Jul 15 22:14:02.896706 ip-10-0-136-3 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 22:14:02.896717 ip-10-0-136-3 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 22:14:02.896724 ip-10-0-136-3 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 22:14:02.897072 ip-10-0-136-3 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 22:14:12.624411 ip-10-0-136-3 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 15 22:14:12.624425 ip-10-0-136-3 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7985f5f20542406db5cb47854d1cfd7a --
Jul 15 22:15:43.347533 ip-10-0-136-3 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.805734    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809737    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809749    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809754    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809757    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809765    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809769    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809771    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:15:43.817846 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809774    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809777    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809779    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809782    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809785    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809787    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809790    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809792    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809795    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809797    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809800    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809802    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809805    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809808    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809811    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809813    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809816    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809818    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809821    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809824    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:15:43.823028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809827    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809830    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809834    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809838    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809841    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809843    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809846    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809848    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809851    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809854    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809856    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809859    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809861    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809864    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809866    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809869    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809871    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809873    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809876    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:15:43.823594 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809878    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809881    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809883    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809886    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809888    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809891    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809894    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809897    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809899    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809902    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809905    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809907    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809910    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809912    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809916    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809918    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809921    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809923    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809926    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:15:43.824069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809928    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809931    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809933    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809936    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809939    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809942    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809945    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809947    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809950    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809952    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809956    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809959    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809961    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809964    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809967    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809970    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809973    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809977    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809980    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:15:43.824543 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809983    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809986    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809989    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809991    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809994    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809996    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.809999    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810002    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810004    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810007    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810009    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810012    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810014    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810017    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.810020    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811656    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811665    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811668    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811671    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811675    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:15:43.824978 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811678    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811681    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811683    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811686    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811688    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811691    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811694    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811696    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811698    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811701    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811704    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811706    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811709    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811712    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811714    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811717    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811719    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811722    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811725    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811728    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:15:43.825505 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811731    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811733    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811735    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811738    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811740    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811746    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811749    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811751    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811753    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811756    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811758    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811761    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811764    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811766    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811769    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811771    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811774    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811776    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811779    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811782    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:15:43.826028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811784    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811787    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811789    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811793    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811796    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811799    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811802    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811805    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811807    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811811    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811815    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811817    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811820    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811823    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811825    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811828    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811831    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811836    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811839    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:15:43.826533 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811842    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811845    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811847    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811850    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811852    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811855    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811858    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811861    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811863    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811865    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811869    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811871    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811874    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811876    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811879    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811881    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811884    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811887    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811889    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811892    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:15:43.826983 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811894    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811896    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811899    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811901    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811904    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811906    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811908    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811911    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811913    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811916    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811920    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811923    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811925    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811927    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.811930    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812281    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812286    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812289    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812293    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812295    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:15:43.827474 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812299    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812301    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812304    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812307    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812309    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812312    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812314    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812317    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812319    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812323    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812326    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812329    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812331    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812334    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812336    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812339    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812343    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812347    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812350    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:15:43.827961 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812353    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812357    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812360    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812364    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812366    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812370    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812372    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812375    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812377    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812380    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812382    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812385    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812391    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812393    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812396    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812398    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812401    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812403    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812406    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:15:43.828435 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812408    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812411    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812413    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812417    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812420    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812422    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812425    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812427    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812430    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812432    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812435    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812438    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812440    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812442    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812445    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812448    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812452    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812454    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812456    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812459    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:15:43.828935 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812461    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812464    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812466    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812469    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812471    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812474    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812477    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812479    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812482    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812484    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812487    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812489    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812492    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812494    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812497    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812501    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812503    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812506    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812509    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812512    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:15:43.829496 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812514    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812517    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812519    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812522    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812524    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812527    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812529    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812532    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812535    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812538    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812540    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812543    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812545    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812548    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812551    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.812554    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812629    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812639    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812648    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812656    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812662    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 22:15:43.829971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812665    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812669    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812673    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812676    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812679    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812682    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812688    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812691    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812694    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812697    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812700    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812702    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812705    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812709    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812712    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812715    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812718    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812721    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812724    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812731    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812734    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812737    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812740    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812743    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 22:15:43.830539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812746    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812749    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812752    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812756    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812759    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812762    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812765    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812768    2580 flags.go:64] FLAG: --enable-server="true"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812771    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812776    2580 flags.go:64] FLAG: --event-burst="100"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812779    2580 flags.go:64] FLAG: --event-qps="50"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812781    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812784    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812787    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812792    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812795    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812798    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812801    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812804    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812807    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812810    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812812    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812815    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812818    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812821    2580 flags.go:64] FLAG: --feature-gates=""
Jul 15 22:15:43.831100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812825    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812828    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812832    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812836    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812839    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812842    2580 flags.go:64] FLAG: --help="false"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812845    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-3.ec2.internal"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812848    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812851    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812854    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812857    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812860    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812863    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812865    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812868    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812871    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812874    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812877    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812880    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812883    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812885    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812889    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812892    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812895    2580 flags.go:64] FLAG: --lock-file=""
Jul 15 22:15:43.831784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812898    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812901    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812904    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812909    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812912    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812914    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812917    2580 flags.go:64] FLAG: --logging-format="text"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812920    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812924    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812926    2580 flags.go:64] FLAG: --manifest-url=""
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812931    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812935    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812938    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812942    2580 flags.go:64] FLAG: --max-pods="110"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812945    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812948    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812951    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812954    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812956    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812959    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812962    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812968    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812971    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812974    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 22:15:43.832389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812978    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812981    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812986    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812989    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812992    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812995    2580 flags.go:64] FLAG: --port="10250"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.812999    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813002    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08010c8c263709a9a"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813005    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813008    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813011    2580 flags.go:64] FLAG: --register-node="true"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813013    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813018    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813021    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813024    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813026    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813030    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813033    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813038    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813040    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813043    2580 flags.go:64] FLAG: --runonce="false"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813046    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813049    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813052    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813054    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 22:15:43.832959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813057    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813060    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813063    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813066    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813069    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813085    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813089    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813092    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813096    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813099    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813102    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813107    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813110    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813114    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813118    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813120    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813123    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813126    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813129    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813132    2580 flags.go:64] FLAG: --v="2"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813136    2580 flags.go:64] FLAG: --version="false"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813140    2580 flags.go:64] FLAG: --vmodule=""
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813143    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.813146    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813268    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:15:43.833611 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813273    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813276    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813280    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813284    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813287    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813290    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813293    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813295    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813298    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813301    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813303    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813306    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813308    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813311    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813313    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813316    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813319    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813321    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813324    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813327    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:15:43.834217 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813332    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813336    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813339    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813342    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813345    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813347    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813350    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813353    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813355    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813358    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813360    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813363    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813367    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813370    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813372    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813375    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813377    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813380    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813382    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:15:43.834786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813384    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813387    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813390    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813392    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813394    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813397    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813399    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813402    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813404    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813407    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813409    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813412    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813415    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813419    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813421    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813424    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813426    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813429    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813431    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813434    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:15:43.835460 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813436    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813439    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813441    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813444    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813446    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813450    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813452    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813455    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813457    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813460    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813462    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813465    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813467    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813470    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813472    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813475    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813478    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813481    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813484    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813487    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:15:43.835968 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813490    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813492    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813495    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813498    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813500    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813504    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813506    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813509    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813511    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813514    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813517    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813519    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813522    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813524    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813526    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813529    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813531    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813535    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:15:43.836479 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.813537    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.814306    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.824347    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.824362    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.824381    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.824387    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824453    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824458    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824462    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824464    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824467    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824470    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824473    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824476    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824481    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:15:43.836952 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824485    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824489    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824493    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824497    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824501    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824506    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824509    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824512    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824514    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824517    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824519    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824522    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824525    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824528    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824531    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824534    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824537    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824540    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824543    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:15:43.837357 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824546    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824548    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824551    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824555    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824560    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824564    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824570    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824574    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824577    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824580    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824583    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824586    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824589    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824591    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824594    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824597    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824599    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824602    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824611    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:15:43.837809 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824614    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824617    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824619    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824622    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824624    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824627    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824630    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824633    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824637    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824641    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824646    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824649    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824652    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824655    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824657    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824660    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824662    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824664    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824667    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824670    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:15:43.838322 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824672    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824675    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824677    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824680    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824682    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824685    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824687    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824690    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824692    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824695    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824697    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824700    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824709    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824714    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824718    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824722    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824726    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824728    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824732    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824735    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:15:43.838799 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824738    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824741    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824744    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824747    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824750    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824752    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824755    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824757    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824760    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824763    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824765    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824767    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.824773    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824897    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824902    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:15:43.839281 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824906    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824909    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824911    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824915    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824920    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824922    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824925    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824927    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824930    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824933    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824937    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824939    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824943    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824947    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824951    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824955    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824959    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824962    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824965    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824967    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:15:43.839657 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824970    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824973    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824976    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824978    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824981    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824984    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824987    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824989    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824992    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824996    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.824999    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825002    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825005    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825008    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825010    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825013    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825015    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825018    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825024    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:15:43.840129 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825029    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825034    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825037    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825039    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825043    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825045    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825048    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825051    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825053    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825056    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825058    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825061    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825065    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825068    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825070    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825073    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825075    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825078    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825080    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825082    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:15:43.840616 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825085    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825087    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825090    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825092    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825095    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825098    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825102    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825106    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825110    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825113    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825116    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825118    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825121    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825125    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825128    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825131    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825133    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825136    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825139    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825141    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:15:43.841142 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825144    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825146    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825149    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825151    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825155    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825157    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825160    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825162    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825165    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825167    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825170    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825173    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825178    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825182    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825186    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825188    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825191    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:15:43.841673 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:43.825193    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.825198    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.825316    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.828553    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.830271    2580 server.go:1019] "Starting client certificate rotation"
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.830368    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.830404    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.833077    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 22:15:43.842372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.836894    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 22:15:43.849573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.849557    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 15 22:15:43.851993 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.851978    2580 log.go:25] "Validated CRI v1 image API"
Jul 15 22:15:43.852788 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.852774    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 22:15:43.856141 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.856120    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ecb9baac-2ea3-4297-95f0-a8770a205114:/dev/nvme0n1p3 f26a42b6-7554-4e1f-903c-ef8f8da1aeef:/dev/nvme0n1p4]
Jul 15 22:15:43.856222 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.856139    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 22:15:43.860164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.860145    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 22:15:43.864008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.863903    2580 manager.go:216] Machine: {Timestamp:2026-07-15 22:15:43.86246859 +0000 UTC m=+0.387491801 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099901 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c82f143be4f1ffbf1f5099f654031 SystemUUID:ec2c82f1-43be-4f1f-fbf1-f5099f654031 BootID:7985f5f2-0542-406d-b5cb-47854d1cfd7a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:36:15:61:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:36:15:61:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:1c:7f:89:ce:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 22:15:43.864008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.863997    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 22:15:43.864145 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.864068    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 22:15:43.867687 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.867663    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 22:15:43.867808 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.867690    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 22:15:43.868624 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.868615    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 22:15:43.868657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.868627    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 22:15:43.868657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.868634    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 22:15:43.869493 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.869483    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 22:15:43.871401 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.871391    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 22:15:43.876071 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876059    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 22:15:43.876186 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876176    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 22:15:43.876220 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876207    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 22:15:43.876220 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876218    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 22:15:43.876297 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876232    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 22:15:43.876297 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876254    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 15 22:15:43.876297 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876265    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 22:15:43.876674 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876663    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 22:15:43.876723 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.876681    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 22:15:43.879049 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.879036    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 22:15:43.881447 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881434    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 22:15:43.881496 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881463    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 22:15:43.881612 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881603    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 22:15:43.881654 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881617    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 22:15:43.881654 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881622    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 22:15:43.881654 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881628    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 22:15:43.881654 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881636    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 22:15:43.881654 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.881641    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 22:15:43.882321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.882310    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 22:15:43.882321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.882321    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 22:15:43.882414 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.882327    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 22:15:43.882414 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.882332    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 22:15:43.882414 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.882340    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 22:15:43.882414 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.882350    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 22:15:43.883179 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.883170    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 22:15:43.883179 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.883178    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 22:15:43.886440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.886426    2580 server.go:1268] "Started kubelet"
Jul 15 22:15:43.886537 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.886508    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 22:15:43.886871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.886770    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 22:15:43.886871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.886850    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 22:15:43.887275 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.887233    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 22:15:43.887336 ip-10-0-136-3 systemd[1]: Started Kubernetes Kubelet.
Jul 15 22:15:43.887487 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.887263    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 22:15:43.887487 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.887256    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 22:15:43.888345 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.888304    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 22:15:43.890694 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.890625    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 22:15:43.892316 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.892298    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 22:15:43.893852 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.892778    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18c29660910838fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-07-15 22:15:43.886399739 +0000 UTC m=+0.411422949,LastTimestamp:2026-07-15 22:15:43.886399739 +0000 UTC m=+0.411422949,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Jul 15 22:15:43.895987 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.895969    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 22:15:43.895987 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.895978    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 22:15:43.896125 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.896042    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:43.896649 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896632    2580 factory.go:55] Registering systemd factory
Jul 15 22:15:43.896649 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896651    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 15 22:15:43.896796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896721    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 22:15:43.896796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896735    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 22:15:43.896796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896723    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 22:15:43.896928 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896819    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 22:15:43.896928 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896829    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 22:15:43.896928 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896856    2580 factory.go:153] Registering CRI-O factory
Jul 15 22:15:43.896928 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896867    2580 factory.go:223] Registration of the crio container factory successfully
Jul 15 22:15:43.896928 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896902    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 22:15:43.896928 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896924    2580 factory.go:103] Registering Raw factory
Jul 15 22:15:43.897136 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.896934    2580 manager.go:1196] Started watching for new ooms in manager
Jul 15 22:15:43.897318 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.897305    2580 manager.go:349] Starting recovery of all containers
Jul 15 22:15:43.899315 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.899286    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 22:15:43.899394 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.899336    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 22:15:43.905902 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.905867    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlq87"
Jul 15 22:15:43.913017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.912907    2580 manager.go:354] Recovery completed
Jul 15 22:15:43.914417 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.914399    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlq87"
Jul 15 22:15:43.917094 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.917079    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:15:43.918760 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.918743    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:15:43.918822 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.918774    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:15:43.918822 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.918788    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:15:43.919370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.919339    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 22:15:43.919370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.919351    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 22:15:43.919370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.919367    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 22:15:43.919370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.919369    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:15:43.920087 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.920066    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:15:43.920161 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.920100    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:15:43.920161 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.920111    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:15:43.920739 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.920671    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-3.ec2.internal.18c2966092f5fcef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-3.ec2.internal,UID:ip-10-0-136-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-3.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-3.ec2.internal,},FirstTimestamp:2026-07-15 22:15:43.918759151 +0000 UTC m=+0.443782366,LastTimestamp:2026-07-15 22:15:43.918759151 +0000 UTC m=+0.443782366,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-3.ec2.internal,}"
Jul 15 22:15:43.921514 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.921499    2580 policy_none.go:49] "None policy: Start"
Jul 15 22:15:43.921585 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.921517    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 22:15:43.921585 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.921536    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 22:15:43.924317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.924303    2580 policy_none.go:47] "Start"
Jul 15 22:15:43.957845 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.957828    2580 manager.go:337] "Starting Device Plugin manager"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.957863    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.957876    2580 server.go:87] "Starting device plugin registration server"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.958083    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.958094    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.958226    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.958308    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:43.958316    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.958820    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 22:15:43.976455 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:43.958867    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.002561 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.002540    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 22:15:44.003720 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.003699    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 22:15:44.003790 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.003736    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 22:15:44.003790 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.003754    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 22:15:44.003790 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.003786    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 22:15:44.005769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.005752    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:15:44.058436 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.058408    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:15:44.059801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.059785    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:15:44.059896 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.059816    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:15:44.059896 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.059830    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:15:44.059896 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.059859    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.066312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.066298    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.066365 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.066316    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-3.ec2.internal\": node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.092121 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.092093    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.104476 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.104443    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"]
Jul 15 22:15:44.104536 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.104501    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:15:44.105469 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.105454    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:15:44.105530 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.105485    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:15:44.105530 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.105496    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:15:44.107815 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.107803    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:15:44.107936 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.107913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.107991 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.107945    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:15:44.109144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.108764    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:15:44.109144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.108769    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:15:44.109144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.108790    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:15:44.109144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.108801    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:15:44.109144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.108804    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:15:44.109144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.108815    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:15:44.111132 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.111117    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.111201 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.111143    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:15:44.113518 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.113497    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:15:44.113601 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.113526    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:15:44.113601 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.113540    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:15:44.123764 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.123748    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-3.ec2.internal\" not found" node="ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.128377 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.128362    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-3.ec2.internal\" not found" node="ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.193018 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.192999    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.293453 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.293405    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.297687 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.297670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14184da6420b1883b0b0003e3d2f4bed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-3.ec2.internal\" (UID: \"14184da6420b1883b0b0003e3d2f4bed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.297740 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.297697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3356a5f2c0cd49093c8ef30ebd469c18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"3356a5f2c0cd49093c8ef30ebd469c18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.297740 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.297717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3356a5f2c0cd49093c8ef30ebd469c18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"3356a5f2c0cd49093c8ef30ebd469c18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.393996 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.393965    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.398274 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.398238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14184da6420b1883b0b0003e3d2f4bed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-3.ec2.internal\" (UID: \"14184da6420b1883b0b0003e3d2f4bed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.398337 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.398283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3356a5f2c0cd49093c8ef30ebd469c18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"3356a5f2c0cd49093c8ef30ebd469c18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.398337 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.398298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3356a5f2c0cd49093c8ef30ebd469c18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"3356a5f2c0cd49093c8ef30ebd469c18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.398410 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.398343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3356a5f2c0cd49093c8ef30ebd469c18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"3356a5f2c0cd49093c8ef30ebd469c18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.398443 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.398399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14184da6420b1883b0b0003e3d2f4bed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-3.ec2.internal\" (UID: \"14184da6420b1883b0b0003e3d2f4bed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.398443 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.398428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3356a5f2c0cd49093c8ef30ebd469c18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal\" (UID: \"3356a5f2c0cd49093c8ef30ebd469c18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.425406 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.425387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.431284 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.431266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:44.494679 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.494645    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.595098 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.595073    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.696850 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.696813    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.797301 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.797272    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.829020 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.828993    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 22:15:44.829458 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.829134    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 22:15:44.897914 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.897842    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:44.918976 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.918938    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 22:10:44 +0000 UTC" deadline="2028-01-18 22:43:09.005824935 +0000 UTC"
Jul 15 22:15:44.918976 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:44.918969    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13248h27m24.086858249s"
Jul 15 22:15:44.998761 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:44.998743    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:45.093143 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.093109    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:15:45.099891 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:45.099862    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:45.107306 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:45.107280    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3356a5f2c0cd49093c8ef30ebd469c18.slice/crio-8ac431ea31f7cef31e99aef5fc6693319c6944a6881626f38a7817369eb802fc WatchSource:0}: Error finding container 8ac431ea31f7cef31e99aef5fc6693319c6944a6881626f38a7817369eb802fc: Status 404 returned error can't find the container with id 8ac431ea31f7cef31e99aef5fc6693319c6944a6881626f38a7817369eb802fc
Jul 15 22:15:45.114954 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.114931    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:15:45.120001 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:45.119978    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14184da6420b1883b0b0003e3d2f4bed.slice/crio-980ab60fe599a562a6a207e43fa2749678c90b205cdf5f0b75ff6012b5ad687f WatchSource:0}: Error finding container 980ab60fe599a562a6a207e43fa2749678c90b205cdf5f0b75ff6012b5ad687f: Status 404 returned error can't find the container with id 980ab60fe599a562a6a207e43fa2749678c90b205cdf5f0b75ff6012b5ad687f
Jul 15 22:15:45.200798 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:45.200715    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-3.ec2.internal\" not found"
Jul 15 22:15:45.238790 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.238770    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:15:45.298621 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.298582    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:45.310712 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.310689    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 22:15:45.311630 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.311617    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal"
Jul 15 22:15:45.325741 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.325722    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 22:15:45.443419 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.443389    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:15:45.877949 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.877915    2580 apiserver.go:52] "Watching apiserver"
Jul 15 22:15:45.883910 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.883871    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 22:15:45.884456 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.884405    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gsl96","kube-system/konnectivity-agent-mz9jz","openshift-cluster-node-tuning-operator/tuned-d8827","openshift-dns/node-resolver-hzqkp","openshift-image-registry/node-ca-xwv8k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal","openshift-network-operator/iptables-alerter-swrfz","openshift-ovn-kubernetes/ovnkube-node-wn4wl","kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct","openshift-multus/multus-additional-cni-plugins-xnz7z","openshift-multus/multus-rxrp4","openshift-multus/network-metrics-daemon-xq5ww","openshift-network-diagnostics/network-check-target-n49b8"]
Jul 15 22:15:45.887211 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.887185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.890276 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.890251    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:15:45.890529 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.890508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-grdd6\""
Jul 15 22:15:45.890795 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.890776    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 22:15:45.891490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.891469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.894466 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.893957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:45.895011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.894989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 22:15:45.895402 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.895339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 22:15:45.895505 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.895437    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 22:15:45.895505 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.895468    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h4vlc\""
Jul 15 22:15:45.896734 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.896133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:45.896734 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:45.896208    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:15:45.896734 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.896246    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 22:15:45.896734 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.896551    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 22:15:45.898316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.897638    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 22:15:45.898316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.898195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qbh58\""
Jul 15 22:15:45.900812 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.900231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:45.902587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.901911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:45.903269 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.902899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qdlvw\""
Jul 15 22:15:45.903269 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.903113    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 22:15:45.903796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.903584    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 22:15:45.903888 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.903832    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 22:15:45.904620 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.904602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:45.905554 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.905381    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7fs2r\""
Jul 15 22:15:45.905554 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.905418    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 22:15:45.905710 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.905667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 22:15:45.905872 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.905840    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:15:45.906387 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-644h7\" (UniqueName: \"kubernetes.io/projected/5ee7f799-55c8-4726-9e16-6f87f635570c-kube-api-access-644h7\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.906486 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klbtm\" (UniqueName: \"kubernetes.io/projected/a74c030e-d29d-46da-8305-d14bde4d3d9d-kube-api-access-klbtm\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:45.906486 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:45.906486 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysctl-conf\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.906486 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-systemd\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.906691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-var-lib-kubelet\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.906691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a74c030e-d29d-46da-8305-d14bde4d3d9d-tmp-dir\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:45.906691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysconfig\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.906691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-kubernetes\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.906691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-run\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.906691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b637baad-e920-42b5-9d47-b5b5d0991054-etc-tuned\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.906691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a74c030e-d29d-46da-8305-d14bde4d3d9d-hosts-file\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:45.907043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-registration-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.907043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-device-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.907043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-sys-fs\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.907043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-dbus\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:45.907043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysctl-d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.907043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-sys\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.907043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.906935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b637baad-e920-42b5-9d47-b5b5d0991054-tmp\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.907447 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.907426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.907535 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.907518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-kubelet-config\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:45.907745 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.907648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-host\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.907809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.907772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhv8d\" (UniqueName: \"kubernetes.io/projected/b637baad-e920-42b5-9d47-b5b5d0991054-kube-api-access-mhv8d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.908820 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.908796    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.909439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-socket-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.909476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d167f8d-ca9d-42e6-9a4c-2175797892ac-host\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.909516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jztp\" (UniqueName: \"kubernetes.io/projected/5d167f8d-ca9d-42e6-9a4c-2175797892ac-kube-api-access-5jztp\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.909551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-modprobe-d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.909655    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rhsbb\""
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.910094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-lib-modules\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.910127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.910201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.910162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d167f8d-ca9d-42e6-9a4c-2175797892ac-serviceca\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:45.910659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.910373    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 22:15:45.911306 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.910830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 22:15:45.911306 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.910942    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 22:15:45.911306 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.911283    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 22:15:45.912424 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.912402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:45.915873 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.915852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:45.917941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.917719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4rkv5\""
Jul 15 22:15:45.917941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.917911    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 22:15:45.918105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.918054    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 22:15:45.918224 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.918206    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 22:15:45.918588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.918570    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 22:15:45.919365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.918901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94vtx\""
Jul 15 22:15:45.919365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.919092    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 22:15:45.919365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.919226    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 22:15:45.919365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.919273    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 22:15:45.920338 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.920315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:45.920848 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.920664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 22:15:45.922596 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.922574    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95zp2\""
Jul 15 22:15:45.923103 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.922964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:45.923103 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:45.923029    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:15:45.923373 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.923351    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 22:15:45.925244 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.925221    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:45.925362 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:45.925294    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:15:45.937085 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.937061    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cqr4z"
Jul 15 22:15:45.945208 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.945155    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cqr4z"
Jul 15 22:15:45.998427 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:45.998401    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 22:15:46.010646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7rhh\" (UniqueName: \"kubernetes.io/projected/142b818f-5a55-4dff-b47e-12ed53564ac7-kube-api-access-d7rhh\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.010646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-ovn\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.010858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-system-cni-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.010858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-cnibin\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.010858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-sys-fs\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.010858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-ovnkube-config\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.010858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8r64\" (UniqueName: \"kubernetes.io/projected/e8fe13d4-2dc1-45fc-be52-222402d3a623-kube-api-access-r8r64\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.011105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-sys-fs\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.011105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysctl-d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.011105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.011105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-k8s-cni-cncf-io\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.011105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.010996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-cni-multus\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.011105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysctl-d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.011105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-kubelet\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-daemon-config\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/142b818f-5a55-4dff-b47e-12ed53564ac7-host-slash\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-kubelet\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-cni-binary-copy\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-socket-dir-parent\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr4nm\" (UniqueName: \"kubernetes.io/projected/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-kube-api-access-mr4nm\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-socket-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d167f8d-ca9d-42e6-9a4c-2175797892ac-host\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:46.011478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jztp\" (UniqueName: \"kubernetes.io/projected/5d167f8d-ca9d-42e6-9a4c-2175797892ac-kube-api-access-5jztp\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-systemd-units\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-os-release\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-modprobe-d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d167f8d-ca9d-42e6-9a4c-2175797892ac-host\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-lib-modules\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-lib-modules\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-socket-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-modprobe-d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d167f8d-ca9d-42e6-9a4c-2175797892ac-serviceca\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-slash\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-run-netns\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.011977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-etc-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.012054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-cni-bin\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4rv\" (UniqueName: \"kubernetes.io/projected/84693dac-8a3e-4731-8778-2a99c37b0e32-kube-api-access-nf4rv\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-644h7\" (UniqueName: \"kubernetes.io/projected/5ee7f799-55c8-4726-9e16-6f87f635570c-kube-api-access-644h7\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-cni-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-var-lib-kubelet\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a74c030e-d29d-46da-8305-d14bde4d3d9d-tmp-dir\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-node-log\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal" event={"ID":"14184da6420b1883b0b0003e3d2f4bed","Type":"ContainerStarted","Data":"980ab60fe599a562a6a207e43fa2749678c90b205cdf5f0b75ff6012b5ad687f"}
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-hostroot\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysconfig\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-kubernetes\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-run\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d167f8d-ca9d-42e6-9a4c-2175797892ac-serviceca\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b637baad-e920-42b5-9d47-b5b5d0991054-etc-tuned\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a74c030e-d29d-46da-8305-d14bde4d3d9d-hosts-file\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-system-cni-dir\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.012751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-cni-binary-copy\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a74c030e-d29d-46da-8305-d14bde4d3d9d-tmp-dir\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012894    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-run\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a74c030e-d29d-46da-8305-d14bde4d3d9d-hosts-file\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.012727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-conf-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-kubernetes\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-registration-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-device-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysconfig\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-dbus\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-device-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-log-socket\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-var-lib-kubelet\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-registration-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-dbus\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:46.013587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-cnibin\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-sys\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b637baad-e920-42b5-9d47-b5b5d0991054-tmp\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-sys\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-kubelet-config\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-cni-netd\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-kubelet-config\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbgt\" (UniqueName: \"kubernetes.io/projected/a6713e93-db89-44aa-8b21-e073154e177f-kube-api-access-nzbgt\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-etc-kubernetes\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.013971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-host\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.014020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhv8d\" (UniqueName: \"kubernetes.io/projected/b637baad-e920-42b5-9d47-b5b5d0991054-kube-api-access-mhv8d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.014026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-host\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.014064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-var-lib-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.014090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-cni-bin\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.014459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.014112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-netns\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.017818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.017537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.017818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.017599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-systemd\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.017818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.017677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ee7f799-55c8-4726-9e16-6f87f635570c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.017818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.017697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.017818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.017740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-multus-certs\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.017818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.017805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b637baad-e920-42b5-9d47-b5b5d0991054-etc-tuned\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.018233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.017809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klbtm\" (UniqueName: \"kubernetes.io/projected/a74c030e-d29d-46da-8305-d14bde4d3d9d-kube-api-access-klbtm\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:46.018233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:46.018233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-env-overrides\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.018233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" event={"ID":"3356a5f2c0cd49093c8ef30ebd469c18","Type":"ContainerStarted","Data":"8ac431ea31f7cef31e99aef5fc6693319c6944a6881626f38a7817369eb802fc"}
Jul 15 22:15:46.018233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89e4af4d-f5a4-41c2-9f94-d529139156cf-agent-certs\") pod \"konnectivity-agent-mz9jz\" (UID: \"89e4af4d-f5a4-41c2-9f94-d529139156cf\") " pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:46.018512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysctl-conf\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.018512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-systemd\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.018512 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.018374    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:46.018512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6713e93-db89-44aa-8b21-e073154e177f-ovn-node-metrics-cert\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.018512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-ovnkube-script-lib\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.018512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89e4af4d-f5a4-41c2-9f94-d529139156cf-konnectivity-ca\") pod \"konnectivity-agent-mz9jz\" (UID: \"89e4af4d-f5a4-41c2-9f94-d529139156cf\") " pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:46.018795 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-sysctl-conf\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.018795 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.018572    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret podName:eecc91ea-9fc4-4acf-8470-6e01e8d07bf5 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:46.518521676 +0000 UTC m=+3.043544876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret") pod "global-pull-secret-syncer-gsl96" (UID: "eecc91ea-9fc4-4acf-8470-6e01e8d07bf5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:46.018795 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-os-release\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.018795 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b637baad-e920-42b5-9d47-b5b5d0991054-etc-systemd\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.018795 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.018689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/142b818f-5a55-4dff-b47e-12ed53564ac7-iptables-alerter-script\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.020873 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.020797    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b637baad-e920-42b5-9d47-b5b5d0991054-tmp\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.027003 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.026975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jztp\" (UniqueName: \"kubernetes.io/projected/5d167f8d-ca9d-42e6-9a4c-2175797892ac-kube-api-access-5jztp\") pod \"node-ca-xwv8k\" (UID: \"5d167f8d-ca9d-42e6-9a4c-2175797892ac\") " pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:46.028617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.028592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-644h7\" (UniqueName: \"kubernetes.io/projected/5ee7f799-55c8-4726-9e16-6f87f635570c-kube-api-access-644h7\") pod \"aws-ebs-csi-driver-node-qxvct\" (UID: \"5ee7f799-55c8-4726-9e16-6f87f635570c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.031599 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.031547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhv8d\" (UniqueName: \"kubernetes.io/projected/b637baad-e920-42b5-9d47-b5b5d0991054-kube-api-access-mhv8d\") pod \"tuned-d8827\" (UID: \"b637baad-e920-42b5-9d47-b5b5d0991054\") " pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.033394 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.033364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klbtm\" (UniqueName: \"kubernetes.io/projected/a74c030e-d29d-46da-8305-d14bde4d3d9d-kube-api-access-klbtm\") pod \"node-resolver-hzqkp\" (UID: \"a74c030e-d29d-46da-8305-d14bde4d3d9d\") " pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-os-release\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/142b818f-5a55-4dff-b47e-12ed53564ac7-iptables-alerter-script\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7rhh\" (UniqueName: \"kubernetes.io/projected/142b818f-5a55-4dff-b47e-12ed53564ac7-kube-api-access-d7rhh\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-ovn\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-system-cni-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-cnibin\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-ovnkube-config\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-os-release\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8r64\" (UniqueName: \"kubernetes.io/projected/e8fe13d4-2dc1-45fc-be52-222402d3a623-kube-api-access-r8r64\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-k8s-cni-cncf-io\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-cni-multus\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-system-cni-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-kubelet\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-daemon-config\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-ovn\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-k8s-cni-cncf-io\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/142b818f-5a55-4dff-b47e-12ed53564ac7-host-slash\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.119657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/142b818f-5a55-4dff-b47e-12ed53564ac7-host-slash\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-cnibin\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-cni-multus\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-kubelet\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-kubelet\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-cni-binary-copy\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-socket-dir-parent\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr4nm\" (UniqueName: \"kubernetes.io/projected/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-kube-api-access-mr4nm\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-systemd-units\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-os-release\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-slash\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-run-netns\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-etc-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-cni-bin\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4rv\" (UniqueName: \"kubernetes.io/projected/84693dac-8a3e-4731-8778-2a99c37b0e32-kube-api-access-nf4rv\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:46.120813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-cni-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.119990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/142b818f-5a55-4dff-b47e-12ed53564ac7-iptables-alerter-script\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-node-log\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-hostroot\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-kubelet\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-system-cni-dir\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.120132    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-cni-binary-copy\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-conf-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.120202    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs podName:84693dac-8a3e-4731-8778-2a99c37b0e32 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:46.620182634 +0000 UTC m=+3.145205849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs") pod "network-metrics-daemon-xq5ww" (UID: "84693dac-8a3e-4731-8778-2a99c37b0e32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-conf-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-log-socket\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120382    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-cnibin\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-cni-netd\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.121715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbgt\" (UniqueName: \"kubernetes.io/projected/a6713e93-db89-44aa-8b21-e073154e177f-kube-api-access-nzbgt\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-etc-kubernetes\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-var-lib-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-cni-bin\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-netns\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-systemd\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-daemon-config\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-node-log\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-systemd-units\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-ovnkube-config\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-system-cni-dir\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.122633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-multus-certs\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-var-lib-cni-bin\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-socket-dir-parent\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-env-overrides\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-os-release\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89e4af4d-f5a4-41c2-9f94-d529139156cf-agent-certs\") pod \"konnectivity-agent-mz9jz\" (UID: \"89e4af4d-f5a4-41c2-9f94-d529139156cf\") " pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6713e93-db89-44aa-8b21-e073154e177f-ovn-node-metrics-cert\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-ovnkube-script-lib\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89e4af4d-f5a4-41c2-9f94-d529139156cf-konnectivity-ca\") pod \"konnectivity-agent-mz9jz\" (UID: \"89e4af4d-f5a4-41c2-9f94-d529139156cf\") " pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-multus-cni-dir\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-cni-netd\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-cni-binary-copy\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-run-netns\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-cni-binary-copy\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-hostroot\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-slash\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-netns\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-etc-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.123546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-cnibin\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-log-socket\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-etc-kubernetes\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89e4af4d-f5a4-41c2-9f94-d529139156cf-konnectivity-ca\") pod \"konnectivity-agent-mz9jz\" (UID: \"89e4af4d-f5a4-41c2-9f94-d529139156cf\") " pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-var-lib-openvswitch\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-run-systemd\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6713e93-db89-44aa-8b21-e073154e177f-host-cni-bin\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.121777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fe13d4-2dc1-45fc-be52-222402d3a623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.120882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-host-run-multus-certs\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.122089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8fe13d4-2dc1-45fc-be52-222402d3a623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.122164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-env-overrides\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.122606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6713e93-db89-44aa-8b21-e073154e177f-ovnkube-script-lib\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124987 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.124683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6713e93-db89-44aa-8b21-e073154e177f-ovn-node-metrics-cert\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.124987 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.124741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89e4af4d-f5a4-41c2-9f94-d529139156cf-agent-certs\") pod \"konnectivity-agent-mz9jz\" (UID: \"89e4af4d-f5a4-41c2-9f94-d529139156cf\") " pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:46.130899 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.130830    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:15:46.130899 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.130855    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:15:46.130899 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.130867    2580 projected.go:196] Error preparing data for projected volume kube-api-access-btw7w for pod openshift-network-diagnostics/network-check-target-n49b8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:46.131134 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.130929    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w podName:002d59a9-74b7-4bc3-8222-40a35a4bc153 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:46.630912761 +0000 UTC m=+3.155936004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btw7w" (UniqueName: "kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w") pod "network-check-target-n49b8" (UID: "002d59a9-74b7-4bc3-8222-40a35a4bc153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:46.131134 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.131093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8r64\" (UniqueName: \"kubernetes.io/projected/e8fe13d4-2dc1-45fc-be52-222402d3a623-kube-api-access-r8r64\") pod \"multus-additional-cni-plugins-xnz7z\" (UID: \"e8fe13d4-2dc1-45fc-be52-222402d3a623\") " pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.132621 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.132530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbgt\" (UniqueName: \"kubernetes.io/projected/a6713e93-db89-44aa-8b21-e073154e177f-kube-api-access-nzbgt\") pod \"ovnkube-node-wn4wl\" (UID: \"a6713e93-db89-44aa-8b21-e073154e177f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.133193 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.133170    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr4nm\" (UniqueName: \"kubernetes.io/projected/0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98-kube-api-access-mr4nm\") pod \"multus-rxrp4\" (UID: \"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98\") " pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.133855 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.133828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7rhh\" (UniqueName: \"kubernetes.io/projected/142b818f-5a55-4dff-b47e-12ed53564ac7-kube-api-access-d7rhh\") pod \"iptables-alerter-swrfz\" (UID: \"142b818f-5a55-4dff-b47e-12ed53564ac7\") " pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.134431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.134180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4rv\" (UniqueName: \"kubernetes.io/projected/84693dac-8a3e-4731-8778-2a99c37b0e32-kube-api-access-nf4rv\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:46.204130 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.204095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d8827"
Jul 15 22:15:46.217896 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.217868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct"
Jul 15 22:15:46.219997 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:46.219962    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb637baad_e920_42b5_9d47_b5b5d0991054.slice/crio-a4715e1d81eb673e4b2d5df72da04298bd246c55f626b3d3fbb4086143c20f21 WatchSource:0}: Error finding container a4715e1d81eb673e4b2d5df72da04298bd246c55f626b3d3fbb4086143c20f21: Status 404 returned error can't find the container with id a4715e1d81eb673e4b2d5df72da04298bd246c55f626b3d3fbb4086143c20f21
Jul 15 22:15:46.229391 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:46.229359    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee7f799_55c8_4726_9e16_6f87f635570c.slice/crio-760d8b0194850707c10cbc05ba1ee35ce87e952dda900b8ac67fa7570990bdc8 WatchSource:0}: Error finding container 760d8b0194850707c10cbc05ba1ee35ce87e952dda900b8ac67fa7570990bdc8: Status 404 returned error can't find the container with id 760d8b0194850707c10cbc05ba1ee35ce87e952dda900b8ac67fa7570990bdc8
Jul 15 22:15:46.229524 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.229455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzqkp"
Jul 15 22:15:46.237308 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.237079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xwv8k"
Jul 15 22:15:46.238727 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.238704    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:15:46.247471 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.247386    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swrfz"
Jul 15 22:15:46.250353 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:46.250323    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d167f8d_ca9d_42e6_9a4c_2175797892ac.slice/crio-4ded84f81b5233ed195dd4b653f7078d24a6048472fa4bcd10f1e2bdecfcf834 WatchSource:0}: Error finding container 4ded84f81b5233ed195dd4b653f7078d24a6048472fa4bcd10f1e2bdecfcf834: Status 404 returned error can't find the container with id 4ded84f81b5233ed195dd4b653f7078d24a6048472fa4bcd10f1e2bdecfcf834
Jul 15 22:15:46.264269 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.264241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:15:46.274157 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.274135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:15:46.275849 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:46.275822    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6713e93_db89_44aa_8b21_e073154e177f.slice/crio-5ad16145334bafff58d3e90084b07d07ffb6dd3c665d219499740ce4afecb2cb WatchSource:0}: Error finding container 5ad16145334bafff58d3e90084b07d07ffb6dd3c665d219499740ce4afecb2cb: Status 404 returned error can't find the container with id 5ad16145334bafff58d3e90084b07d07ffb6dd3c665d219499740ce4afecb2cb
Jul 15 22:15:46.282876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.282854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xnz7z"
Jul 15 22:15:46.289239 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:46.289213    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e4af4d_f5a4_41c2_9f94_d529139156cf.slice/crio-541d6120872cfad2cf9611715f734d9249bfca2e23be031993569e396102ffd8 WatchSource:0}: Error finding container 541d6120872cfad2cf9611715f734d9249bfca2e23be031993569e396102ffd8: Status 404 returned error can't find the container with id 541d6120872cfad2cf9611715f734d9249bfca2e23be031993569e396102ffd8
Jul 15 22:15:46.291191 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.291078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rxrp4"
Jul 15 22:15:46.297177 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:46.297147    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fe13d4_2dc1_45fc_be52_222402d3a623.slice/crio-212babe4e043dcf35b29cddf76f1c742c6c362c790dbbd25b0ee6f92088a7b92 WatchSource:0}: Error finding container 212babe4e043dcf35b29cddf76f1c742c6c362c790dbbd25b0ee6f92088a7b92: Status 404 returned error can't find the container with id 212babe4e043dcf35b29cddf76f1c742c6c362c790dbbd25b0ee6f92088a7b92
Jul 15 22:15:46.303499 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:15:46.303465    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8d7457_3d36_4c83_8b2e_00f5c8a6fc98.slice/crio-3dd30595b145a38ca2163b37a02f7d26ebd051534a8fe4d1969b2191bdf4dcb5 WatchSource:0}: Error finding container 3dd30595b145a38ca2163b37a02f7d26ebd051534a8fe4d1969b2191bdf4dcb5: Status 404 returned error can't find the container with id 3dd30595b145a38ca2163b37a02f7d26ebd051534a8fe4d1969b2191bdf4dcb5
Jul 15 22:15:46.524316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.524220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:46.524493 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.524391    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:46.524493 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.524481    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret podName:eecc91ea-9fc4-4acf-8470-6e01e8d07bf5 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:47.524458466 +0000 UTC m=+4.049481666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret") pod "global-pull-secret-syncer-gsl96" (UID: "eecc91ea-9fc4-4acf-8470-6e01e8d07bf5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:46.624676 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.624622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:46.624882 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.624809    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:46.624882 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.624879    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs podName:84693dac-8a3e-4731-8778-2a99c37b0e32 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:47.624861141 +0000 UTC m=+4.149884345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs") pod "network-metrics-daemon-xq5ww" (UID: "84693dac-8a3e-4731-8778-2a99c37b0e32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:46.725214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.725177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:46.725394 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.725351    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:15:46.725394 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.725368    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:15:46.725394 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.725378    2580 projected.go:196] Error preparing data for projected volume kube-api-access-btw7w for pod openshift-network-diagnostics/network-check-target-n49b8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:46.725543 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:46.725439    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w podName:002d59a9-74b7-4bc3-8222-40a35a4bc153 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:47.725419089 +0000 UTC m=+4.250442310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btw7w" (UniqueName: "kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w") pod "network-check-target-n49b8" (UID: "002d59a9-74b7-4bc3-8222-40a35a4bc153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:46.949110 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.948999    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:10:46 +0000 UTC" deadline="2027-12-24 11:37:53.716813181 +0000 UTC"
Jul 15 22:15:46.949110 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:46.949060    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12637h22m6.767757327s"
Jul 15 22:15:47.004590 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.004551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:47.004783 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.004681    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:15:47.021808 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.021769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"5ad16145334bafff58d3e90084b07d07ffb6dd3c665d219499740ce4afecb2cb"}
Jul 15 22:15:47.023258 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.023228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzqkp" event={"ID":"a74c030e-d29d-46da-8305-d14bde4d3d9d","Type":"ContainerStarted","Data":"94523545e664b463ae47c5166df3ceec1f4b1be46d1aa2671aa2a39723f65831"}
Jul 15 22:15:47.024778 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.024748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rxrp4" event={"ID":"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98","Type":"ContainerStarted","Data":"3dd30595b145a38ca2163b37a02f7d26ebd051534a8fe4d1969b2191bdf4dcb5"}
Jul 15 22:15:47.026165 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.026112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mz9jz" event={"ID":"89e4af4d-f5a4-41c2-9f94-d529139156cf","Type":"ContainerStarted","Data":"541d6120872cfad2cf9611715f734d9249bfca2e23be031993569e396102ffd8"}
Jul 15 22:15:47.028156 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.027924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swrfz" event={"ID":"142b818f-5a55-4dff-b47e-12ed53564ac7","Type":"ContainerStarted","Data":"6575be46f898de709f4ec37abed68a72f8304e158dfea8c96bf8c94bbfd5d25e"}
Jul 15 22:15:47.029257 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.029220    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xwv8k" event={"ID":"5d167f8d-ca9d-42e6-9a4c-2175797892ac","Type":"ContainerStarted","Data":"4ded84f81b5233ed195dd4b653f7078d24a6048472fa4bcd10f1e2bdecfcf834"}
Jul 15 22:15:47.030797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.030767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct" event={"ID":"5ee7f799-55c8-4726-9e16-6f87f635570c","Type":"ContainerStarted","Data":"760d8b0194850707c10cbc05ba1ee35ce87e952dda900b8ac67fa7570990bdc8"}
Jul 15 22:15:47.032559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.032494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d8827" event={"ID":"b637baad-e920-42b5-9d47-b5b5d0991054","Type":"ContainerStarted","Data":"a4715e1d81eb673e4b2d5df72da04298bd246c55f626b3d3fbb4086143c20f21"}
Jul 15 22:15:47.034022 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.033996    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerStarted","Data":"212babe4e043dcf35b29cddf76f1c742c6c362c790dbbd25b0ee6f92088a7b92"}
Jul 15 22:15:47.531053 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.531012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:47.531329 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.531222    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:47.531329 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.531311    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret podName:eecc91ea-9fc4-4acf-8470-6e01e8d07bf5 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:49.531274971 +0000 UTC m=+6.056298176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret") pod "global-pull-secret-syncer-gsl96" (UID: "eecc91ea-9fc4-4acf-8470-6e01e8d07bf5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:47.632552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.632512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:47.632752 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.632709    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:47.632819 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.632781    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs podName:84693dac-8a3e-4731-8778-2a99c37b0e32 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:49.632759389 +0000 UTC m=+6.157782591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs") pod "network-metrics-daemon-xq5ww" (UID: "84693dac-8a3e-4731-8778-2a99c37b0e32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:47.733354 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.733313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:47.733559 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.733497    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:15:47.733559 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.733519    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:15:47.733559 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.733533    2580 projected.go:196] Error preparing data for projected volume kube-api-access-btw7w for pod openshift-network-diagnostics/network-check-target-n49b8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:47.733727 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:47.733595    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w podName:002d59a9-74b7-4bc3-8222-40a35a4bc153 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:49.733576281 +0000 UTC m=+6.258599487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btw7w" (UniqueName: "kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w") pod "network-check-target-n49b8" (UID: "002d59a9-74b7-4bc3-8222-40a35a4bc153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:47.949617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.949416    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:10:46 +0000 UTC" deadline="2028-05-01 11:28:33.303401088 +0000 UTC"
Jul 15 22:15:47.949617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:47.949452    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15733h12m45.353954325s"
Jul 15 22:15:48.007021 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:48.006983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:48.007215 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:48.007118    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:15:48.007466 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:48.007446    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:48.007584 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:48.007564    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:15:48.042150 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:48.041356    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal" event={"ID":"14184da6420b1883b0b0003e3d2f4bed","Type":"ContainerStarted","Data":"394d927d835289701ed78f7af8fc0fc2dd007363ce297bece22ed5e7c4e44313"}
Jul 15 22:15:49.004874 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:49.004836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:49.005378 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.004981    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:15:49.071342 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:49.071294    2580 generic.go:356] "Generic (PLEG): container finished" podID="3356a5f2c0cd49093c8ef30ebd469c18" containerID="9647bcc11f0695806af4c3c558518e3fe711ae44374702c45f5457ba1cec91fb" exitCode=0
Jul 15 22:15:49.072406 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:49.072379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" event={"ID":"3356a5f2c0cd49093c8ef30ebd469c18","Type":"ContainerDied","Data":"9647bcc11f0695806af4c3c558518e3fe711ae44374702c45f5457ba1cec91fb"}
Jul 15 22:15:49.105484 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:49.105410    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-3.ec2.internal" podStartSLOduration=3.105386197 podStartE2EDuration="3.105386197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:15:48.0597123 +0000 UTC m=+4.584735524" watchObservedRunningTime="2026-07-15 22:15:49.105386197 +0000 UTC m=+5.630409422"
Jul 15 22:15:49.549006 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:49.548274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:49.549006 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.548511    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:49.549006 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.548579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret podName:eecc91ea-9fc4-4acf-8470-6e01e8d07bf5 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:53.548557473 +0000 UTC m=+10.073580680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret") pod "global-pull-secret-syncer-gsl96" (UID: "eecc91ea-9fc4-4acf-8470-6e01e8d07bf5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:49.649665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:49.649629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:49.649877 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.649776    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:49.649877 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.649837    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs podName:84693dac-8a3e-4731-8778-2a99c37b0e32 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:53.649817096 +0000 UTC m=+10.174840299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs") pod "network-metrics-daemon-xq5ww" (UID: "84693dac-8a3e-4731-8778-2a99c37b0e32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:49.750860 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:49.750823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:49.751057 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.751027    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:15:49.751057 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.751049    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:15:49.751179 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.751062    2580 projected.go:196] Error preparing data for projected volume kube-api-access-btw7w for pod openshift-network-diagnostics/network-check-target-n49b8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:49.751179 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:49.751118    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w podName:002d59a9-74b7-4bc3-8222-40a35a4bc153 nodeName:}" failed. No retries permitted until 2026-07-15 22:15:53.75109853 +0000 UTC m=+10.276121738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btw7w" (UniqueName: "kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w") pod "network-check-target-n49b8" (UID: "002d59a9-74b7-4bc3-8222-40a35a4bc153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:50.007740 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:50.006981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:50.007740 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:50.007135    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:15:50.007740 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:50.007538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:50.007740 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:50.007627    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:15:51.004815 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:51.004761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:51.005023 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:51.004908    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:15:52.004791 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:52.004263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:52.004791 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:52.004423    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:15:52.005593 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:52.005429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:52.005593 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:52.005547    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:15:53.004404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:53.004318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:53.004620 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.004469    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:15:53.586510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:53.586466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:53.587007 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.586642    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:53.587007 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.586737    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret podName:eecc91ea-9fc4-4acf-8470-6e01e8d07bf5 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:01.586713539 +0000 UTC m=+18.111736739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret") pod "global-pull-secret-syncer-gsl96" (UID: "eecc91ea-9fc4-4acf-8470-6e01e8d07bf5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:15:53.687534 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:53.687440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:53.687762 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.687636    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:53.687762 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.687711    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs podName:84693dac-8a3e-4731-8778-2a99c37b0e32 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:01.687688148 +0000 UTC m=+18.212711350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs") pod "network-metrics-daemon-xq5ww" (UID: "84693dac-8a3e-4731-8778-2a99c37b0e32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:15:53.788607 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:53.788557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:53.788808 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.788782    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:15:53.788885 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.788815    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:15:53.788885 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.788831    2580 projected.go:196] Error preparing data for projected volume kube-api-access-btw7w for pod openshift-network-diagnostics/network-check-target-n49b8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:53.788970 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:53.788901    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w podName:002d59a9-74b7-4bc3-8222-40a35a4bc153 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:01.788881361 +0000 UTC m=+18.313904577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btw7w" (UniqueName: "kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w") pod "network-check-target-n49b8" (UID: "002d59a9-74b7-4bc3-8222-40a35a4bc153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:15:54.006083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:54.005526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:54.006083 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:54.005660    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:15:54.006083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:54.005891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:54.006083 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:54.005999    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:15:55.004208 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:55.004133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:55.004709 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:55.004314    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:15:56.005024 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:56.004879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:56.005686 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:56.005039    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:15:56.005686 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:56.005301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:56.005686 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:56.005416    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:15:57.004685 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:57.004653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:57.004858 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:57.004810    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:15:58.004388 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:58.004318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:15:58.004785 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:58.004453    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:15:58.004785 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:58.004506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:15:58.004785 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:58.004600    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:15:59.004491 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:15:59.004445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:15:59.004890 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:15:59.004561    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:00.004512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:00.004431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:00.004512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:00.004479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:00.005006 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:00.004565    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:00.005076 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:00.005023    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:01.004592 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:01.004561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:01.005086 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.004688    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:01.658259 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:01.658215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:01.658375 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.658359    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:01.658445 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.658433    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret podName:eecc91ea-9fc4-4acf-8470-6e01e8d07bf5 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:17.658411408 +0000 UTC m=+34.183434615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret") pod "global-pull-secret-syncer-gsl96" (UID: "eecc91ea-9fc4-4acf-8470-6e01e8d07bf5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:01.758695 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:01.758652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:01.758854 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.758782    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:01.758930 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.758862    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs podName:84693dac-8a3e-4731-8778-2a99c37b0e32 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:17.758841571 +0000 UTC m=+34.283864772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs") pod "network-metrics-daemon-xq5ww" (UID: "84693dac-8a3e-4731-8778-2a99c37b0e32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:01.859832 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:01.859785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:01.860015 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.859940    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:01.860015 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.859964    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:01.860015 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.859977    2580 projected.go:196] Error preparing data for projected volume kube-api-access-btw7w for pod openshift-network-diagnostics/network-check-target-n49b8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:01.860138 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:01.860037    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w podName:002d59a9-74b7-4bc3-8222-40a35a4bc153 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:17.860018611 +0000 UTC m=+34.385041812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btw7w" (UniqueName: "kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w") pod "network-check-target-n49b8" (UID: "002d59a9-74b7-4bc3-8222-40a35a4bc153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:02.004451 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:02.004360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:02.004599 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:02.004505    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:02.004599 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:02.004531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:02.004911 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:02.004606    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:03.004824 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:03.004786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:03.005324 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:03.004928    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:04.005920 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:04.005803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:04.006399 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:04.005925    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:04.006399 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:04.006004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:04.006399 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:04.006115    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:05.004396 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:05.004351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:05.004608 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:05.004494    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:06.016973 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:06.016943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:06.017401 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:06.017083    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:06.017655 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:06.017502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:06.017655 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:06.017602    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:06.122141 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:06.122036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" event={"ID":"3356a5f2c0cd49093c8ef30ebd469c18","Type":"ContainerStarted","Data":"6bae05503bb468f542eee82b83808bc3c26e4c1c62177e04acb206dace6be6a0"}
Jul 15 22:16:06.124747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:06.124711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mz9jz" event={"ID":"89e4af4d-f5a4-41c2-9f94-d529139156cf","Type":"ContainerStarted","Data":"4bc8c4a78dab40eef312dc2069af1d1f0afb43aed2da9005d045d7b50c48d6a2"}
Jul 15 22:16:06.141538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:06.141485    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mz9jz" podStartSLOduration=9.720830783 podStartE2EDuration="21.141467407s" totalImagesPullingTime="11.420636624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:06.140976018 +0000 UTC m=+22.665999235" watchObservedRunningTime="2026-07-15 22:16:06.141467407 +0000 UTC m=+22.666490627"
Jul 15 22:16:07.004583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.004317    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:07.004768 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:07.004630    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:07.130101 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.130066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xwv8k" event={"ID":"5d167f8d-ca9d-42e6-9a4c-2175797892ac","Type":"ContainerStarted","Data":"dfeae01d99d598a1b6b85380d0129c1d5744d4d6aea5b43d6eb6026c53163c91"}
Jul 15 22:16:07.131460 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.131441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct" event={"ID":"5ee7f799-55c8-4726-9e16-6f87f635570c","Type":"ContainerStarted","Data":"508e0c6a4444d4b1dc8a824adb8ef6dbd054187c64296892937138ac29caaf9d"}
Jul 15 22:16:07.132700 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.132673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d8827" event={"ID":"b637baad-e920-42b5-9d47-b5b5d0991054","Type":"ContainerStarted","Data":"7bc0bdcd115e7fa42de3fec2a149cee6acf274f2d985c0764cc99f923185c20c"}
Jul 15 22:16:07.134090 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.134070    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8fe13d4-2dc1-45fc-be52-222402d3a623" containerID="62ea932f7dbf65e465247a9ebfe826d37b5e101cec99d0eed9ee4656c3a083db" exitCode=0
Jul 15 22:16:07.134179 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.134135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerDied","Data":"62ea932f7dbf65e465247a9ebfe826d37b5e101cec99d0eed9ee4656c3a083db"}
Jul 15 22:16:07.136537 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.136521    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:16:07.136860 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.136843    2580 generic.go:356] "Generic (PLEG): container finished" podID="a6713e93-db89-44aa-8b21-e073154e177f" containerID="d96187aadd03657d6d0f1eef3c14b3aa23984dac4dd4425dca898a56625483b3" exitCode=1
Jul 15 22:16:07.136931 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.136902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"5cc4441b77e8baaa24c6f3d11c03f5c3fec21195c99f22cacdb3b6362a9f481c"}
Jul 15 22:16:07.136982 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.136964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"ca6d6b6ceefbb405bf684ef9b6e7773d2b783923922a44b94dca2788d785d723"}
Jul 15 22:16:07.137091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.137014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"d6bf2361283e03cf3f971b0f2633ffbe3239750abee25992503e9384f3ed8333"}
Jul 15 22:16:07.137091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.137064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerDied","Data":"d96187aadd03657d6d0f1eef3c14b3aa23984dac4dd4425dca898a56625483b3"}
Jul 15 22:16:07.137284 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.137106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"2e8fdf723d1c37127ec2045ab4ae48920b262a48f31979029c23cac799a69328"}
Jul 15 22:16:07.138399 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.138378    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzqkp" event={"ID":"a74c030e-d29d-46da-8305-d14bde4d3d9d","Type":"ContainerStarted","Data":"4c2685ae6e82d596e646531fafb9ac2b4592874d0f6f1e5df4dc49a7b894d25e"}
Jul 15 22:16:07.139828 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.139756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rxrp4" event={"ID":"0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98","Type":"ContainerStarted","Data":"8307afac75872d5ff4cea036b7966ada003adf0b661105e1da79998deae404c9"}
Jul 15 22:16:07.172122 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.172079    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d8827" podStartSLOduration=3.441780192 podStartE2EDuration="23.172062226s" totalImagesPullingTime="19.730282034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:07.171438956 +0000 UTC m=+23.696462177" watchObservedRunningTime="2026-07-15 22:16:07.172062226 +0000 UTC m=+23.697085445"
Jul 15 22:16:07.204358 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.204304    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hzqkp" podStartSLOduration=6.816919304 podStartE2EDuration="22.204284794s" totalImagesPullingTime="15.38736549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:07.185766451 +0000 UTC m=+23.710789665" watchObservedRunningTime="2026-07-15 22:16:07.204284794 +0000 UTC m=+23.729308015"
Jul 15 22:16:07.204503 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.204388    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xwv8k" podStartSLOduration=6.820202813 podStartE2EDuration="22.204382246s" totalImagesPullingTime="15.384179433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:07.203760742 +0000 UTC m=+23.728783962" watchObservedRunningTime="2026-07-15 22:16:07.204382246 +0000 UTC m=+23.729405466"
Jul 15 22:16:07.263881 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.263791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rxrp4" podStartSLOduration=2.6086272150000003 podStartE2EDuration="22.263774583s" totalImagesPullingTime="19.655147368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:07.241986691 +0000 UTC m=+23.767009911" watchObservedRunningTime="2026-07-15 22:16:07.263774583 +0000 UTC m=+23.788797803"
Jul 15 22:16:07.488872 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.488850    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 22:16:07.973895 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.973805    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T22:16:07.488866414Z","UUID":"37a2b432-2395-4789-90cf-b1847fbe1b65","Handler":null,"Name":"","Endpoint":""}
Jul 15 22:16:07.975258 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.975226    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 22:16:07.975382 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:07.975282    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 22:16:08.004105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.004079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:08.004105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.004088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:08.004284 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:08.004175    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:08.004284 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:08.004228    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:08.144803 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.144734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swrfz" event={"ID":"142b818f-5a55-4dff-b47e-12ed53564ac7","Type":"ContainerStarted","Data":"82a26fda198b0420cd16a868d08858d67ea3311a9458dc61c38cf09ec484a4eb"}
Jul 15 22:16:08.147575 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.147533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct" event={"ID":"5ee7f799-55c8-4726-9e16-6f87f635570c","Type":"ContainerStarted","Data":"beae9cfb2ee4ee8c1dfc1467419bb6a30482ab7d02290df8d7c6f04f497677e4"}
Jul 15 22:16:08.151267 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.151226    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:16:08.151960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.151715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"dbbd1bd495abdb959c8c3bf345aa883b7e7963c75006217ae653cc93c2c34855"}
Jul 15 22:16:08.159231 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.159191    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-3.ec2.internal" podStartSLOduration=22.159178193 podStartE2EDuration="22.159178193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:07.264514092 +0000 UTC m=+23.789537313" watchObservedRunningTime="2026-07-15 22:16:08.159178193 +0000 UTC m=+24.684201412"
Jul 15 22:16:08.159364 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:08.159293    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-swrfz" podStartSLOduration=3.468438156 podStartE2EDuration="23.159284301s" totalImagesPullingTime="19.690846145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:08.158849853 +0000 UTC m=+24.683873075" watchObservedRunningTime="2026-07-15 22:16:08.159284301 +0000 UTC m=+24.684307523"
Jul 15 22:16:09.005082 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:09.004857    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:09.005230 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:09.005115    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:09.155837 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:09.155796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct" event={"ID":"5ee7f799-55c8-4726-9e16-6f87f635570c","Type":"ContainerStarted","Data":"ac81e00001e861926e937eb750447058099c208a240fb38f7253036632fdf0e9"}
Jul 15 22:16:09.174966 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:09.174912    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxvct" podStartSLOduration=3.185124792 podStartE2EDuration="25.174892927s" totalImagesPullingTime="21.989768135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:09.174552551 +0000 UTC m=+25.699575770" watchObservedRunningTime="2026-07-15 22:16:09.174892927 +0000 UTC m=+25.699916148"
Jul 15 22:16:10.006929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:10.006901    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:10.007080 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:10.006994    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:10.007080 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:10.007045    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:10.007158 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:10.007134    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:10.161455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:10.161427    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:16:10.162100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:10.161899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"1ad620ec3ba7893797ba8a8cd7eddfed39b622f125ca1d003d2bcc97946a24d5"}
Jul 15 22:16:10.190410 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:10.190378    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:16:10.191128 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:10.191108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:16:11.004444 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:11.004412    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:11.004614 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:11.004524    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:11.164622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:11.164590    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:16:11.165089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:11.165074    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mz9jz"
Jul 15 22:16:12.004819 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.004643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:12.004939 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.004700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:12.004993 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:12.004939    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:12.004993 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:12.004962    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:12.168564 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.168535    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8fe13d4-2dc1-45fc-be52-222402d3a623" containerID="2e8774afb02a69b7796df916bb436c1f7ad4313a7f2680b17f6dc60f1afff48e" exitCode=0
Jul 15 22:16:12.169122 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.168610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerDied","Data":"2e8774afb02a69b7796df916bb436c1f7ad4313a7f2680b17f6dc60f1afff48e"}
Jul 15 22:16:12.171961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.171936    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:16:12.172384 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.172360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"0e5a8b415100824274eb31ca524b41793ca08233f6ddd16c3346567fa2d38da0"}
Jul 15 22:16:12.172567 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.172550    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:16:12.172644 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.172610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:16:12.172698 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.172657    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:16:12.172698 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.172688    2580 scope.go:117] "RemoveContainer" containerID="d96187aadd03657d6d0f1eef3c14b3aa23984dac4dd4425dca898a56625483b3"
Jul 15 22:16:12.187876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.187857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:16:12.187959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:12.187950    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:16:13.004455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.004419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:13.004697 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:13.004539    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:13.179279 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.179234    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:16:13.179714 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.179647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" event={"ID":"a6713e93-db89-44aa-8b21-e073154e177f","Type":"ContainerStarted","Data":"f0b68f89d64d809682515ea13373f0d3b2ae591c373aca25101a190e5f0a8589"}
Jul 15 22:16:13.207580 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.207524    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl" podStartSLOduration=7.987031449 podStartE2EDuration="28.207503075s" totalImagesPullingTime="20.220471626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:13.206293309 +0000 UTC m=+29.731316530" watchObservedRunningTime="2026-07-15 22:16:13.207503075 +0000 UTC m=+29.732526296"
Jul 15 22:16:13.565927 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.565901    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xq5ww"]
Jul 15 22:16:13.566042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.566034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:13.566159 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:13.566137    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:13.568649 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.568623    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gsl96"]
Jul 15 22:16:13.568755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.568701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:13.568814 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:13.568786    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:13.569110 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.569090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n49b8"]
Jul 15 22:16:13.569205 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:13.569187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:13.569284 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:13.569267    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:14.183836 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:14.183804    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8fe13d4-2dc1-45fc-be52-222402d3a623" containerID="c4b606349da320bcb9827aab630114e36a3993c705e0d86aeb716765f7ca2883" exitCode=0
Jul 15 22:16:14.184300 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:14.183882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerDied","Data":"c4b606349da320bcb9827aab630114e36a3993c705e0d86aeb716765f7ca2883"}
Jul 15 22:16:15.004694 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:15.004499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:15.004853 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:15.004536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:15.004853 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:15.004781    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:15.004934 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:15.004871    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:16.004346 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:16.004287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:16.004726 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:16.004382    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:16.191321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:16.191280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerDied","Data":"c2016f6a100f6b12e3e948fdf5dfb250597d1abaa86a22b9c5828292f6bc9957"}
Jul 15 22:16:16.191450 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:16.191291    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8fe13d4-2dc1-45fc-be52-222402d3a623" containerID="c2016f6a100f6b12e3e948fdf5dfb250597d1abaa86a22b9c5828292f6bc9957" exitCode=0
Jul 15 22:16:17.004775 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:17.004742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:17.005497 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.004883    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:17.005497 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:17.004935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:17.005497 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.005028    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:17.676308 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:17.676268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:17.676488 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.676426    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:17.676488 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.676486    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret podName:eecc91ea-9fc4-4acf-8470-6e01e8d07bf5 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:49.676472134 +0000 UTC m=+66.201495332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret") pod "global-pull-secret-syncer-gsl96" (UID: "eecc91ea-9fc4-4acf-8470-6e01e8d07bf5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:17.777622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:17.777585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:17.777788 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.777765    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:17.777853 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.777842    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs podName:84693dac-8a3e-4731-8778-2a99c37b0e32 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:49.777819356 +0000 UTC m=+66.302842559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs") pod "network-metrics-daemon-xq5ww" (UID: "84693dac-8a3e-4731-8778-2a99c37b0e32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:17.878903 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:17.878867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:17.879066 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.879027    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:17.879066 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.879050    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:17.879066 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.879060    2580 projected.go:196] Error preparing data for projected volume kube-api-access-btw7w for pod openshift-network-diagnostics/network-check-target-n49b8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:17.879195 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:17.879115    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w podName:002d59a9-74b7-4bc3-8222-40a35a4bc153 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:49.87909933 +0000 UTC m=+66.404122547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btw7w" (UniqueName: "kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w") pod "network-check-target-n49b8" (UID: "002d59a9-74b7-4bc3-8222-40a35a4bc153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:18.004197 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:18.004125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:18.004349 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:18.004268    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n49b8" podUID="002d59a9-74b7-4bc3-8222-40a35a4bc153"
Jul 15 22:16:19.004769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.004740    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:19.005255 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.004843    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xq5ww" podUID="84693dac-8a3e-4731-8778-2a99c37b0e32"
Jul 15 22:16:19.005255 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.004897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:19.005255 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.005015    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gsl96" podUID="eecc91ea-9fc4-4acf-8470-6e01e8d07bf5"
Jul 15 22:16:19.745041 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.745013    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-3.ec2.internal" event="NodeReady"
Jul 15 22:16:19.745211 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.745145    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 22:16:19.781163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.781129    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jmq88"]
Jul 15 22:16:19.786426 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.786351    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"]
Jul 15 22:16:19.786562 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.786495    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.791337 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.791030    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.791337 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.791209    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.791337 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.791270    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-p9bt7"]
Jul 15 22:16:19.791554 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.791443    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 22:16:19.791554 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.791497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.791966 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.791940    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 22:16:19.792092 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.792076    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-29k4s\""
Jul 15 22:16:19.794620 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.794601    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 22:16:19.794901 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.794883    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7x57r\""
Jul 15 22:16:19.795003 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.794945    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 22:16:19.795286 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.795267    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 22:16:19.795827 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.795809    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"]
Jul 15 22:16:19.795981 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.795962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.799830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.799807    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 22:16:19.801231 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.801197    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"]
Jul 15 22:16:19.801454 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.801439    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 22:16:19.802378 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.802360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.803619 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.803602    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.804385 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.803610    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.804385 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.803824    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 22:16:19.804385 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.803907    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-c8jlp\""
Jul 15 22:16:19.804385 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.804362    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 22:16:19.804785 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.804768    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64bf7f4c68-xhtmq"]
Jul 15 22:16:19.805440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.805182    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:19.809834 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.807427    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.809834 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.809183    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"]
Jul 15 22:16:19.809834 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.809351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:19.811514 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.811497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 22:16:19.811748 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.811723    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 22:16:19.811924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.811904    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f2mhr\""
Jul 15 22:16:19.811995 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.811980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.813301 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.813279    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.813377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.813343    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"]
Jul 15 22:16:19.813473 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.813455    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.814846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.814798    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k2pw4\""
Jul 15 22:16:19.816363 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.816141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"
Jul 15 22:16:19.819010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.818122    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 22:16:19.819010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.818525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 22:16:19.819010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.818772    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.819316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.819297    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 22:16:19.819586 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.819542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 22:16:19.821617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.819951    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.821617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.820238    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.821617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.820610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2tmsk\""
Jul 15 22:16:19.821617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.820706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ts7p5\""
Jul 15 22:16:19.821617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.820620    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.823376 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.821208    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"]
Jul 15 22:16:19.823376 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.822455    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 22:16:19.823376 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.821915    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 22:16:19.823376 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.821303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:19.825510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.825494    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.825766 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.825528    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 22:16:19.825942 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.825652    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zqsrp\""
Jul 15 22:16:19.826189 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.825713    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.826374 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.825940    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 22:16:19.826510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.826489    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.826607 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.826431    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"]
Jul 15 22:16:19.830983 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.830964    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"]
Jul 15 22:16:19.831454 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.831435    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"
Jul 15 22:16:19.834062 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834042    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.834274 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.834274 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834230    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ns7t4\""
Jul 15 22:16:19.834445 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"]
Jul 15 22:16:19.834562 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jmq88"]
Jul 15 22:16:19.834562 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834487    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"]
Jul 15 22:16:19.834562 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834506    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"]
Jul 15 22:16:19.834562 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834524    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"]
Jul 15 22:16:19.834562 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:19.834826 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.834545    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ffv6m"]
Jul 15 22:16:19.836908 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.836890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.837048 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.837028    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.837048 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.836902    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 22:16:19.837198 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.837047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 22:16:19.837357 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.837324    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-24rph\""
Jul 15 22:16:19.838811 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.838775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64bf7f4c68-xhtmq"]
Jul 15 22:16:19.838811 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.838811    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"]
Jul 15 22:16:19.838950 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.838831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-p9bt7"]
Jul 15 22:16:19.838950 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.838851    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b5qsg"]
Jul 15 22:16:19.839101 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.839081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:19.841372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841352    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 22:16:19.841372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841361    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 22:16:19.841638 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841621    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ff8j8\""
Jul 15 22:16:19.841858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841840    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"]
Jul 15 22:16:19.841943 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841892    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"]
Jul 15 22:16:19.841943 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ffv6m"]
Jul 15 22:16:19.842041 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841958    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b5qsg"]
Jul 15 22:16:19.842041 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841977    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"]
Jul 15 22:16:19.842041 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.841975    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:19.844609 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.844584    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 22:16:19.844707 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.844680    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 22:16:19.844810 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.844793    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 22:16:19.844999 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.844890    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vb4mh\""
Jul 15 22:16:19.894040 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894148 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-trusted-ca\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894148 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.894148 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mff5t\" (UniqueName: \"kubernetes.io/projected/19fdc26a-8644-4f14-99cb-9fdacae2d495-kube-api-access-mff5t\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:19.894321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8bd896-286c-4473-a150-63ad81c8a097-serving-cert\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.894321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwp9q\" (UniqueName: \"kubernetes.io/projected/5b8bd896-286c-4473-a150-63ad81c8a097-kube-api-access-fwp9q\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.894321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-serving-cert\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.894321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-trusted-ca\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.894321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-bound-sa-token\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894531 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b8bd896-286c-4473-a150-63ad81c8a097-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.894531 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:19.894531 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-image-registry-private-configuration\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894531 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqfrt\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-kube-api-access-tqfrt\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894531 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b8bd896-286c-4473-a150-63ad81c8a097-snapshots\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.894531 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a3e9871-ba4e-4211-9494-3577d232e955-ca-trust-extracted\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-installation-pull-secrets\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8dr8\" (UniqueName: \"kubernetes.io/projected/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-kube-api-access-r8dr8\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-registry-certificates\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-config\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15fddc58-25b8-4d02-9c2d-eda67232c113-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vtk\" (UniqueName: \"kubernetes.io/projected/15fddc58-25b8-4d02-9c2d-eda67232c113-kube-api-access-d7vtk\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8bd896-286c-4473-a150-63ad81c8a097-tmp\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.894799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.894751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b8bd896-286c-4473-a150-63ad81c8a097-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.995155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6tp\" (UniqueName: \"kubernetes.io/projected/e6373857-826c-4ca6-8ef5-05543d484bff-kube-api-access-vc6tp\") pod \"network-check-source-869dcfcdcd-22wpm\" (UID: \"e6373857-826c-4ca6-8ef5-05543d484bff\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"
Jul 15 22:16:19.995340 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8bd896-286c-4473-a150-63ad81c8a097-serving-cert\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.995340 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwp9q\" (UniqueName: \"kubernetes.io/projected/5b8bd896-286c-4473-a150-63ad81c8a097-kube-api-access-fwp9q\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.995340 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-serving-cert\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.995340 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkh65\" (UniqueName: \"kubernetes.io/projected/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-kube-api-access-tkh65\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:19.995553 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-default-certificate\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:19.995553 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c21d106-9fda-4395-8845-c6303a05d319-ca-trust-extracted\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.995553 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-image-registry-private-configuration\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.995715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-registry-certificates\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.995715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b8bd896-286c-4473-a150-63ad81c8a097-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.995715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjk7q\" (UniqueName: \"kubernetes.io/projected/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-kube-api-access-zjk7q\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:19.995715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz7x7\" (UniqueName: \"kubernetes.io/projected/fdb15212-d5fb-48cf-b590-baef7da8dabc-kube-api-access-wz7x7\") pod \"ingress-canary-b5qsg\" (UID: \"fdb15212-d5fb-48cf-b590-baef7da8dabc\") " pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:19.995715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5daaeacb-b48c-4719-869a-50ab1d541658-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:19.995715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995708    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb15212-d5fb-48cf-b590-baef7da8dabc-cert\") pod \"ingress-canary-b5qsg\" (UID: \"fdb15212-d5fb-48cf-b590-baef7da8dabc\") " pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:19.996010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mp8c\" (UniqueName: \"kubernetes.io/projected/967cd527-fd78-4e56-b9bc-7d388f7f0413-kube-api-access-2mp8c\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:19.996010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9vvd\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-kube-api-access-b9vvd\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.996010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a3e9871-ba4e-4211-9494-3577d232e955-ca-trust-extracted\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.996010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8dr8\" (UniqueName: \"kubernetes.io/projected/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-kube-api-access-r8dr8\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.996010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd46s\" (UniqueName: \"kubernetes.io/projected/a47121b8-3b53-444d-b155-bfa763997934-kube-api-access-jd46s\") pod \"volume-data-source-validator-78495597f6-2vxhl\" (UID: \"a47121b8-3b53-444d-b155-bfa763997934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"
Jul 15 22:16:19.996010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.995969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-installation-pull-secrets\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.996010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5daaeacb-b48c-4719-869a-50ab1d541658-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vtk\" (UniqueName: \"kubernetes.io/projected/15fddc58-25b8-4d02-9c2d-eda67232c113-kube-api-access-d7vtk\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b8bd896-286c-4473-a150-63ad81c8a097-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-trusted-ca\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j79dc\" (UniqueName: \"kubernetes.io/projected/5daaeacb-b48c-4719-869a-50ab1d541658-kube-api-access-j79dc\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a3e9871-ba4e-4211-9494-3577d232e955-ca-trust-extracted\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mff5t\" (UniqueName: \"kubernetes.io/projected/19fdc26a-8644-4f14-99cb-9fdacae2d495-kube-api-access-mff5t\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b8bd896-286c-4473-a150-63ad81c8a097-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-trusted-ca\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-config-volume\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-bound-sa-token\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:19.996369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-config\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-trusted-ca\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-bound-sa-token\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-stats-auth\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqfrt\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-kube-api-access-tqfrt\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b8bd896-286c-4473-a150-63ad81c8a097-snapshots\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-installation-pull-secrets\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-tmp-dir\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:19.996961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.996942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b8bd896-286c-4473-a150-63ad81c8a097-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.997388 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-trusted-ca\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.997388 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.997202    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 22:16:19.997388 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-trusted-ca\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.997388 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.997275    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls podName:19fdc26a-8644-4f14-99cb-9fdacae2d495 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:20.497256796 +0000 UTC m=+37.022280008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls") pod "cluster-samples-operator-65db858894-zpmld" (UID: "19fdc26a-8644-4f14-99cb-9fdacae2d495") : secret "samples-operator-tls" not found
Jul 15 22:16:19.997388 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-registry-certificates\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.997388 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-config\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.997664 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b8bd896-286c-4473-a150-63ad81c8a097-snapshots\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.997664 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15fddc58-25b8-4d02-9c2d-eda67232c113-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.997865 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-registry-certificates\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.997922 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8bd896-286c-4473-a150-63ad81c8a097-tmp\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.998007 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.997985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-image-registry-private-configuration\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:19.998092 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.998023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-config\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:19.998149 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.998094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:19.998204 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.998176    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:19.998204 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.998189    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7cbcd9dc-q9fjn: secret "image-registry-tls" not found
Jul 15 22:16:19.998321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.998228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/15fddc58-25b8-4d02-9c2d-eda67232c113-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.998321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.998281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8bd896-286c-4473-a150-63ad81c8a097-tmp\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:19.998321 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.998289    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls podName:8a3e9871-ba4e-4211-9494-3577d232e955 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:20.498271375 +0000 UTC m=+37.023294575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls") pod "image-registry-b7cbcd9dc-q9fjn" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955") : secret "image-registry-tls" not found
Jul 15 22:16:19.998467 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:19.998348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:19.998467 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.998457    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:19.998564 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:19.998506    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls podName:15fddc58-25b8-4d02-9c2d-eda67232c113 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:20.498492153 +0000 UTC m=+37.023515368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zk859" (UID: "15fddc58-25b8-4d02-9c2d-eda67232c113") : secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:20.000680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.000526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-serving-cert\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:20.000797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.000556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b8bd896-286c-4473-a150-63ad81c8a097-serving-cert\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:20.000797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.000625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-installation-pull-secrets\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:20.000797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.000635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-image-registry-private-configuration\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:20.008597 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.008579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:20.010803 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.010734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwp9q\" (UniqueName: \"kubernetes.io/projected/5b8bd896-286c-4473-a150-63ad81c8a097-kube-api-access-fwp9q\") pod \"insights-operator-68d9dd94cf-jmq88\" (UID: \"5b8bd896-286c-4473-a150-63ad81c8a097\") " pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:20.011497 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.011068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mff5t\" (UniqueName: \"kubernetes.io/projected/19fdc26a-8644-4f14-99cb-9fdacae2d495-kube-api-access-mff5t\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:20.011497 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.011455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-bound-sa-token\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:20.011633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.011612    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvxsv\""
Jul 15 22:16:20.011782 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.011736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8dr8\" (UniqueName: \"kubernetes.io/projected/36c9ef27-d29b-4ddc-8f2f-b09e3788f05b-kube-api-access-r8dr8\") pod \"console-operator-7866497494-p9bt7\" (UID: \"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b\") " pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:20.012088 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.012061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vtk\" (UniqueName: \"kubernetes.io/projected/15fddc58-25b8-4d02-9c2d-eda67232c113-kube-api-access-d7vtk\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:20.013218 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.013196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqfrt\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-kube-api-access-tqfrt\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:20.099102 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-trusted-ca\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.099102 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-bound-sa-token\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.099102 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.099377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-stats-auth\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.099377 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.099157    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 22:16:20.099377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-tmp-dir\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.099377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-image-registry-private-configuration\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.099377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6tp\" (UniqueName: \"kubernetes.io/projected/e6373857-826c-4ca6-8ef5-05543d484bff-kube-api-access-vc6tp\") pod \"network-check-source-869dcfcdcd-22wpm\" (UID: \"e6373857-826c-4ca6-8ef5-05543d484bff\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"
Jul 15 22:16:20.099377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkh65\" (UniqueName: \"kubernetes.io/projected/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-kube-api-access-tkh65\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.099377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-default-certificate\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c21d106-9fda-4395-8845-c6303a05d319-ca-trust-extracted\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-registry-certificates\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjk7q\" (UniqueName: \"kubernetes.io/projected/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-kube-api-access-zjk7q\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz7x7\" (UniqueName: \"kubernetes.io/projected/fdb15212-d5fb-48cf-b590-baef7da8dabc-kube-api-access-wz7x7\") pod \"ingress-canary-b5qsg\" (UID: \"fdb15212-d5fb-48cf-b590-baef7da8dabc\") " pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5daaeacb-b48c-4719-869a-50ab1d541658-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb15212-d5fb-48cf-b590-baef7da8dabc-cert\") pod \"ingress-canary-b5qsg\" (UID: \"fdb15212-d5fb-48cf-b590-baef7da8dabc\") " pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mp8c\" (UniqueName: \"kubernetes.io/projected/967cd527-fd78-4e56-b9bc-7d388f7f0413-kube-api-access-2mp8c\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.099602    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls podName:3cf39fe5-cec6-4347-8095-b6f07d5a8efc nodeName:}" failed. No retries permitted until 2026-07-15 22:16:20.599570824 +0000 UTC m=+37.124594025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls") pod "dns-default-ffv6m" (UID: "3cf39fe5-cec6-4347-8095-b6f07d5a8efc") : secret "dns-default-metrics-tls" not found
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vvd\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-kube-api-access-b9vvd\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd46s\" (UniqueName: \"kubernetes.io/projected/a47121b8-3b53-444d-b155-bfa763997934-kube-api-access-jd46s\") pod \"volume-data-source-validator-78495597f6-2vxhl\" (UID: \"a47121b8-3b53-444d-b155-bfa763997934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"
Jul 15 22:16:20.099717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-installation-pull-secrets\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.100268 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-tmp-dir\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.100268 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5daaeacb-b48c-4719-869a-50ab1d541658-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:20.100268 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.099802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.100268 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.099930    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:20.599913774 +0000 UTC m=+37.124936975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : configmap references non-existent config key: service-ca.crt
Jul 15 22:16:20.100268 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-registry-certificates\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.100268 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-trusted-ca\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.100572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5daaeacb-b48c-4719-869a-50ab1d541658-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:20.100572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.100572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j79dc\" (UniqueName: \"kubernetes.io/projected/5daaeacb-b48c-4719-869a-50ab1d541658-kube-api-access-j79dc\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:20.100572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-config-volume\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.100574    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.100590    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f48dbbf6d-z9dq6: secret "image-registry-tls" not found
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c21d106-9fda-4395-8845-c6303a05d319-ca-trust-extracted\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.100634    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls podName:7c21d106-9fda-4395-8845-c6303a05d319 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:20.600619423 +0000 UTC m=+37.125642622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls") pod "image-registry-7f48dbbf6d-z9dq6" (UID: "7c21d106-9fda-4395-8845-c6303a05d319") : secret "image-registry-tls" not found
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.100655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-config\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.100672    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 22:16:20.100760 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.100719    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:20.600702386 +0000 UTC m=+37.125725600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : secret "router-metrics-certs-default" not found
Jul 15 22:16:20.101299 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.101273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-config\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:20.101593 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.101550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-config-volume\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.102913 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.102858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-stats-auth\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.103003 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.102920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-installation-pull-secrets\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.103377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.103219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5daaeacb-b48c-4719-869a-50ab1d541658-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:20.103377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.103367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-image-registry-private-configuration\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.103981 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.103921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:20.104351 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.104326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb15212-d5fb-48cf-b590-baef7da8dabc-cert\") pod \"ingress-canary-b5qsg\" (UID: \"fdb15212-d5fb-48cf-b590-baef7da8dabc\") " pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:20.104434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.104356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-default-certificate\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.106005 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.105979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jmq88"
Jul 15 22:16:20.109095 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.109069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-bound-sa-token\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.109511 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.109193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mp8c\" (UniqueName: \"kubernetes.io/projected/967cd527-fd78-4e56-b9bc-7d388f7f0413-kube-api-access-2mp8c\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.109726 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.109703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6tp\" (UniqueName: \"kubernetes.io/projected/e6373857-826c-4ca6-8ef5-05543d484bff-kube-api-access-vc6tp\") pod \"network-check-source-869dcfcdcd-22wpm\" (UID: \"e6373857-826c-4ca6-8ef5-05543d484bff\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"
Jul 15 22:16:20.110538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.110514    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9vvd\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-kube-api-access-b9vvd\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.110819 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.110770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkh65\" (UniqueName: \"kubernetes.io/projected/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-kube-api-access-tkh65\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.111299 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.111236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd46s\" (UniqueName: \"kubernetes.io/projected/a47121b8-3b53-444d-b155-bfa763997934-kube-api-access-jd46s\") pod \"volume-data-source-validator-78495597f6-2vxhl\" (UID: \"a47121b8-3b53-444d-b155-bfa763997934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"
Jul 15 22:16:20.111887 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.111869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjk7q\" (UniqueName: \"kubernetes.io/projected/647ff99d-eb21-46b9-a02a-2b6ad9b6de2b-kube-api-access-zjk7q\") pod \"service-ca-operator-7695fc6c8c-tv29r\" (UID: \"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:20.113093 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.113061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j79dc\" (UniqueName: \"kubernetes.io/projected/5daaeacb-b48c-4719-869a-50ab1d541658-kube-api-access-j79dc\") pod \"kube-storage-version-migrator-operator-799cb7f958-d8nsp\" (UID: \"5daaeacb-b48c-4719-869a-50ab1d541658\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:20.113178 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.113144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz7x7\" (UniqueName: \"kubernetes.io/projected/fdb15212-d5fb-48cf-b590-baef7da8dabc-kube-api-access-wz7x7\") pod \"ingress-canary-b5qsg\" (UID: \"fdb15212-d5fb-48cf-b590-baef7da8dabc\") " pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:20.123204 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.123184    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:20.157132 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.157111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"
Jul 15 22:16:20.163889 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.163868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"
Jul 15 22:16:20.176637 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.176619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"
Jul 15 22:16:20.183408 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.183383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"
Jul 15 22:16:20.195309 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.195292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b5qsg"
Jul 15 22:16:20.503972 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.503939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:20.504142 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.504013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:20.504142 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.504048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:20.504142 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.504092    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 22:16:20.504345 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.504169    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls podName:19fdc26a-8644-4f14-99cb-9fdacae2d495 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:21.504145477 +0000 UTC m=+38.029168702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls") pod "cluster-samples-operator-65db858894-zpmld" (UID: "19fdc26a-8644-4f14-99cb-9fdacae2d495") : secret "samples-operator-tls" not found
Jul 15 22:16:20.504345 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.504186    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:20.504345 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.504205    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7cbcd9dc-q9fjn: secret "image-registry-tls" not found
Jul 15 22:16:20.504345 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.504189    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:20.504345 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.504268    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls podName:8a3e9871-ba4e-4211-9494-3577d232e955 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:21.504236328 +0000 UTC m=+38.029259543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls") pod "image-registry-b7cbcd9dc-q9fjn" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955") : secret "image-registry-tls" not found
Jul 15 22:16:20.504345 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.504316    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls podName:15fddc58-25b8-4d02-9c2d-eda67232c113 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:21.50429796 +0000 UTC m=+38.029321169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zk859" (UID: "15fddc58-25b8-4d02-9c2d-eda67232c113") : secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:20.605276 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.605237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.605402 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.605291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:20.605402 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.605330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:20.605402 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605386    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:21.605359164 +0000 UTC m=+38.130382368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : configmap references non-existent config key: service-ca.crt
Jul 15 22:16:20.605603 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.605422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:20.605603 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605436    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 22:16:20.605603 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605487    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:21.605466257 +0000 UTC m=+38.130489459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : secret "router-metrics-certs-default" not found
Jul 15 22:16:20.605603 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605549    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 22:16:20.605856 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605606    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls podName:3cf39fe5-cec6-4347-8095-b6f07d5a8efc nodeName:}" failed. No retries permitted until 2026-07-15 22:16:21.605593898 +0000 UTC m=+38.130617100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls") pod "dns-default-ffv6m" (UID: "3cf39fe5-cec6-4347-8095-b6f07d5a8efc") : secret "dns-default-metrics-tls" not found
Jul 15 22:16:20.605856 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605642    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:20.605856 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605654    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f48dbbf6d-z9dq6: secret "image-registry-tls" not found
Jul 15 22:16:20.605856 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:20.605692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls podName:7c21d106-9fda-4395-8845-c6303a05d319 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:21.605681717 +0000 UTC m=+38.130704919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls") pod "image-registry-7f48dbbf6d-z9dq6" (UID: "7c21d106-9fda-4395-8845-c6303a05d319") : secret "image-registry-tls" not found
Jul 15 22:16:20.783179 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.783060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-p9bt7"]
Jul 15 22:16:20.789984 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:20.789951    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c9ef27_d29b_4ddc_8f2f_b09e3788f05b.slice/crio-a93eef0f411cdb58445968d4c8fc8d8925be77db8816c7ba0e4027e51224f4b4 WatchSource:0}: Error finding container a93eef0f411cdb58445968d4c8fc8d8925be77db8816c7ba0e4027e51224f4b4: Status 404 returned error can't find the container with id a93eef0f411cdb58445968d4c8fc8d8925be77db8816c7ba0e4027e51224f4b4
Jul 15 22:16:20.793722 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.793511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r"]
Jul 15 22:16:20.799287 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:20.799109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647ff99d_eb21_46b9_a02a_2b6ad9b6de2b.slice/crio-d98a580b1f58ea52c55e69ce95737ef4531c0c1cfbaaf0f0efa1462da74d044f WatchSource:0}: Error finding container d98a580b1f58ea52c55e69ce95737ef4531c0c1cfbaaf0f0efa1462da74d044f: Status 404 returned error can't find the container with id d98a580b1f58ea52c55e69ce95737ef4531c0c1cfbaaf0f0efa1462da74d044f
Jul 15 22:16:20.799784 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.799760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b5qsg"]
Jul 15 22:16:20.803094 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:20.803053    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb15212_d5fb_48cf_b590_baef7da8dabc.slice/crio-3793bf88d1403715a7bf72a22ee0895e0fbd9f07f56c992dae13421612f36f5d WatchSource:0}: Error finding container 3793bf88d1403715a7bf72a22ee0895e0fbd9f07f56c992dae13421612f36f5d: Status 404 returned error can't find the container with id 3793bf88d1403715a7bf72a22ee0895e0fbd9f07f56c992dae13421612f36f5d
Jul 15 22:16:20.806368 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.806347    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl"]
Jul 15 22:16:20.809923 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.809878    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jmq88"]
Jul 15 22:16:20.812501 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.812422    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp"]
Jul 15 22:16:20.822300 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.822277    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm"]
Jul 15 22:16:20.826719 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:20.826681    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6373857_826c_4ca6_8ef5_05543d484bff.slice/crio-cea490022785cac257d4ff522c7ee2209ceee7518e44e7e133526025a6023bbb WatchSource:0}: Error finding container cea490022785cac257d4ff522c7ee2209ceee7518e44e7e133526025a6023bbb: Status 404 returned error can't find the container with id cea490022785cac257d4ff522c7ee2209ceee7518e44e7e133526025a6023bbb
Jul 15 22:16:20.827703 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:20.827676    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daaeacb_b48c_4719_869a_50ab1d541658.slice/crio-c34562bb6859a4ef0456ef1de27735d590ab78d80c1976122c59f8cf31c4e97d WatchSource:0}: Error finding container c34562bb6859a4ef0456ef1de27735d590ab78d80c1976122c59f8cf31c4e97d: Status 404 returned error can't find the container with id c34562bb6859a4ef0456ef1de27735d590ab78d80c1976122c59f8cf31c4e97d
Jul 15 22:16:20.828740 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:20.828670    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8bd896_286c_4473_a150_63ad81c8a097.slice/crio-7e9e08d0643a688df9ec029c524dc0b0a551a1766ed9effd8da0a6f3a7edbb2b WatchSource:0}: Error finding container 7e9e08d0643a688df9ec029c524dc0b0a551a1766ed9effd8da0a6f3a7edbb2b: Status 404 returned error can't find the container with id 7e9e08d0643a688df9ec029c524dc0b0a551a1766ed9effd8da0a6f3a7edbb2b
Jul 15 22:16:20.932160 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:20.932134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:21.004162 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.004139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:21.004308 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.004291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:21.006688 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.006670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rb8hr\""
Jul 15 22:16:21.006793 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.006671    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 22:16:21.006793 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.006705    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 22:16:21.017295 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.017216    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:21.075683 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.075511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:21.206418 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.206395    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8fe13d4-2dc1-45fc-be52-222402d3a623" containerID="cdf48ea537cf1d9e8cce582d0a56c439bcb6f07cf1f5d4fbedf1c15fa6467d72" exitCode=0
Jul 15 22:16:21.206524 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.206494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerDied","Data":"cdf48ea537cf1d9e8cce582d0a56c439bcb6f07cf1f5d4fbedf1c15fa6467d72"}
Jul 15 22:16:21.207645 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.207612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl" event={"ID":"a47121b8-3b53-444d-b155-bfa763997934","Type":"ContainerStarted","Data":"f4a0a28bf4ba10fa72a38bc7fa3da2f94136f2333e5cf083bfdc5fe1d860258a"}
Jul 15 22:16:21.208636 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.208607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p9bt7" event={"ID":"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b","Type":"ContainerStarted","Data":"a93eef0f411cdb58445968d4c8fc8d8925be77db8816c7ba0e4027e51224f4b4"}
Jul 15 22:16:21.209732 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.209711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b5qsg" event={"ID":"fdb15212-d5fb-48cf-b590-baef7da8dabc","Type":"ContainerStarted","Data":"3793bf88d1403715a7bf72a22ee0895e0fbd9f07f56c992dae13421612f36f5d"}
Jul 15 22:16:21.210858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.210840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r" event={"ID":"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b","Type":"ContainerStarted","Data":"d98a580b1f58ea52c55e69ce95737ef4531c0c1cfbaaf0f0efa1462da74d044f"}
Jul 15 22:16:21.211845 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.211813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp" event={"ID":"5daaeacb-b48c-4719-869a-50ab1d541658","Type":"ContainerStarted","Data":"c34562bb6859a4ef0456ef1de27735d590ab78d80c1976122c59f8cf31c4e97d"}
Jul 15 22:16:21.212765 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.212740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jmq88" event={"ID":"5b8bd896-286c-4473-a150-63ad81c8a097","Type":"ContainerStarted","Data":"7e9e08d0643a688df9ec029c524dc0b0a551a1766ed9effd8da0a6f3a7edbb2b"}
Jul 15 22:16:21.213682 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.213664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm" event={"ID":"e6373857-826c-4ca6-8ef5-05543d484bff","Type":"ContainerStarted","Data":"cea490022785cac257d4ff522c7ee2209ceee7518e44e7e133526025a6023bbb"}
Jul 15 22:16:21.519633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.519522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:21.519633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.519589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:21.519633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.519621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:21.519921 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.519792    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:21.519921 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.519852    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls podName:15fddc58-25b8-4d02-9c2d-eda67232c113 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:23.519833843 +0000 UTC m=+40.044857044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zk859" (UID: "15fddc58-25b8-4d02-9c2d-eda67232c113") : secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:21.519921 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.519921    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 22:16:21.520067 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.519953    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls podName:19fdc26a-8644-4f14-99cb-9fdacae2d495 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:23.519942234 +0000 UTC m=+40.044965437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls") pod "cluster-samples-operator-65db858894-zpmld" (UID: "19fdc26a-8644-4f14-99cb-9fdacae2d495") : secret "samples-operator-tls" not found
Jul 15 22:16:21.520067 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.520021    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:21.520067 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.520032    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7cbcd9dc-q9fjn: secret "image-registry-tls" not found
Jul 15 22:16:21.520067 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.520062    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls podName:8a3e9871-ba4e-4211-9494-3577d232e955 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:23.520051794 +0000 UTC m=+40.045074999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls") pod "image-registry-b7cbcd9dc-q9fjn" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955") : secret "image-registry-tls" not found
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.620520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.620567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.620607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:21.620646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.620889    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.620959    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls podName:3cf39fe5-cec6-4347-8095-b6f07d5a8efc nodeName:}" failed. No retries permitted until 2026-07-15 22:16:23.620928454 +0000 UTC m=+40.145951666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls") pod "dns-default-ffv6m" (UID: "3cf39fe5-cec6-4347-8095-b6f07d5a8efc") : secret "dns-default-metrics-tls" not found
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.621353    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:23.621338141 +0000 UTC m=+40.146361344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : configmap references non-existent config key: service-ca.crt
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.621439    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.621451    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f48dbbf6d-z9dq6: secret "image-registry-tls" not found
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.621484    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls podName:7c21d106-9fda-4395-8845-c6303a05d319 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:23.621472711 +0000 UTC m=+40.146495914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls") pod "image-registry-7f48dbbf6d-z9dq6" (UID: "7c21d106-9fda-4395-8845-c6303a05d319") : secret "image-registry-tls" not found
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.621539    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 22:16:21.621598 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:21.621568    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:23.62155835 +0000 UTC m=+40.146581547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : secret "router-metrics-certs-default" not found
Jul 15 22:16:22.228970 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:22.228111    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8fe13d4-2dc1-45fc-be52-222402d3a623" containerID="00c5b938ad18957829e75edfa532448b44a752eeb9f7ab8c8269b088cf24b309" exitCode=0
Jul 15 22:16:22.228970 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:22.228168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerDied","Data":"00c5b938ad18957829e75edfa532448b44a752eeb9f7ab8c8269b088cf24b309"}
Jul 15 22:16:23.237074 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.236557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" event={"ID":"e8fe13d4-2dc1-45fc-be52-222402d3a623","Type":"ContainerStarted","Data":"a5cb6460752489fb226cedec5627edcaf35891acc37288856fa20c8ef12bd13b"}
Jul 15 22:16:23.238560 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.238506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl" event={"ID":"a47121b8-3b53-444d-b155-bfa763997934","Type":"ContainerStarted","Data":"893d7c5c3a78151a3efd2923f5bf0949a6cdd67c7b5d012298db347acb323274"}
Jul 15 22:16:23.264724 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.264618    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xnz7z" podStartSLOduration=7.308955645 podStartE2EDuration="38.264562728s" totalImagesPullingTime="30.955607083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:23.262908316 +0000 UTC m=+39.787931537" watchObservedRunningTime="2026-07-15 22:16:23.264562728 +0000 UTC m=+39.789585949"
Jul 15 22:16:23.280171 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.280119    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2vxhl" podStartSLOduration=12.339345125 podStartE2EDuration="14.280103065s" totalImagesPullingTime="1.94075794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:23.279652599 +0000 UTC m=+39.804675819" watchObservedRunningTime="2026-07-15 22:16:23.280103065 +0000 UTC m=+39.805126286"
Jul 15 22:16:23.373575 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.373525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:23.474577 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.474471    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:23.542551 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.542496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:23.542705 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.542558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:23.542705 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.542588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:23.542705 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.542682    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 22:16:23.542867 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.542746    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:23.542867 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.542755    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls podName:19fdc26a-8644-4f14-99cb-9fdacae2d495 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.542733913 +0000 UTC m=+44.067757116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls") pod "cluster-samples-operator-65db858894-zpmld" (UID: "19fdc26a-8644-4f14-99cb-9fdacae2d495") : secret "samples-operator-tls" not found
Jul 15 22:16:23.542867 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.542759    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7cbcd9dc-q9fjn: secret "image-registry-tls" not found
Jul 15 22:16:23.542867 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.542807    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls podName:8a3e9871-ba4e-4211-9494-3577d232e955 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.542791284 +0000 UTC m=+44.067814481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls") pod "image-registry-b7cbcd9dc-q9fjn" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955") : secret "image-registry-tls" not found
Jul 15 22:16:23.542867 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.542691    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:23.542867 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.542848    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls podName:15fddc58-25b8-4d02-9c2d-eda67232c113 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.542838001 +0000 UTC m=+44.067861238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zk859" (UID: "15fddc58-25b8-4d02-9c2d-eda67232c113") : secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:23.597001 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.596970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.643856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.644032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.644062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.644105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644226    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644307    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.644289089 +0000 UTC m=+44.169312307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : secret "router-metrics-certs-default" not found
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644661    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644702    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls podName:3cf39fe5-cec6-4347-8095-b6f07d5a8efc nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.644688391 +0000 UTC m=+44.169711592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls") pod "dns-default-ffv6m" (UID: "3cf39fe5-cec6-4347-8095-b6f07d5a8efc") : secret "dns-default-metrics-tls" not found
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644769    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.644757958 +0000 UTC m=+44.169781161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : configmap references non-existent config key: service-ca.crt
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644826    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644837    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f48dbbf6d-z9dq6: secret "image-registry-tls" not found
Jul 15 22:16:23.644898 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:23.644867    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls podName:7c21d106-9fda-4395-8845-c6303a05d319 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.644857292 +0000 UTC m=+44.169880493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls") pod "image-registry-7f48dbbf6d-z9dq6" (UID: "7c21d106-9fda-4395-8845-c6303a05d319") : secret "image-registry-tls" not found
Jul 15 22:16:23.697629 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:23.697592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:25.489459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:25.489417    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:25.590753 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:25.590716    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:25.689905 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:25.689868    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:25.759586 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:25.759520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:25.834589 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:25.834558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:25.933903 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:25.933864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:26.103680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:26.103594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:26.206821 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:26.206782    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:26.609041 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:26.608959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:26.678286 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:26.678239    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:27.006597 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.006562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:27.062262 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.062218    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:27.576481 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.576443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:27.576651 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.576493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:27.576651 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.576513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:27.576651 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.576595    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 22:16:27.576651 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.576625    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:27.576651 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.576638    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7cbcd9dc-q9fjn: secret "image-registry-tls" not found
Jul 15 22:16:27.576871 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.576671    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls podName:19fdc26a-8644-4f14-99cb-9fdacae2d495 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:35.576649904 +0000 UTC m=+52.101673107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls") pod "cluster-samples-operator-65db858894-zpmld" (UID: "19fdc26a-8644-4f14-99cb-9fdacae2d495") : secret "samples-operator-tls" not found
Jul 15 22:16:27.576871 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.576687    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls podName:8a3e9871-ba4e-4211-9494-3577d232e955 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:35.576680803 +0000 UTC m=+52.101704000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls") pod "image-registry-b7cbcd9dc-q9fjn" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955") : secret "image-registry-tls" not found
Jul 15 22:16:27.576871 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.576693    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:27.576871 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.576739    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls podName:15fddc58-25b8-4d02-9c2d-eda67232c113 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:35.576728917 +0000 UTC m=+52.101752116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zk859" (UID: "15fddc58-25b8-4d02-9c2d-eda67232c113") : secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:27.677846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.677810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.677851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.677895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.677980    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.678007    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:35.67797863 +0000 UTC m=+52.203001848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : configmap references non-existent config key: service-ca.crt
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.678044    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.678052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.678063    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f48dbbf6d-z9dq6: secret "image-registry-tls" not found
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.678111    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls podName:7c21d106-9fda-4395-8845-c6303a05d319 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:35.678094015 +0000 UTC m=+52.203117219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls") pod "image-registry-7f48dbbf6d-z9dq6" (UID: "7c21d106-9fda-4395-8845-c6303a05d319") : secret "image-registry-tls" not found
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.678136    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.678138    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:35.67812912 +0000 UTC m=+52.203152321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : secret "router-metrics-certs-default" not found
Jul 15 22:16:27.678309 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:27.678198    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls podName:3cf39fe5-cec6-4347-8095-b6f07d5a8efc nodeName:}" failed. No retries permitted until 2026-07-15 22:16:35.678188799 +0000 UTC m=+52.203212002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls") pod "dns-default-ffv6m" (UID: "3cf39fe5-cec6-4347-8095-b6f07d5a8efc") : secret "dns-default-metrics-tls" not found
Jul 15 22:16:27.819547 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.819512    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:27.888229 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:27.888130    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:28.233918 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:28.233894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:28.354394 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:28.354326    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:29.124593 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.124555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:29.156991 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.156959    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"]
Jul 15 22:16:29.189747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.189709    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"]
Jul 15 22:16:29.189901 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.189823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"
Jul 15 22:16:29.192409 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.192379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:29.192549 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.192418    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 22:16:29.193506 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.193330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dbd8z\""
Jul 15 22:16:29.208596 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.208574    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:29.256428 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.256405    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/0.log"
Jul 15 22:16:29.256535 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.256442    2580 generic.go:356] "Generic (PLEG): container finished" podID="36c9ef27-d29b-4ddc-8f2f-b09e3788f05b" containerID="508bec7c63e8df62869d75b21e0206b1d06e60920bece1a7034897c7e001f58a" exitCode=255
Jul 15 22:16:29.256535 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.256496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p9bt7" event={"ID":"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b","Type":"ContainerDied","Data":"508bec7c63e8df62869d75b21e0206b1d06e60920bece1a7034897c7e001f58a"}
Jul 15 22:16:29.256744 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.256728    2580 scope.go:117] "RemoveContainer" containerID="508bec7c63e8df62869d75b21e0206b1d06e60920bece1a7034897c7e001f58a"
Jul 15 22:16:29.258317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.258276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b5qsg" event={"ID":"fdb15212-d5fb-48cf-b590-baef7da8dabc","Type":"ContainerStarted","Data":"f0ac885da93c863f35a6e00c7c99b5e0e5f5d45a6c1f098cac72c0c54a5aed2d"}
Jul 15 22:16:29.260040 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.260014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r" event={"ID":"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b","Type":"ContainerStarted","Data":"8159790e2b149b3d00efef7bde5c851c3a6e7f8afbfa83d3b835b12c74c58b2e"}
Jul 15 22:16:29.261798 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.261769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp" event={"ID":"5daaeacb-b48c-4719-869a-50ab1d541658","Type":"ContainerStarted","Data":"3e7ed2d690f1b1c3e4e5f1b87b42893e1863759c771b768d1b02809e0bd5599b"}
Jul 15 22:16:29.263033 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.263010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:29.263490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.263468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jmq88" event={"ID":"5b8bd896-286c-4473-a150-63ad81c8a097","Type":"ContainerStarted","Data":"c196dd7a25c883a7601360ccf734246080ee6db2923233816a908e28d9c479cc"}
Jul 15 22:16:29.265078 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.265057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm" event={"ID":"e6373857-826c-4ca6-8ef5-05543d484bff","Type":"ContainerStarted","Data":"c8eedcd166975bcacf8223d953b6241422650609c71399ee205d76dd61f660dd"}
Jul 15 22:16:29.290961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.290914    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b5qsg" podStartSLOduration=2.548218322 podStartE2EDuration="10.290896678s" totalImagesPullingTime="7.742678356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:29.289774313 +0000 UTC m=+45.814797534" watchObservedRunningTime="2026-07-15 22:16:29.290896678 +0000 UTC m=+45.815919900"
Jul 15 22:16:29.295342 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.295183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5nq\" (UniqueName: \"kubernetes.io/projected/1a5a2565-33a0-4223-8a33-94b011e3254f-kube-api-access-wg5nq\") pod \"migrator-7f59b54f6c-hfqbg\" (UID: \"1a5a2565-33a0-4223-8a33-94b011e3254f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"
Jul 15 22:16:29.307284 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.307219    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-jmq88" podStartSLOduration=12.860278642 podStartE2EDuration="20.307203031s" totalImagesPullingTime="7.446924389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:29.30556898 +0000 UTC m=+45.830592203" watchObservedRunningTime="2026-07-15 22:16:29.307203031 +0000 UTC m=+45.832226251"
Jul 15 22:16:29.351280 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.351178    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r" podStartSLOduration=8.874026882 podStartE2EDuration="16.351159607s" totalImagesPullingTime="7.477132725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:29.326202861 +0000 UTC m=+45.851226082" watchObservedRunningTime="2026-07-15 22:16:29.351159607 +0000 UTC m=+45.876182832"
Jul 15 22:16:29.351471 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.351370    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp" podStartSLOduration=10.903422352 podStartE2EDuration="18.351361596s" totalImagesPullingTime="7.447939244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:29.350622952 +0000 UTC m=+45.875646173" watchObservedRunningTime="2026-07-15 22:16:29.351361596 +0000 UTC m=+45.876384820"
Jul 15 22:16:29.370286 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.370213    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-22wpm" podStartSLOduration=7.91248445 podStartE2EDuration="15.370196218s" totalImagesPullingTime="7.457711768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:29.368365092 +0000 UTC m=+45.893388312" watchObservedRunningTime="2026-07-15 22:16:29.370196218 +0000 UTC m=+45.895219439"
Jul 15 22:16:29.396216 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.396152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5nq\" (UniqueName: \"kubernetes.io/projected/1a5a2565-33a0-4223-8a33-94b011e3254f-kube-api-access-wg5nq\") pod \"migrator-7f59b54f6c-hfqbg\" (UID: \"1a5a2565-33a0-4223-8a33-94b011e3254f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"
Jul 15 22:16:29.406834 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.406808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5nq\" (UniqueName: \"kubernetes.io/projected/1a5a2565-33a0-4223-8a33-94b011e3254f-kube-api-access-wg5nq\") pod \"migrator-7f59b54f6c-hfqbg\" (UID: \"1a5a2565-33a0-4223-8a33-94b011e3254f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"
Jul 15 22:16:29.499634 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.499597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"
Jul 15 22:16:29.652237 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:29.652156    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg"]
Jul 15 22:16:29.654540 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:29.654509    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5a2565_33a0_4223_8a33_94b011e3254f.slice/crio-91545dcc0a9ded839c5e80e861a613fc6b2ea6282c3786fcb51c8e71ae77dc3c WatchSource:0}: Error finding container 91545dcc0a9ded839c5e80e861a613fc6b2ea6282c3786fcb51c8e71ae77dc3c: Status 404 returned error can't find the container with id 91545dcc0a9ded839c5e80e861a613fc6b2ea6282c3786fcb51c8e71ae77dc3c
Jul 15 22:16:30.016001 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.015973    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7gstz"]
Jul 15 22:16:30.048482 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.048445    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7gstz"]
Jul 15 22:16:30.048626 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.048555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.049822 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.049788    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:30.050941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.050924    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vmsfz\""
Jul 15 22:16:30.051039 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.050947    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 22:16:30.051092 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.051034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 22:16:30.101886 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.101852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07967bd4-a9ed-4a20-9408-4ea88fa1f124-data-volume\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.102021 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.101905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.102021 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.101979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07967bd4-a9ed-4a20-9408-4ea88fa1f124-crio-socket\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.102131 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.102046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.102131 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.102068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmwz7\" (UniqueName: \"kubernetes.io/projected/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-api-access-wmwz7\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.108227 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.108201    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:30.124018 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.123996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:30.124121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.124043    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:30.203371 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.203348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07967bd4-a9ed-4a20-9408-4ea88fa1f124-data-volume\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.203390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.203473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07967bd4-a9ed-4a20-9408-4ea88fa1f124-crio-socket\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.203586    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.203651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.203659    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.703638789 +0000 UTC m=+47.228661998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.203665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07967bd4-a9ed-4a20-9408-4ea88fa1f124-crio-socket\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.203689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07967bd4-a9ed-4a20-9408-4ea88fa1f124-data-volume\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.203720    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 22:16:30.203731 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.203698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmwz7\" (UniqueName: \"kubernetes.io/projected/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-api-access-wmwz7\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.204089 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.203826    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.703809863 +0000 UTC m=+47.228833068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : configmap "kube-rbac-proxy" not found
Jul 15 22:16:30.214605 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.214585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmwz7\" (UniqueName: \"kubernetes.io/projected/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-api-access-wmwz7\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.272915 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.272860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:16:30.273383 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.273359    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/0.log"
Jul 15 22:16:30.273477 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.273399    2580 generic.go:356] "Generic (PLEG): container finished" podID="36c9ef27-d29b-4ddc-8f2f-b09e3788f05b" containerID="fa1610195b2709977e20991a2b40020288e0dee8d68853b953bb4918b0e87158" exitCode=255
Jul 15 22:16:30.273543 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.273473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p9bt7" event={"ID":"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b","Type":"ContainerDied","Data":"fa1610195b2709977e20991a2b40020288e0dee8d68853b953bb4918b0e87158"}
Jul 15 22:16:30.273543 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.273529    2580 scope.go:117] "RemoveContainer" containerID="508bec7c63e8df62869d75b21e0206b1d06e60920bece1a7034897c7e001f58a"
Jul 15 22:16:30.273743 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.273721    2580 scope.go:117] "RemoveContainer" containerID="fa1610195b2709977e20991a2b40020288e0dee8d68853b953bb4918b0e87158"
Jul 15 22:16:30.273924 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.273898    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-p9bt7_openshift-console-operator(36c9ef27-d29b-4ddc-8f2f-b09e3788f05b)\"" pod="openshift-console-operator/console-operator-7866497494-p9bt7" podUID="36c9ef27-d29b-4ddc-8f2f-b09e3788f05b"
Jul 15 22:16:30.275161 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.275100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg" event={"ID":"1a5a2565-33a0-4223-8a33-94b011e3254f","Type":"ContainerStarted","Data":"91545dcc0a9ded839c5e80e861a613fc6b2ea6282c3786fcb51c8e71ae77dc3c"}
Jul 15 22:16:30.452702 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.452663    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:30.517942 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.517912    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:30.708618 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.708581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.708797 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.708742    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 22:16:30.708797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.708763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:30.708923 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.708810    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:31.708790303 +0000 UTC m=+48.233813514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : configmap "kube-rbac-proxy" not found
Jul 15 22:16:30.708923 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.708859    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:30.708923 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:30.708919    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:31.708903968 +0000 UTC m=+48.233927168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:30.880546 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.880510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:30.933665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:30.933626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:31.168493 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:31.168415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:31.279338 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:31.279312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:16:31.279678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:31.279605    2580 scope.go:117] "RemoveContainer" containerID="fa1610195b2709977e20991a2b40020288e0dee8d68853b953bb4918b0e87158"
Jul 15 22:16:31.279765 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:31.279744    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-p9bt7_openshift-console-operator(36c9ef27-d29b-4ddc-8f2f-b09e3788f05b)\"" pod="openshift-console-operator/console-operator-7866497494-p9bt7" podUID="36c9ef27-d29b-4ddc-8f2f-b09e3788f05b"
Jul 15 22:16:31.385608 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:31.385570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:31.718272 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:31.718232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:31.718406 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:31.718388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:31.718493 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:31.718469    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:31.718544 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:31.718520    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 22:16:31.718544 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:31.718538    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:33.718520441 +0000 UTC m=+50.243543641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:31.718631 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:31.718558    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:33.718546658 +0000 UTC m=+50.243569862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : configmap "kube-rbac-proxy" not found
Jul 15 22:16:32.022041 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.022016    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzqkp_a74c030e-d29d-46da-8305-d14bde4d3d9d/dns-node-resolver/0.log"
Jul 15 22:16:32.284893 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.284814    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg" event={"ID":"1a5a2565-33a0-4223-8a33-94b011e3254f","Type":"ContainerStarted","Data":"bf3da9a8804ef27fa737c8fd5a4746c764791c6da263c07fff540a25d5f087d3"}
Jul 15 22:16:32.284893 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.284872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg" event={"ID":"1a5a2565-33a0-4223-8a33-94b011e3254f","Type":"ContainerStarted","Data":"424185a9fa59fac51d4e0158a015916831a4c3d93ee60dc9c6d90084ff16e6bc"}
Jul 15 22:16:32.302937 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.302885    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hfqbg" podStartSLOduration=1.486203676 podStartE2EDuration="3.302871275s" totalImagesPullingTime="1.816667599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:32.302033821 +0000 UTC m=+48.827057041" watchObservedRunningTime="2026-07-15 22:16:32.302871275 +0000 UTC m=+48.827894516"
Jul 15 22:16:32.615151 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.615074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:32.666340 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.666308    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:32.757312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.757281    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rnrvz"]
Jul 15 22:16:32.778399 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.778378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rnrvz"]
Jul 15 22:16:32.778516 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.778457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.781018 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.781000    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 22:16:32.781235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.781216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rx5wq\""
Jul 15 22:16:32.781339 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.781226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 22:16:32.782172 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.782157    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 22:16:32.782238 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.782220    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 22:16:32.800595 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.800575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:32.829298 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.829272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qt24\" (UniqueName: \"kubernetes.io/projected/51b9efcf-af09-4f27-95d5-15721e4a27bf-kube-api-access-8qt24\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.829387 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.829305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51b9efcf-af09-4f27-95d5-15721e4a27bf-signing-key\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.829387 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.829348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51b9efcf-af09-4f27-95d5-15721e4a27bf-signing-cabundle\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.895089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.895032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:32.930255 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.930217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qt24\" (UniqueName: \"kubernetes.io/projected/51b9efcf-af09-4f27-95d5-15721e4a27bf-kube-api-access-8qt24\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.930355 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.930267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51b9efcf-af09-4f27-95d5-15721e4a27bf-signing-key\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.930355 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.930316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51b9efcf-af09-4f27-95d5-15721e4a27bf-signing-cabundle\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.930853 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.930837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51b9efcf-af09-4f27-95d5-15721e4a27bf-signing-cabundle\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.932666 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.932650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51b9efcf-af09-4f27-95d5-15721e4a27bf-signing-key\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:32.938034 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:32.938015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qt24\" (UniqueName: \"kubernetes.io/projected/51b9efcf-af09-4f27-95d5-15721e4a27bf-kube-api-access-8qt24\") pod \"service-ca-79f68b9f4f-rnrvz\" (UID: \"51b9efcf-af09-4f27-95d5-15721e4a27bf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:33.087764 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.087725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz"
Jul 15 22:16:33.225272 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.225237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rnrvz"]
Jul 15 22:16:33.225538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.225508    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xwv8k_5d167f8d-ca9d-42e6-9a4c-2175797892ac/node-ca/0.log"
Jul 15 22:16:33.227651 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:33.227624    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b9efcf_af09_4f27_95d5_15721e4a27bf.slice/crio-32ced82574c3478d88e21218c2be002808c12d030e7967360fb5a530e0366325 WatchSource:0}: Error finding container 32ced82574c3478d88e21218c2be002808c12d030e7967360fb5a530e0366325: Status 404 returned error can't find the container with id 32ced82574c3478d88e21218c2be002808c12d030e7967360fb5a530e0366325
Jul 15 22:16:33.289751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.289723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz" event={"ID":"51b9efcf-af09-4f27-95d5-15721e4a27bf","Type":"ContainerStarted","Data":"32ced82574c3478d88e21218c2be002808c12d030e7967360fb5a530e0366325"}
Jul 15 22:16:33.624911 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.624885    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b5qsg_fdb15212-d5fb-48cf-b590-baef7da8dabc/serve-healthcheck-canary/0.log"
Jul 15 22:16:33.737425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.737393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:33.737563 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.737508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:33.737610 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:33.737514    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 22:16:33.737610 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:33.737590    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:33.737682 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:33.737634    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:37.737619015 +0000 UTC m=+54.262642223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : configmap "kube-rbac-proxy" not found
Jul 15 22:16:33.737682 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:33.737651    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:37.737641823 +0000 UTC m=+54.262665021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:33.812473 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.812441    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:33.823007 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:33.822985    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hfqbg_1a5a2565-33a0-4223-8a33-94b011e3254f/migrator/0.log"
Jul 15 22:16:34.022433 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:34.022400    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hfqbg_1a5a2565-33a0-4223-8a33-94b011e3254f/graceful-termination/0.log"
Jul 15 22:16:34.227757 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:34.227725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-d8nsp_5daaeacb-b48c-4719-869a-50ab1d541658/kube-storage-version-migrator-operator/0.log"
Jul 15 22:16:34.294127 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:34.294043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz" event={"ID":"51b9efcf-af09-4f27-95d5-15721e4a27bf","Type":"ContainerStarted","Data":"e5ea6d7d4557604a1447749a18e0e8fc3287c75c0ff3713f4030c138a473d6ce"}
Jul 15 22:16:34.316878 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:34.316830    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-rnrvz" podStartSLOduration=2.316813995 podStartE2EDuration="2.316813995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:34.316013879 +0000 UTC m=+50.841037100" watchObservedRunningTime="2026-07-15 22:16:34.316813995 +0000 UTC m=+50.841837214"
Jul 15 22:16:34.905007 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:34.904967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:35.007848 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.007816    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:35.220547 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.220503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:35.427450 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.427414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:35.593740 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.593646    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:35.656826 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.656790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:35.656997 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.656851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:35.656997 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.656884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:35.657115 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.656991    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 22:16:35.657115 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.657045    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:35.657115 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.657060    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls podName:19fdc26a-8644-4f14-99cb-9fdacae2d495 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:51.657039558 +0000 UTC m=+68.182062757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls") pod "cluster-samples-operator-65db858894-zpmld" (UID: "19fdc26a-8644-4f14-99cb-9fdacae2d495") : secret "samples-operator-tls" not found
Jul 15 22:16:35.657308 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.657123    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls podName:15fddc58-25b8-4d02-9c2d-eda67232c113 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:51.657106839 +0000 UTC m=+68.182130043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zk859" (UID: "15fddc58-25b8-4d02-9c2d-eda67232c113") : secret "cluster-monitoring-operator-tls" not found
Jul 15 22:16:35.657308 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.657230    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:35.657691 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.657679    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b7cbcd9dc-q9fjn: secret "image-registry-tls" not found
Jul 15 22:16:35.657748 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.657726    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls podName:8a3e9871-ba4e-4211-9494-3577d232e955 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:51.657714007 +0000 UTC m=+68.182737207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls") pod "image-registry-b7cbcd9dc-q9fjn" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955") : secret "image-registry-tls" not found
Jul 15 22:16:35.728726 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.728690    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:35.757774 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.757741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:35.757942 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.757801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:35.757942 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.757901    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 22:16:35.758051 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.757978    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 22:16:35.758051 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.757984    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls podName:3cf39fe5-cec6-4347-8095-b6f07d5a8efc nodeName:}" failed. No retries permitted until 2026-07-15 22:16:51.75795629 +0000 UTC m=+68.282979488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls") pod "dns-default-ffv6m" (UID: "3cf39fe5-cec6-4347-8095-b6f07d5a8efc") : secret "dns-default-metrics-tls" not found
Jul 15 22:16:35.758051 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.758047    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:51.758029369 +0000 UTC m=+68.283052566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : secret "router-metrics-certs-default" not found
Jul 15 22:16:35.758205 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.758107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:35.758205 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.758127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:35.758205 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.758197    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 22:16:35.758205 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.758205    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f48dbbf6d-z9dq6: secret "image-registry-tls" not found
Jul 15 22:16:35.758432 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.758229    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls podName:7c21d106-9fda-4395-8845-c6303a05d319 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:51.758222057 +0000 UTC m=+68.283245255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls") pod "image-registry-7f48dbbf6d-z9dq6" (UID: "7c21d106-9fda-4395-8845-c6303a05d319") : secret "image-registry-tls" not found
Jul 15 22:16:35.758432 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:35.758268    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle podName:967cd527-fd78-4e56-b9bc-7d388f7f0413 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:51.758238551 +0000 UTC m=+68.283261755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle") pod "router-default-64bf7f4c68-xhtmq" (UID: "967cd527-fd78-4e56-b9bc-7d388f7f0413") : configmap references non-existent config key: service-ca.crt
Jul 15 22:16:35.818119 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:35.818083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:36.130376 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:36.130335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:36.937323 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:36.937293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:37.123051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:37.123014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:37.351368 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:37.351278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:37.478154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:37.478118    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:37.578050 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:37.578005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:37.781153 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:37.781108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:37.781366 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:37.781285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:37.781456 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:37.781408    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:37.781512 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:16:37.781480    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls podName:07967bd4-a9ed-4a20-9408-4ea88fa1f124 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:45.781462614 +0000 UTC m=+62.306485818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7gstz" (UID: "07967bd4-a9ed-4a20-9408-4ea88fa1f124") : secret "insights-runtime-extractor-tls" not found
Jul 15 22:16:37.781769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:37.781746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07967bd4-a9ed-4a20-9408-4ea88fa1f124-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:38.528589 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:38.528552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:38.630677 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:38.630638    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:38.836518 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:38.836431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:38.976419 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:38.976383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:39.349389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:39.349354    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:39.453926 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:39.453893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:39.727476 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:39.727442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:40.124216 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.124145    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:40.124216 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.124203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:40.124545 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.124532    2580 scope.go:117] "RemoveContainer" containerID="fa1610195b2709977e20991a2b40020288e0dee8d68853b953bb4918b0e87158"
Jul 15 22:16:40.317305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.317280    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:16:40.317475 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.317372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p9bt7" event={"ID":"36c9ef27-d29b-4ddc-8f2f-b09e3788f05b","Type":"ContainerStarted","Data":"0f505a71abfaf732393cc2cebaf6613cbafafafa989ea747e8c07888309af14f"}
Jul 15 22:16:40.317666 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.317647    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:40.340211 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.340163    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-p9bt7" podStartSLOduration=23.875087866 podStartE2EDuration="31.340152098s" totalImagesPullingTime="7.465064232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:40.339869932 +0000 UTC m=+56.864893152" watchObservedRunningTime="2026-07-15 22:16:40.340152098 +0000 UTC m=+56.865175317"
Jul 15 22:16:40.347985 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.347953    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:40.437920 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.437897    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:40.540803 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.540774    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:40.895192 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.895119    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-p9bt7"
Jul 15 22:16:40.960319 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:40.960283    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.061876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.061839    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.161004 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.160921    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.221179 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.221151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.387287 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.387227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.536038 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.536003    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.599330 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.599301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.729723 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.729661    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.828351 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.828268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:41.955691 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:41.955642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:42.055678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:42.055633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:42.127616 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:42.127526    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:42.227725 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:42.227677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:42.365771 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:42.365737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:42.938262 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:42.938205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:43.048155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:43.048115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:43.148776 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:43.148738    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:43.414634 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:43.414548    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:43.747619 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:43.747587    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:43.838704 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:43.838660    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:44.203645 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:44.203619    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wn4wl"
Jul 15 22:16:44.539557 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:44.539445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:44.926856 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:44.926826    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:45.126124 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.126093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:45.332392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.332277    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:45.727965 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.727928    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:45.828064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.828009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:45.861205 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.861181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:45.863417 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.863391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07967bd4-a9ed-4a20-9408-4ea88fa1f124-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gstz\" (UID: \"07967bd4-a9ed-4a20-9408-4ea88fa1f124\") " pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:45.934894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.934864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:45.960642 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.960618    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vmsfz\""
Jul 15 22:16:45.968616 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:45.968597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7gstz"
Jul 15 22:16:46.089872 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:46.089846    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7gstz"]
Jul 15 22:16:46.091738 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:46.091694    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07967bd4_a9ed_4a20_9408_4ea88fa1f124.slice/crio-cc724089a8ac62f01eacefb4669024c6878cc6d936ff78947ce145ed7ef6cbe4 WatchSource:0}: Error finding container cc724089a8ac62f01eacefb4669024c6878cc6d936ff78947ce145ed7ef6cbe4: Status 404 returned error can't find the container with id cc724089a8ac62f01eacefb4669024c6878cc6d936ff78947ce145ed7ef6cbe4
Jul 15 22:16:46.338675 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:46.338600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gstz" event={"ID":"07967bd4-a9ed-4a20-9408-4ea88fa1f124","Type":"ContainerStarted","Data":"cc724089a8ac62f01eacefb4669024c6878cc6d936ff78947ce145ed7ef6cbe4"}
Jul 15 22:16:49.697794 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.697748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:49.700588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.700565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 22:16:49.711010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.710984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eecc91ea-9fc4-4acf-8470-6e01e8d07bf5-original-pull-secret\") pod \"global-pull-secret-syncer-gsl96\" (UID: \"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5\") " pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:49.798743 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.798706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:49.801383 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.801358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 22:16:49.811797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.811776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84693dac-8a3e-4731-8778-2a99c37b0e32-metrics-certs\") pod \"network-metrics-daemon-xq5ww\" (UID: \"84693dac-8a3e-4731-8778-2a99c37b0e32\") " pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:49.826068 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.825891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gsl96"
Jul 15 22:16:49.832692 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.832670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rb8hr\""
Jul 15 22:16:49.840686 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.840668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xq5ww"
Jul 15 22:16:49.899747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.899717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:49.902392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:49.902364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btw7w\" (UniqueName: \"kubernetes.io/projected/002d59a9-74b7-4bc3-8222-40a35a4bc153-kube-api-access-btw7w\") pod \"network-check-target-n49b8\" (UID: \"002d59a9-74b7-4bc3-8222-40a35a4bc153\") " pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:50.036729 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:50.036651    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvxsv\""
Jul 15 22:16:50.044599 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:50.044575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:51.156967 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.156885    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n49b8"]
Jul 15 22:16:51.164079 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:51.160052    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002d59a9_74b7_4bc3_8222_40a35a4bc153.slice/crio-3a3e129b0dcc2da7ea0826ae51adefad8f08e3ba48ab86614da52866b47adffd WatchSource:0}: Error finding container 3a3e129b0dcc2da7ea0826ae51adefad8f08e3ba48ab86614da52866b47adffd: Status 404 returned error can't find the container with id 3a3e129b0dcc2da7ea0826ae51adefad8f08e3ba48ab86614da52866b47adffd
Jul 15 22:16:51.170984 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.170931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gsl96"]
Jul 15 22:16:51.173786 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:51.173753    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecc91ea_9fc4_4acf_8470_6e01e8d07bf5.slice/crio-7f45e09c0ec6c02f105a1fd7bca40e267d0311afdfdeaea09112a05b54ea2df3 WatchSource:0}: Error finding container 7f45e09c0ec6c02f105a1fd7bca40e267d0311afdfdeaea09112a05b54ea2df3: Status 404 returned error can't find the container with id 7f45e09c0ec6c02f105a1fd7bca40e267d0311afdfdeaea09112a05b54ea2df3
Jul 15 22:16:51.192729 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.192701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xq5ww"]
Jul 15 22:16:51.356681 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.356612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n49b8" event={"ID":"002d59a9-74b7-4bc3-8222-40a35a4bc153","Type":"ContainerStarted","Data":"3a3e129b0dcc2da7ea0826ae51adefad8f08e3ba48ab86614da52866b47adffd"}
Jul 15 22:16:51.357680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.357654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gsl96" event={"ID":"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5","Type":"ContainerStarted","Data":"7f45e09c0ec6c02f105a1fd7bca40e267d0311afdfdeaea09112a05b54ea2df3"}
Jul 15 22:16:51.367320 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:51.367299    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84693dac_8a3e_4731_8778_2a99c37b0e32.slice/crio-82483bfe95c49de63e05ebbbc3fc6763021f357a28030143f00613ea1f3dc166 WatchSource:0}: Error finding container 82483bfe95c49de63e05ebbbc3fc6763021f357a28030143f00613ea1f3dc166: Status 404 returned error can't find the container with id 82483bfe95c49de63e05ebbbc3fc6763021f357a28030143f00613ea1f3dc166
Jul 15 22:16:51.717224 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.717193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:51.717394 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.717236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:51.717394 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.717282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:51.719676 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.719651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/15fddc58-25b8-4d02-9c2d-eda67232c113-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zk859\" (UID: \"15fddc58-25b8-4d02-9c2d-eda67232c113\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:51.719808 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.719690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"image-registry-b7cbcd9dc-q9fjn\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") " pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:51.719808 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.719785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdc26a-8644-4f14-99cb-9fdacae2d495-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zpmld\" (UID: \"19fdc26a-8644-4f14-99cb-9fdacae2d495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:51.818506 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.818476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:51.818645 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.818515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:51.818645 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.818600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:51.818645 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.818626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:51.819107 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.819083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967cd527-fd78-4e56-b9bc-7d388f7f0413-service-ca-bundle\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:51.820622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.820593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cf39fe5-cec6-4347-8095-b6f07d5a8efc-metrics-tls\") pod \"dns-default-ffv6m\" (UID: \"3cf39fe5-cec6-4347-8095-b6f07d5a8efc\") " pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:51.820752 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.820642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/967cd527-fd78-4e56-b9bc-7d388f7f0413-metrics-certs\") pod \"router-default-64bf7f4c68-xhtmq\" (UID: \"967cd527-fd78-4e56-b9bc-7d388f7f0413\") " pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:51.820752 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.820729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"image-registry-7f48dbbf6d-z9dq6\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") " pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:51.916364 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.916340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7x57r\""
Jul 15 22:16:51.924310 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.924293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:51.937114 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.937095    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k2pw4\""
Jul 15 22:16:51.945172 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.945154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"
Jul 15 22:16:51.945443 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.945427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f2mhr\""
Jul 15 22:16:51.952790 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.952774    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ts7p5\""
Jul 15 22:16:51.953797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.953784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"
Jul 15 22:16:51.960806 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.960788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:51.969559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.969508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:51.991201 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.991142    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ff8j8\""
Jul 15 22:16:51.999653 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:51.999625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:16:52.141324 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.141212    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"]
Jul 15 22:16:52.193434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.192991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859"]
Jul 15 22:16:52.260900 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.260867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld"]
Jul 15 22:16:52.288071 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.287278    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ffv6m"]
Jul 15 22:16:52.292301 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:52.292275    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf39fe5_cec6_4347_8095_b6f07d5a8efc.slice/crio-63e44398af717f0e1fab4198a6ac246d56870af39d92f18048b0272099ae71d3 WatchSource:0}: Error finding container 63e44398af717f0e1fab4198a6ac246d56870af39d92f18048b0272099ae71d3: Status 404 returned error can't find the container with id 63e44398af717f0e1fab4198a6ac246d56870af39d92f18048b0272099ae71d3
Jul 15 22:16:52.335906 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.335646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"]
Jul 15 22:16:52.348581 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:52.347536    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c21d106_9fda_4395_8845_c6303a05d319.slice/crio-2e101c1da30452e7c56d3bd01e7f0a40fd636c3da783753f748da0f21afc8a44 WatchSource:0}: Error finding container 2e101c1da30452e7c56d3bd01e7f0a40fd636c3da783753f748da0f21afc8a44: Status 404 returned error can't find the container with id 2e101c1da30452e7c56d3bd01e7f0a40fd636c3da783753f748da0f21afc8a44
Jul 15 22:16:52.359744 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.359721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64bf7f4c68-xhtmq"]
Jul 15 22:16:52.365541 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.365512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xq5ww" event={"ID":"84693dac-8a3e-4731-8778-2a99c37b0e32","Type":"ContainerStarted","Data":"82483bfe95c49de63e05ebbbc3fc6763021f357a28030143f00613ea1f3dc166"}
Jul 15 22:16:52.366451 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:16:52.366405    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967cd527_fd78_4e56_b9bc_7d388f7f0413.slice/crio-a885a06d932322f5a97d662ac7b52d1dba3bdf6c6e481e795bf26b02669f0b15 WatchSource:0}: Error finding container a885a06d932322f5a97d662ac7b52d1dba3bdf6c6e481e795bf26b02669f0b15: Status 404 returned error can't find the container with id a885a06d932322f5a97d662ac7b52d1dba3bdf6c6e481e795bf26b02669f0b15
Jul 15 22:16:52.369098 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.368920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gstz" event={"ID":"07967bd4-a9ed-4a20-9408-4ea88fa1f124","Type":"ContainerStarted","Data":"1ce1b9e479e95726f68d088b28d63ce0e1f583839bcb6d31a075d987079b1af7"}
Jul 15 22:16:52.371449 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.371412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ffv6m" event={"ID":"3cf39fe5-cec6-4347-8095-b6f07d5a8efc","Type":"ContainerStarted","Data":"63e44398af717f0e1fab4198a6ac246d56870af39d92f18048b0272099ae71d3"}
Jul 15 22:16:52.372956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.372893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld" event={"ID":"19fdc26a-8644-4f14-99cb-9fdacae2d495","Type":"ContainerStarted","Data":"454bf7ec2804016413b8c8c4843d76a6241d027cded6ed4c1efedce8769804aa"}
Jul 15 22:16:52.375884 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.375763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn" event={"ID":"8a3e9871-ba4e-4211-9494-3577d232e955","Type":"ContainerStarted","Data":"eda4e0e542ff299a39142a15fad08f5d7c33a6bcbc0539631b9bc085755daafe"}
Jul 15 22:16:52.375884 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.375803    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn" event={"ID":"8a3e9871-ba4e-4211-9494-3577d232e955","Type":"ContainerStarted","Data":"9b7e3cd40dc559bb33e5fbfd511c5b6a204db8145021686a48ee5b50b5c79161"}
Jul 15 22:16:52.378388 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.378318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859" event={"ID":"15fddc58-25b8-4d02-9c2d-eda67232c113","Type":"ContainerStarted","Data":"5fd97b9eeaa84246b9cdb35ec3f1bd06729131770bed3e37b17160f60d97d685"}
Jul 15 22:16:52.381787 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.381722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n49b8" event={"ID":"002d59a9-74b7-4bc3-8222-40a35a4bc153","Type":"ContainerStarted","Data":"428dd6ec45cdd1621a2f2b7b1bd3f56411879e8efb9017a04c71cfb8fb413526"}
Jul 15 22:16:52.383010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.382947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6" event={"ID":"7c21d106-9fda-4395-8845-c6303a05d319","Type":"ContainerStarted","Data":"2e101c1da30452e7c56d3bd01e7f0a40fd636c3da783753f748da0f21afc8a44"}
Jul 15 22:16:52.398514 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.398188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:16:52.398514 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.398511    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:16:52.417625 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.417576    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn" podStartSLOduration=67.417556077 podStartE2EDuration="1m7.417556077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:52.416588563 +0000 UTC m=+68.941611784" watchObservedRunningTime="2026-07-15 22:16:52.417556077 +0000 UTC m=+68.942579300"
Jul 15 22:16:52.432076 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:52.432028    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n49b8" podStartSLOduration=67.432010501 podStartE2EDuration="1m7.432010501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:52.430946529 +0000 UTC m=+68.955969749" watchObservedRunningTime="2026-07-15 22:16:52.432010501 +0000 UTC m=+68.957033721"
Jul 15 22:16:53.390810 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.390756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6" event={"ID":"7c21d106-9fda-4395-8845-c6303a05d319","Type":"ContainerStarted","Data":"aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93"}
Jul 15 22:16:53.391195 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.391001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:16:53.394702 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.394416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq" event={"ID":"967cd527-fd78-4e56-b9bc-7d388f7f0413","Type":"ContainerStarted","Data":"f205c243ba5d44466139585469fff0ce1586cc56605753299d2e22c6c7f4dd1b"}
Jul 15 22:16:53.394702 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.394466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq" event={"ID":"967cd527-fd78-4e56-b9bc-7d388f7f0413","Type":"ContainerStarted","Data":"a885a06d932322f5a97d662ac7b52d1dba3bdf6c6e481e795bf26b02669f0b15"}
Jul 15 22:16:53.416425 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.416003    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6" podStartSLOduration=44.415984487 podStartE2EDuration="44.415984487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:53.413919692 +0000 UTC m=+69.938942908" watchObservedRunningTime="2026-07-15 22:16:53.415984487 +0000 UTC m=+69.941007710"
Jul 15 22:16:53.438848 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.437140    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq" podStartSLOduration=44.437119881 podStartE2EDuration="44.437119881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:53.436630053 +0000 UTC m=+69.961653274" watchObservedRunningTime="2026-07-15 22:16:53.437119881 +0000 UTC m=+69.962143101"
Jul 15 22:16:53.961905 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.961865    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:53.964592 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:53.964564    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:54.119440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.119413    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dncgs"]
Jul 15 22:16:54.123412 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.123390    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"]
Jul 15 22:16:54.125087 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.123531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.128267 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.128232    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"]
Jul 15 22:16:54.128805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.128328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.131423 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.131405    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"]
Jul 15 22:16:54.132722 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.132698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.134997 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.134978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.136953    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.137170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.137411    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.137503    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.137611    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.137801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jdxkb\""
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.137808    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 22:16:54.137924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.137829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 22:16:54.138583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.138565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tlx2z\""
Jul 15 22:16:54.138930 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.138914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 22:16:54.139235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.139219    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 22:16:54.139464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.139448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 22:16:54.139680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.139626    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 22:16:54.161592 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.161532    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dncgs"]
Jul 15 22:16:54.163113 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.163089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"]
Jul 15 22:16:54.178352 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.178213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"]
Jul 15 22:16:54.184824 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.184780    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"]
Jul 15 22:16:54.220424 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.219097    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-w44sz"]
Jul 15 22:16:54.223434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.222904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-w44sz"
Jul 15 22:16:54.225721 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.225544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5n6ws\""
Jul 15 22:16:54.225842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.225765    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 22:16:54.226880 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.226861    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 22:16:54.244823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.244766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-w44sz"]
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.246877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f67c5b56-564wz\" (UID: \"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.246916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8178934-eaa0-4ad0-b05b-811c4143cf4e-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dncgs\" (UID: \"e8178934-eaa0-4ad0-b05b-811c4143cf4e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.246946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz6mt\" (UniqueName: \"kubernetes.io/projected/0e0888e2-bc7f-4537-8bc0-1760140ad235-kube-api-access-kz6mt\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.246983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e0888e2-bc7f-4537-8bc0-1760140ad235-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-hub\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8pnc\" (UniqueName: \"kubernetes.io/projected/2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f-kube-api-access-b8pnc\") pod \"managed-serviceaccount-addon-agent-69f67c5b56-564wz\" (UID: \"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.247125 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.247602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-ca\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.247602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4406f178-dd6d-45c5-9080-6a493ea54097-klusterlet-config\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.247602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ttk2\" (UniqueName: \"kubernetes.io/projected/4406f178-dd6d-45c5-9080-6a493ea54097-kube-api-access-2ttk2\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.247602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4406f178-dd6d-45c5-9080-6a493ea54097-tmp\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.247602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.247351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8178934-eaa0-4ad0-b05b-811c4143cf4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dncgs\" (UID: \"e8178934-eaa0-4ad0-b05b-811c4143cf4e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.259796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.259773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"]
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f67c5b56-564wz\" (UID: \"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8178934-eaa0-4ad0-b05b-811c4143cf4e-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dncgs\" (UID: \"e8178934-eaa0-4ad0-b05b-811c4143cf4e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz6mt\" (UniqueName: \"kubernetes.io/projected/0e0888e2-bc7f-4537-8bc0-1760140ad235-kube-api-access-kz6mt\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e0888e2-bc7f-4537-8bc0-1760140ad235-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-hub\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8pnc\" (UniqueName: \"kubernetes.io/projected/2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f-kube-api-access-b8pnc\") pod \"managed-serviceaccount-addon-agent-69f67c5b56-564wz\" (UID: \"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kmcn\" (UniqueName: \"kubernetes.io/projected/a352e3fc-f590-47f8-a5b4-ac81917a67ed-kube-api-access-7kmcn\") pod \"downloads-68c9cbb497-w44sz\" (UID: \"a352e3fc-f590-47f8-a5b4-ac81917a67ed\") " pod="openshift-console/downloads-68c9cbb497-w44sz"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.348667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.348442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-ca\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.351252 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.349086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8178934-eaa0-4ad0-b05b-811c4143cf4e-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dncgs\" (UID: \"e8178934-eaa0-4ad0-b05b-811c4143cf4e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.351252 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.350456    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e0888e2-bc7f-4537-8bc0-1760140ad235-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.351357 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.351334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4406f178-dd6d-45c5-9080-6a493ea54097-klusterlet-config\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.352164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.351391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ttk2\" (UniqueName: \"kubernetes.io/projected/4406f178-dd6d-45c5-9080-6a493ea54097-kube-api-access-2ttk2\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.352164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.351494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4406f178-dd6d-45c5-9080-6a493ea54097-tmp\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.352164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.351526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8178934-eaa0-4ad0-b05b-811c4143cf4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dncgs\" (UID: \"e8178934-eaa0-4ad0-b05b-811c4143cf4e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.355177 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.355131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69f67c5b56-564wz\" (UID: \"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.356208 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.356087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.359154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.356904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.359154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.356965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4406f178-dd6d-45c5-9080-6a493ea54097-klusterlet-config\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.359154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.357156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-ca\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.359659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.359618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4406f178-dd6d-45c5-9080-6a493ea54097-tmp\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.360221 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.360179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8178934-eaa0-4ad0-b05b-811c4143cf4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dncgs\" (UID: \"e8178934-eaa0-4ad0-b05b-811c4143cf4e\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.362562 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.362524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0e0888e2-bc7f-4537-8bc0-1760140ad235-hub\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.378738 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.378694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz6mt\" (UniqueName: \"kubernetes.io/projected/0e0888e2-bc7f-4537-8bc0-1760140ad235-kube-api-access-kz6mt\") pod \"cluster-proxy-proxy-agent-7d85c5c97f-9bpn8\" (UID: \"0e0888e2-bc7f-4537-8bc0-1760140ad235\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.383572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.383527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8pnc\" (UniqueName: \"kubernetes.io/projected/2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f-kube-api-access-b8pnc\") pod \"managed-serviceaccount-addon-agent-69f67c5b56-564wz\" (UID: \"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.384892 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.384813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ttk2\" (UniqueName: \"kubernetes.io/projected/4406f178-dd6d-45c5-9080-6a493ea54097-kube-api-access-2ttk2\") pod \"klusterlet-addon-workmgr-dcbd447b9-kdl4v\" (UID: \"4406f178-dd6d-45c5-9080-6a493ea54097\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.402894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.402148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xq5ww" event={"ID":"84693dac-8a3e-4731-8778-2a99c37b0e32","Type":"ContainerStarted","Data":"271775b427d5bc5d50082f62bb50a5247d026c8164ec142b86352a96d2250c24"}
Jul 15 22:16:54.402894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.402195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xq5ww" event={"ID":"84693dac-8a3e-4731-8778-2a99c37b0e32","Type":"ContainerStarted","Data":"b059be0dbe05e21f82abfee74c249394418f220c9ad34a839431a9b0eb3be00f"}
Jul 15 22:16:54.403346 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.403328    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:54.404884 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.404868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64bf7f4c68-xhtmq"
Jul 15 22:16:54.430483 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.430319    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xq5ww" podStartSLOduration=67.518151386 podStartE2EDuration="1m9.430300774s" totalImagesPullingTime="1.912149388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:54.428316751 +0000 UTC m=+70.953339974" watchObservedRunningTime="2026-07-15 22:16:54.430300774 +0000 UTC m=+70.955323995"
Jul 15 22:16:54.442835 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.442784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs"
Jul 15 22:16:54.452190 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.452109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kmcn\" (UniqueName: \"kubernetes.io/projected/a352e3fc-f590-47f8-a5b4-ac81917a67ed-kube-api-access-7kmcn\") pod \"downloads-68c9cbb497-w44sz\" (UID: \"a352e3fc-f590-47f8-a5b4-ac81917a67ed\") " pod="openshift-console/downloads-68c9cbb497-w44sz"
Jul 15 22:16:54.460497 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.460476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:16:54.465293 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.465205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kmcn\" (UniqueName: \"kubernetes.io/projected/a352e3fc-f590-47f8-a5b4-ac81917a67ed-kube-api-access-7kmcn\") pod \"downloads-68c9cbb497-w44sz\" (UID: \"a352e3fc-f590-47f8-a5b4-ac81917a67ed\") " pod="openshift-console/downloads-68c9cbb497-w44sz"
Jul 15 22:16:54.485610 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.485525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"
Jul 15 22:16:54.492532 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.492512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"
Jul 15 22:16:54.546091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:54.545857    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-w44sz"
Jul 15 22:16:55.865313 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.865284    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b77655447-xg5zx"]
Jul 15 22:16:55.874980 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.874957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:55.886096 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.886075    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 22:16:55.887450 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.887407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 22:16:55.887559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.887475    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 22:16:55.887559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.887532    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 22:16:55.887773 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.887740    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 22:16:55.887875 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.887782    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2b7m5\""
Jul 15 22:16:55.889646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.889627    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b77655447-xg5zx"]
Jul 15 22:16:55.974004 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.973971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-oauth-config\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:55.974163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.974039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-oauth-serving-cert\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:55.974163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.974064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-serving-cert\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:55.974163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.974089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-config\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:55.974163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.974135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87x5f\" (UniqueName: \"kubernetes.io/projected/85075432-2c5e-42ef-91a2-7e90aa4eefa8-kube-api-access-87x5f\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:55.974359 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:55.974174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-service-ca\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.075016 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.074938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87x5f\" (UniqueName: \"kubernetes.io/projected/85075432-2c5e-42ef-91a2-7e90aa4eefa8-kube-api-access-87x5f\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.075016 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.074989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-service-ca\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.075204 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.075033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-oauth-config\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.075204 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.075073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-oauth-serving-cert\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.075204 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.075107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-serving-cert\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.075204 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.075139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-config\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.075858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.075795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-service-ca\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.076260 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.076219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-config\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.076405 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.076218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-oauth-serving-cert\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.078210 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.077976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-oauth-config\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.079518 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.079466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-serving-cert\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.086515 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.086478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87x5f\" (UniqueName: \"kubernetes.io/projected/85075432-2c5e-42ef-91a2-7e90aa4eefa8-kube-api-access-87x5f\") pod \"console-7b77655447-xg5zx\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") " pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:16:56.186384 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:16:56.186352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:17:00.334917 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.334647    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dncgs"]
Jul 15 22:17:00.424671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.424328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b77655447-xg5zx"]
Jul 15 22:17:00.431569 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.431484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859" event={"ID":"15fddc58-25b8-4d02-9c2d-eda67232c113","Type":"ContainerStarted","Data":"de09975a94bcd76726e9fb94e6c9196960ee9562b8e36a87dd1317dbd570d69e"}
Jul 15 22:17:00.433380 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.433354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gsl96" event={"ID":"eecc91ea-9fc4-4acf-8470-6e01e8d07bf5","Type":"ContainerStarted","Data":"c2b288ab3985291064d143f1f7d55bdfb45a6de10c72dd132f88b7d753d1ac5a"}
Jul 15 22:17:00.436541 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.436523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ffv6m" event={"ID":"3cf39fe5-cec6-4347-8095-b6f07d5a8efc","Type":"ContainerStarted","Data":"64c266efc9395bc5e6ef5e684ad673e22159eb877d4d3331d9deb0ed4aab67d2"}
Jul 15 22:17:00.439982 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.439961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld" event={"ID":"19fdc26a-8644-4f14-99cb-9fdacae2d495","Type":"ContainerStarted","Data":"9aa3e1abab65cfa09a184eeeb2e9985cc4eaa6ca2bdbf648c13606aaec9cb32a"}
Jul 15 22:17:00.458783 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.458735    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zk859" podStartSLOduration=43.798571604 podStartE2EDuration="51.458721795s" totalImagesPullingTime="7.660150191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:00.457028332 +0000 UTC m=+76.982051553" watchObservedRunningTime="2026-07-15 22:17:00.458721795 +0000 UTC m=+76.983745014"
Jul 15 22:17:00.480887 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.480839    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gsl96" podStartSLOduration=66.581556734 podStartE2EDuration="1m15.48082048s" totalImagesPullingTime="8.899263746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:00.478581181 +0000 UTC m=+77.003604402" watchObservedRunningTime="2026-07-15 22:17:00.48082048 +0000 UTC m=+77.005843701"
Jul 15 22:17:00.509738 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:17:00.509701    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8178934_eaa0_4ad0_b05b_811c4143cf4e.slice/crio-e7bd9d01f7d8b9e7afbf9986078ad250e8d48ec441be2086ebeb8090157988ef WatchSource:0}: Error finding container e7bd9d01f7d8b9e7afbf9986078ad250e8d48ec441be2086ebeb8090157988ef: Status 404 returned error can't find the container with id e7bd9d01f7d8b9e7afbf9986078ad250e8d48ec441be2086ebeb8090157988ef
Jul 15 22:17:00.513766 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:17:00.511711    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85075432_2c5e_42ef_91a2_7e90aa4eefa8.slice/crio-cf9bdd896da83d430fb854dd682e3b3d0a6b44e641d19704be8b37123646ae73 WatchSource:0}: Error finding container cf9bdd896da83d430fb854dd682e3b3d0a6b44e641d19704be8b37123646ae73: Status 404 returned error can't find the container with id cf9bdd896da83d430fb854dd682e3b3d0a6b44e641d19704be8b37123646ae73
Jul 15 22:17:00.590233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.588991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-w44sz"]
Jul 15 22:17:00.603801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.603744    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz"]
Jul 15 22:17:00.610414 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:17:00.610390    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2505d1bb_b0b1_4e41_9c5b_f5cbed9a0c3f.slice/crio-78517943ead462c949d6b8549cc716c3879443c97bc4b5f5d77ca23b8c30f855 WatchSource:0}: Error finding container 78517943ead462c949d6b8549cc716c3879443c97bc4b5f5d77ca23b8c30f855: Status 404 returned error can't find the container with id 78517943ead462c949d6b8549cc716c3879443c97bc4b5f5d77ca23b8c30f855
Jul 15 22:17:00.619965 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.619132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8"]
Jul 15 22:17:00.621873 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:00.621694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"]
Jul 15 22:17:00.626065 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:17:00.625506    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4406f178_dd6d_45c5_9080_6a493ea54097.slice/crio-7c8cc086d79103f237e8136cd7aa3cfd1115deb3ccc57e0cef4519b27413b61c WatchSource:0}: Error finding container 7c8cc086d79103f237e8136cd7aa3cfd1115deb3ccc57e0cef4519b27413b61c: Status 404 returned error can't find the container with id 7c8cc086d79103f237e8136cd7aa3cfd1115deb3ccc57e0cef4519b27413b61c
Jul 15 22:17:01.448866 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.448789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs" event={"ID":"e8178934-eaa0-4ad0-b05b-811c4143cf4e","Type":"ContainerStarted","Data":"e7bd9d01f7d8b9e7afbf9986078ad250e8d48ec441be2086ebeb8090157988ef"}
Jul 15 22:17:01.453714 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.453665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b77655447-xg5zx" event={"ID":"85075432-2c5e-42ef-91a2-7e90aa4eefa8","Type":"ContainerStarted","Data":"cf9bdd896da83d430fb854dd682e3b3d0a6b44e641d19704be8b37123646ae73"}
Jul 15 22:17:01.456360 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.456295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v" event={"ID":"4406f178-dd6d-45c5-9080-6a493ea54097","Type":"ContainerStarted","Data":"7c8cc086d79103f237e8136cd7aa3cfd1115deb3ccc57e0cef4519b27413b61c"}
Jul 15 22:17:01.459730 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.459547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-w44sz" event={"ID":"a352e3fc-f590-47f8-a5b4-ac81917a67ed","Type":"ContainerStarted","Data":"2e8c8bba26ac13b1ef04f5030d90d9148db971de843d13a14c029126a0fa5085"}
Jul 15 22:17:01.462805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.462776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gstz" event={"ID":"07967bd4-a9ed-4a20-9408-4ea88fa1f124","Type":"ContainerStarted","Data":"bfa07ed49199bc5b838230a59806c3a78f8e08911497770eaf114704f1f3231f"}
Jul 15 22:17:01.466317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.466292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ffv6m" event={"ID":"3cf39fe5-cec6-4347-8095-b6f07d5a8efc","Type":"ContainerStarted","Data":"90b4474b67b0b253e8caa6e42e8812c7db3bebe1c24a7613d7e08abbc2891a0a"}
Jul 15 22:17:01.467110 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.467046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:17:01.470059 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.469529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld" event={"ID":"19fdc26a-8644-4f14-99cb-9fdacae2d495","Type":"ContainerStarted","Data":"72bf9946bd164d633be84ef8396f45166b13bdaacdd23c0167ec401a977bd133"}
Jul 15 22:17:01.473046 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.472983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8" event={"ID":"0e0888e2-bc7f-4537-8bc0-1760140ad235","Type":"ContainerStarted","Data":"0e8744a4ae585a63cbbcdde108edf7a480d8877dac3d8a6f2892ef89a4d41a3f"}
Jul 15 22:17:01.475193 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.474913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz" event={"ID":"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f","Type":"ContainerStarted","Data":"78517943ead462c949d6b8549cc716c3879443c97bc4b5f5d77ca23b8c30f855"}
Jul 15 22:17:01.497019 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:01.496125    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ffv6m" podStartSLOduration=34.716274671 podStartE2EDuration="42.49610629s" totalImagesPullingTime="7.779831619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:01.495177126 +0000 UTC m=+78.020200349" watchObservedRunningTime="2026-07-15 22:17:01.49610629 +0000 UTC m=+78.021129512"
Jul 15 22:17:11.929656 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:11.929588    2580 patch_prober.go:28] interesting pod/image-registry-b7cbcd9dc-q9fjn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 22:17:11.930325 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:11.929657    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn" podUID="8a3e9871-ba4e-4211-9494-3577d232e955" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:17:12.510396 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.510318    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ffv6m"
Jul 15 22:17:12.531217 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.531179    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zpmld" podStartSLOduration=55.77873787 podStartE2EDuration="1m3.531165182s" totalImagesPullingTime="7.752427312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:01.535062999 +0000 UTC m=+78.060086221" watchObservedRunningTime="2026-07-15 22:17:12.531165182 +0000 UTC m=+89.056188440"
Jul 15 22:17:12.561312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.561277    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs" event={"ID":"e8178934-eaa0-4ad0-b05b-811c4143cf4e","Type":"ContainerStarted","Data":"15e0698eaaedd4470061b7d854cc32a7f0509806f9edb2edd88ab16f8b4096b4"}
Jul 15 22:17:12.563026 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.562998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b77655447-xg5zx" event={"ID":"85075432-2c5e-42ef-91a2-7e90aa4eefa8","Type":"ContainerStarted","Data":"9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318"}
Jul 15 22:17:12.565595 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.565569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v" event={"ID":"4406f178-dd6d-45c5-9080-6a493ea54097","Type":"ContainerStarted","Data":"677413d9aedda1a2c9b575b1d7b3ea9e51a5022d54a7369e8958ead7c3fe2499"}
Jul 15 22:17:12.565890 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.565871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:17:12.567520 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.567498    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v"
Jul 15 22:17:12.568785 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.568766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gstz" event={"ID":"07967bd4-a9ed-4a20-9408-4ea88fa1f124","Type":"ContainerStarted","Data":"695ecb9d89f8014c14619d48d755cb4842d4f71b7f83068fa32944561a80e87b"}
Jul 15 22:17:12.571275 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.571188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8" event={"ID":"0e0888e2-bc7f-4537-8bc0-1760140ad235","Type":"ContainerStarted","Data":"93f75f5a5978a0a1d0243ce8c09569317aa2dbdf4a6036ae3e72108994b4b15e"}
Jul 15 22:17:12.571275 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.571223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8" event={"ID":"0e0888e2-bc7f-4537-8bc0-1760140ad235","Type":"ContainerStarted","Data":"fcbd02bd3669ae914c27e748c403355f02ce284368f4d0820ebaa2343fa582f7"}
Jul 15 22:17:12.573317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.573270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz" event={"ID":"2505d1bb-b0b1-4e41-9c5b-f5cbed9a0c3f","Type":"ContainerStarted","Data":"8c6d2613536cda11a1263c0be1cbbe1662c27294647ea21c80d8ebc138ce5945"}
Jul 15 22:17:12.580044 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.579991    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-dncgs" podStartSLOduration=6.8729392019999995 podStartE2EDuration="18.579974639s" totalImagesPullingTime="11.707035437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:12.579022645 +0000 UTC m=+89.104045866" watchObservedRunningTime="2026-07-15 22:17:12.579974639 +0000 UTC m=+89.104997861"
Jul 15 22:17:12.599617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.599565    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b77655447-xg5zx" podStartSLOduration=5.887554551 podStartE2EDuration="17.59954619s" totalImagesPullingTime="11.711991639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:12.598075985 +0000 UTC m=+89.123099206" watchObservedRunningTime="2026-07-15 22:17:12.59954619 +0000 UTC m=+89.124569411"
Jul 15 22:17:12.633547 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.633502    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69f67c5b56-564wz" podStartSLOduration=7.007449303 podStartE2EDuration="18.633483811s" totalImagesPullingTime="11.626034508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:12.633479196 +0000 UTC m=+89.158502417" watchObservedRunningTime="2026-07-15 22:17:12.633483811 +0000 UTC m=+89.158507032"
Jul 15 22:17:12.633661 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.633641    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dcbd447b9-kdl4v" podStartSLOduration=7.000713591 podStartE2EDuration="18.633633549s" totalImagesPullingTime="11.632919958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:12.614831639 +0000 UTC m=+89.139854860" watchObservedRunningTime="2026-07-15 22:17:12.633633549 +0000 UTC m=+89.158656770"
Jul 15 22:17:12.656407 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.656358    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8" podStartSLOduration=7.016452054 podStartE2EDuration="18.656330889s" totalImagesPullingTime="11.639878835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:12.656106935 +0000 UTC m=+89.181130155" watchObservedRunningTime="2026-07-15 22:17:12.656330889 +0000 UTC m=+89.181354110"
Jul 15 22:17:12.684781 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:12.684741    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7gstz" podStartSLOduration=17.801751863 podStartE2EDuration="43.684728335s" totalImagesPullingTime="25.882976472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:12.683814537 +0000 UTC m=+89.208837781" watchObservedRunningTime="2026-07-15 22:17:12.684728335 +0000 UTC m=+89.209751555"
Jul 15 22:17:13.399467 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:13.399435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:17:13.579545 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:13.579488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d85c5c97f-9bpn8" event={"ID":"0e0888e2-bc7f-4537-8bc0-1760140ad235","Type":"ContainerStarted","Data":"8a7bb94d8d593f7b1b991b44a2f69c2ba3e6554c964c76abc04c4962e0d0460b"}
Jul 15 22:17:15.413292 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:15.413261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:17:16.187123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:16.187088    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:17:16.187328 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:16.187172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:17:16.188795 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:16.188772    2580 patch_prober.go:28] interesting pod/console-7b77655447-xg5zx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.27:8443/health\": dial tcp 10.132.0.27:8443: connect: connection refused" start-of-body=
Jul 15 22:17:16.188916 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:16.188809    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b77655447-xg5zx" podUID="85075432-2c5e-42ef-91a2-7e90aa4eefa8" containerName="console" probeResult="failure" output="Get \"https://10.132.0.27:8443/health\": dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 15 22:17:18.595988 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.595952    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kd7sz"]
Jul 15 22:17:18.729717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.729685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.732667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.732483    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 22:17:18.734479 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.734341    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 22:17:18.734479 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.734382    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 22:17:18.735367 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.735349    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qc2q4\""
Jul 15 22:17:18.735581 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.735565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 22:17:18.895379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f57258c2-0f8a-4525-aee9-8f9263ed20e9-metrics-client-ca\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-tls\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-sys\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnffq\" (UniqueName: \"kubernetes.io/projected/f57258c2-0f8a-4525-aee9-8f9263ed20e9-kube-api-access-bnffq\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-wtmp\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-textfile\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-accelerators-collector-config\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.895635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.895570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-root\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.996905 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.996869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-wtmp\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.996912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-textfile\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.996938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-accelerators-collector-config\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.996964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-root\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.997003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f57258c2-0f8a-4525-aee9-8f9263ed20e9-metrics-client-ca\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.997037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-tls\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.997065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997405 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.997120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-sys\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997405 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.997153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnffq\" (UniqueName: \"kubernetes.io/projected/f57258c2-0f8a-4525-aee9-8f9263ed20e9-kube-api-access-bnffq\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997762 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.997645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-wtmp\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.997762 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.997702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-sys\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.998279 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.998181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f57258c2-0f8a-4525-aee9-8f9263ed20e9-metrics-client-ca\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.998568 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.998515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-accelerators-collector-config\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.998568 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.998526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-textfile\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:18.998765 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:18.998585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f57258c2-0f8a-4525-aee9-8f9263ed20e9-root\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:19.000613 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:19.000586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-tls\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:19.000709 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:19.000595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f57258c2-0f8a-4525-aee9-8f9263ed20e9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:19.006946 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:19.006924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnffq\" (UniqueName: \"kubernetes.io/projected/f57258c2-0f8a-4525-aee9-8f9263ed20e9-kube-api-access-bnffq\") pod \"node-exporter-kd7sz\" (UID: \"f57258c2-0f8a-4525-aee9-8f9263ed20e9\") " pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:19.042671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:19.042649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kd7sz"
Jul 15 22:17:20.432074 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:20.432004    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6" podUID="7c21d106-9fda-4395-8845-c6303a05d319" containerName="registry" containerID="cri-o://aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93" gracePeriod=30
Jul 15 22:17:22.116209 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:17:22.116175    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57258c2_0f8a_4525_aee9_8f9263ed20e9.slice/crio-f84219f0e789e8f871181c82428e97be23e6f0f2dbcb0ea3c2336db238247775 WatchSource:0}: Error finding container f84219f0e789e8f871181c82428e97be23e6f0f2dbcb0ea3c2336db238247775: Status 404 returned error can't find the container with id f84219f0e789e8f871181c82428e97be23e6f0f2dbcb0ea3c2336db238247775
Jul 15 22:17:22.299764 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.299737    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:17:22.430988 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.430960    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9vvd\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-kube-api-access-b9vvd\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431187 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.430995    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-trusted-ca\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431187 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-registry-certificates\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431187 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431075    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-bound-sa-token\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431187 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431097    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c21d106-9fda-4395-8845-c6303a05d319-ca-trust-extracted\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431187 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431142    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431187 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-installation-pull-secrets\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431568 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431210    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-image-registry-private-configuration\") pod \"7c21d106-9fda-4395-8845-c6303a05d319\" (UID: \"7c21d106-9fda-4395-8845-c6303a05d319\") "
Jul 15 22:17:22.431568 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431455    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:17:22.431568 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.431552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:17:22.433953 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.433891    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:17:22.433953 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.433916    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:17:22.433953 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.433941    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:17:22.434130 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.434038    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:17:22.434130 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.434097    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-kube-api-access-b9vvd" (OuterVolumeSpecName: "kube-api-access-b9vvd") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "kube-api-access-b9vvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:17:22.440396 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.440372    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c21d106-9fda-4395-8845-c6303a05d319-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7c21d106-9fda-4395-8845-c6303a05d319" (UID: "7c21d106-9fda-4395-8845-c6303a05d319"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:17:22.532235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532199    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-bound-sa-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.532235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532230    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7c21d106-9fda-4395-8845-c6303a05d319-ca-trust-extracted\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.532235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532255    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-registry-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.532235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532264    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-installation-pull-secrets\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.532505 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532273    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7c21d106-9fda-4395-8845-c6303a05d319-image-registry-private-configuration\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.532505 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532282    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9vvd\" (UniqueName: \"kubernetes.io/projected/7c21d106-9fda-4395-8845-c6303a05d319-kube-api-access-b9vvd\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.532505 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532290    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-trusted-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.532505 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.532298    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7c21d106-9fda-4395-8845-c6303a05d319-registry-certificates\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:22.593956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.593913    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"]
Jul 15 22:17:22.625671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.625387    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c21d106-9fda-4395-8845-c6303a05d319" containerID="aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93" exitCode=0
Jul 15 22:17:22.625671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.625437    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"
Jul 15 22:17:22.625671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.625488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6" event={"ID":"7c21d106-9fda-4395-8845-c6303a05d319","Type":"ContainerDied","Data":"aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93"}
Jul 15 22:17:22.625671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.625527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f48dbbf6d-z9dq6" event={"ID":"7c21d106-9fda-4395-8845-c6303a05d319","Type":"ContainerDied","Data":"2e101c1da30452e7c56d3bd01e7f0a40fd636c3da783753f748da0f21afc8a44"}
Jul 15 22:17:22.625671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.625554    2580 scope.go:117] "RemoveContainer" containerID="aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93"
Jul 15 22:17:22.627708 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.627678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kd7sz" event={"ID":"f57258c2-0f8a-4525-aee9-8f9263ed20e9","Type":"ContainerStarted","Data":"f84219f0e789e8f871181c82428e97be23e6f0f2dbcb0ea3c2336db238247775"}
Jul 15 22:17:22.636684 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.636641    2580 scope.go:117] "RemoveContainer" containerID="aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93"
Jul 15 22:17:22.637018 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:17:22.636988    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93\": container with ID starting with aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93 not found: ID does not exist" containerID="aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93"
Jul 15 22:17:22.637118 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.637030    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93"} err="failed to get container status \"aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93\": rpc error: code = NotFound desc = could not find container \"aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93\": container with ID starting with aefe3660b0f01311fb8b2d5f61fc989481a5e2959a7dc4e55a02990ae93a1c93 not found: ID does not exist"
Jul 15 22:17:22.658072 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.658035    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"]
Jul 15 22:17:22.662017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:22.661991    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f48dbbf6d-z9dq6"]
Jul 15 22:17:23.267375 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.267333    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b77655447-xg5zx"]
Jul 15 22:17:23.326456 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.326417    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5474877dd4-4pcr7"]
Jul 15 22:17:23.326894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.326877    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c21d106-9fda-4395-8845-c6303a05d319" containerName="registry"
Jul 15 22:17:23.326894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.326895    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c21d106-9fda-4395-8845-c6303a05d319" containerName="registry"
Jul 15 22:17:23.327056 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.326981    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c21d106-9fda-4395-8845-c6303a05d319" containerName="registry"
Jul 15 22:17:23.347321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.347287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.347697 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.347672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5474877dd4-4pcr7"]
Jul 15 22:17:23.358740 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.358717    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 22:17:23.397284 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.397194    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n49b8"
Jul 15 22:17:23.441163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.441131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-trusted-ca-bundle\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.441458 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.441438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvk2\" (UniqueName: \"kubernetes.io/projected/18a26036-21db-4fc4-a51c-5ee3e829bbb2-kube-api-access-bmvk2\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.441595 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.441581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-oauth-config\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.441726 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.441714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-serving-cert\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.441855 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.441842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-config\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.441970 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.441959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-service-ca\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.442067 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.442046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-oauth-serving-cert\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.543329 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.543288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-service-ca\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.543510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.543342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-oauth-serving-cert\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.543510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.543392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-trusted-ca-bundle\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.543510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.543422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvk2\" (UniqueName: \"kubernetes.io/projected/18a26036-21db-4fc4-a51c-5ee3e829bbb2-kube-api-access-bmvk2\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.543510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.543448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-oauth-config\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.543510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.543484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-serving-cert\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.543765 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.543553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-config\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.544226 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.544141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-service-ca\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.544467 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.544408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-config\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.544554 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.544458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-oauth-serving-cert\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.545166 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.545142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-trusted-ca-bundle\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.546964 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.546940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-serving-cert\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.547078 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.547003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-oauth-config\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.557067 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.557043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvk2\" (UniqueName: \"kubernetes.io/projected/18a26036-21db-4fc4-a51c-5ee3e829bbb2-kube-api-access-bmvk2\") pod \"console-5474877dd4-4pcr7\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") " pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.636474 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.636432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-w44sz" event={"ID":"a352e3fc-f590-47f8-a5b4-ac81917a67ed","Type":"ContainerStarted","Data":"56cc27c8666d267ad1055a981748254f3c94e485a56cee8766725ff624c82841"}
Jul 15 22:17:23.636650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.636621    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-w44sz"
Jul 15 22:17:23.656925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.656900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-w44sz"
Jul 15 22:17:23.660533 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.660471    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-w44sz" podStartSLOduration=7.712603622 podStartE2EDuration="29.660449905s" totalImagesPullingTime="21.947846283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:23.658518768 +0000 UTC m=+100.183541988" watchObservedRunningTime="2026-07-15 22:17:23.660449905 +0000 UTC m=+100.185473126"
Jul 15 22:17:23.662821 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.662792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:23.874668 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:23.874633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5474877dd4-4pcr7"]
Jul 15 22:17:23.879365 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:17:23.879337    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a26036_21db_4fc4_a51c_5ee3e829bbb2.slice/crio-99a837251e97144135a11160b15fdbbf19a89762323235f50b9c9557bab774af WatchSource:0}: Error finding container 99a837251e97144135a11160b15fdbbf19a89762323235f50b9c9557bab774af: Status 404 returned error can't find the container with id 99a837251e97144135a11160b15fdbbf19a89762323235f50b9c9557bab774af
Jul 15 22:17:24.012393 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:24.012335    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c21d106-9fda-4395-8845-c6303a05d319" path="/var/lib/kubelet/pods/7c21d106-9fda-4395-8845-c6303a05d319/volumes"
Jul 15 22:17:24.644783 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:24.644744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5474877dd4-4pcr7" event={"ID":"18a26036-21db-4fc4-a51c-5ee3e829bbb2","Type":"ContainerStarted","Data":"8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8"}
Jul 15 22:17:24.645404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:24.644808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5474877dd4-4pcr7" event={"ID":"18a26036-21db-4fc4-a51c-5ee3e829bbb2","Type":"ContainerStarted","Data":"99a837251e97144135a11160b15fdbbf19a89762323235f50b9c9557bab774af"}
Jul 15 22:17:24.646774 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:24.646739    2580 generic.go:356] "Generic (PLEG): container finished" podID="f57258c2-0f8a-4525-aee9-8f9263ed20e9" containerID="4383db76fb1b5b9d57e3792dcc81d8f34a3f07d8f1fadf893b5b453651952487" exitCode=0
Jul 15 22:17:24.646900 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:24.646830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kd7sz" event={"ID":"f57258c2-0f8a-4525-aee9-8f9263ed20e9","Type":"ContainerDied","Data":"4383db76fb1b5b9d57e3792dcc81d8f34a3f07d8f1fadf893b5b453651952487"}
Jul 15 22:17:24.674591 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:24.674531    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5474877dd4-4pcr7" podStartSLOduration=1.674514903 podStartE2EDuration="1.674514903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:24.673525208 +0000 UTC m=+101.198548453" watchObservedRunningTime="2026-07-15 22:17:24.674514903 +0000 UTC m=+101.199538123"
Jul 15 22:17:25.654672 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:25.654633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kd7sz" event={"ID":"f57258c2-0f8a-4525-aee9-8f9263ed20e9","Type":"ContainerStarted","Data":"5042486d82167bd468c0602431944dd266b0e294eb3dc839c3c9e24c0944de7d"}
Jul 15 22:17:25.655137 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:25.654696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kd7sz" event={"ID":"f57258c2-0f8a-4525-aee9-8f9263ed20e9","Type":"ContainerStarted","Data":"c486a4a2676ef5837b4ddf031de248b6c0180ea57d9072d87689aeab4fa4254e"}
Jul 15 22:17:25.678614 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:25.678566    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kd7sz" podStartSLOduration=6.039329679 podStartE2EDuration="7.678549687s" totalImagesPullingTime="1.537570965s" totalInitContainerRuntime="101.649043ms" isStatefulPod=true podCreationTimestamp="2026-07-15 22:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:25.676821397 +0000 UTC m=+102.201844613" watchObservedRunningTime="2026-07-15 22:17:25.678549687 +0000 UTC m=+102.203572905"
Jul 15 22:17:33.663559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:33.663524    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:33.663998 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:33.663595    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:33.668490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:33.668466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:33.695451 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:33.695430    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:17:34.697170 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:34.697136    2580 generic.go:356] "Generic (PLEG): container finished" podID="647ff99d-eb21-46b9-a02a-2b6ad9b6de2b" containerID="8159790e2b149b3d00efef7bde5c851c3a6e7f8afbfa83d3b835b12c74c58b2e" exitCode=0
Jul 15 22:17:34.697526 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:34.697214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r" event={"ID":"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b","Type":"ContainerDied","Data":"8159790e2b149b3d00efef7bde5c851c3a6e7f8afbfa83d3b835b12c74c58b2e"}
Jul 15 22:17:34.697711 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:34.697694    2580 scope.go:117] "RemoveContainer" containerID="8159790e2b149b3d00efef7bde5c851c3a6e7f8afbfa83d3b835b12c74c58b2e"
Jul 15 22:17:35.702759 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:35.702727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tv29r" event={"ID":"647ff99d-eb21-46b9-a02a-2b6ad9b6de2b","Type":"ContainerStarted","Data":"a4aff4d85de045cfa51ab05292e18b35ec7ee09ab77c157a7da61ffdc0a6cd77"}
Jul 15 22:17:39.722055 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:39.722023    2580 generic.go:356] "Generic (PLEG): container finished" podID="5b8bd896-286c-4473-a150-63ad81c8a097" containerID="c196dd7a25c883a7601360ccf734246080ee6db2923233816a908e28d9c479cc" exitCode=0
Jul 15 22:17:39.722504 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:39.722061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jmq88" event={"ID":"5b8bd896-286c-4473-a150-63ad81c8a097","Type":"ContainerDied","Data":"c196dd7a25c883a7601360ccf734246080ee6db2923233816a908e28d9c479cc"}
Jul 15 22:17:39.722504 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:39.722378    2580 scope.go:117] "RemoveContainer" containerID="c196dd7a25c883a7601360ccf734246080ee6db2923233816a908e28d9c479cc"
Jul 15 22:17:40.727661 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:40.727624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jmq88" event={"ID":"5b8bd896-286c-4473-a150-63ad81c8a097","Type":"ContainerStarted","Data":"c26c7a0ababc43568e03cd7d21bc107d99a5127fc241a107784ec40d27a3e879"}
Jul 15 22:17:47.628133 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.628083    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn" podUID="8a3e9871-ba4e-4211-9494-3577d232e955" containerName="registry" containerID="cri-o://eda4e0e542ff299a39142a15fad08f5d7c33a6bcbc0539631b9bc085755daafe" gracePeriod=30
Jul 15 22:17:47.758674 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.758648    2580 generic.go:356] "Generic (PLEG): container finished" podID="8a3e9871-ba4e-4211-9494-3577d232e955" containerID="eda4e0e542ff299a39142a15fad08f5d7c33a6bcbc0539631b9bc085755daafe" exitCode=0
Jul 15 22:17:47.758776 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.758737    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn" event={"ID":"8a3e9871-ba4e-4211-9494-3577d232e955","Type":"ContainerDied","Data":"eda4e0e542ff299a39142a15fad08f5d7c33a6bcbc0539631b9bc085755daafe"}
Jul 15 22:17:47.913525 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.913498    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:17:47.949285 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-trusted-ca\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949484 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a3e9871-ba4e-4211-9494-3577d232e955-ca-trust-extracted\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949484 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-image-registry-private-configuration\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949484 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949355    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-installation-pull-secrets\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949484 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949402    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-registry-certificates\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949484 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949464    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-bound-sa-token\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949629    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:17:47.949769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqfrt\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-kube-api-access-tqfrt\") pod \"8a3e9871-ba4e-4211-9494-3577d232e955\" (UID: \"8a3e9871-ba4e-4211-9494-3577d232e955\") "
Jul 15 22:17:47.949927 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949858    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:17:47.949927 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.949908    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-trusted-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:47.952163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.952123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:17:47.952305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.952265    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:17:47.952391 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.952313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:17:47.952469 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.952444    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-kube-api-access-tqfrt" (OuterVolumeSpecName: "kube-api-access-tqfrt") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "kube-api-access-tqfrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:17:47.952628 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.952595    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:17:47.961361 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:47.961331    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a3e9871-ba4e-4211-9494-3577d232e955-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8a3e9871-ba4e-4211-9494-3577d232e955" (UID: "8a3e9871-ba4e-4211-9494-3577d232e955"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:17:48.051117 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.051084    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a3e9871-ba4e-4211-9494-3577d232e955-registry-certificates\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.051117 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.051113    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-registry-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.051332 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.051126    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-bound-sa-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.051332 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.051138    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqfrt\" (UniqueName: \"kubernetes.io/projected/8a3e9871-ba4e-4211-9494-3577d232e955-kube-api-access-tqfrt\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.051332 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.051149    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a3e9871-ba4e-4211-9494-3577d232e955-ca-trust-extracted\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.051332 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.051161    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-image-registry-private-configuration\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.051332 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.051173    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a3e9871-ba4e-4211-9494-3577d232e955-installation-pull-secrets\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.294984 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.294920    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b77655447-xg5zx" podUID="85075432-2c5e-42ef-91a2-7e90aa4eefa8" containerName="console" containerID="cri-o://9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318" gracePeriod=15
Jul 15 22:17:48.571153 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.571124    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:17:48.657360 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-service-ca\") pod \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") "
Jul 15 22:17:48.657792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657412    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-serving-cert\") pod \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") "
Jul 15 22:17:48.657792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657441    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-oauth-serving-cert\") pod \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") "
Jul 15 22:17:48.657792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-oauth-config\") pod \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") "
Jul 15 22:17:48.657792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657477    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-config\") pod \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") "
Jul 15 22:17:48.657792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657513    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87x5f\" (UniqueName: \"kubernetes.io/projected/85075432-2c5e-42ef-91a2-7e90aa4eefa8-kube-api-access-87x5f\") pod \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\" (UID: \"85075432-2c5e-42ef-91a2-7e90aa4eefa8\") "
Jul 15 22:17:48.658019 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657790    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-service-ca" (OuterVolumeSpecName: "service-ca") pod "85075432-2c5e-42ef-91a2-7e90aa4eefa8" (UID: "85075432-2c5e-42ef-91a2-7e90aa4eefa8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:17:48.658019 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "85075432-2c5e-42ef-91a2-7e90aa4eefa8" (UID: "85075432-2c5e-42ef-91a2-7e90aa4eefa8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:17:48.658019 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.657848    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-config" (OuterVolumeSpecName: "console-config") pod "85075432-2c5e-42ef-91a2-7e90aa4eefa8" (UID: "85075432-2c5e-42ef-91a2-7e90aa4eefa8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:17:48.659828 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.659801    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "85075432-2c5e-42ef-91a2-7e90aa4eefa8" (UID: "85075432-2c5e-42ef-91a2-7e90aa4eefa8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:17:48.659922 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.659844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "85075432-2c5e-42ef-91a2-7e90aa4eefa8" (UID: "85075432-2c5e-42ef-91a2-7e90aa4eefa8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:17:48.659922 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.659844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85075432-2c5e-42ef-91a2-7e90aa4eefa8-kube-api-access-87x5f" (OuterVolumeSpecName: "kube-api-access-87x5f") pod "85075432-2c5e-42ef-91a2-7e90aa4eefa8" (UID: "85075432-2c5e-42ef-91a2-7e90aa4eefa8"). InnerVolumeSpecName "kube-api-access-87x5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:17:48.758356 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.758306    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-oauth-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.758356 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.758351    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.758356 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.758364    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87x5f\" (UniqueName: \"kubernetes.io/projected/85075432-2c5e-42ef-91a2-7e90aa4eefa8-kube-api-access-87x5f\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.758594 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.758377    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.758594 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.758388    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85075432-2c5e-42ef-91a2-7e90aa4eefa8-console-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.758594 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.758399    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85075432-2c5e-42ef-91a2-7e90aa4eefa8-oauth-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:17:48.763975 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.763949    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"
Jul 15 22:17:48.764134 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.763949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b7cbcd9dc-q9fjn" event={"ID":"8a3e9871-ba4e-4211-9494-3577d232e955","Type":"ContainerDied","Data":"9b7e3cd40dc559bb33e5fbfd511c5b6a204db8145021686a48ee5b50b5c79161"}
Jul 15 22:17:48.764134 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.764092    2580 scope.go:117] "RemoveContainer" containerID="eda4e0e542ff299a39142a15fad08f5d7c33a6bcbc0539631b9bc085755daafe"
Jul 15 22:17:48.765464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.765290    2580 generic.go:356] "Generic (PLEG): container finished" podID="85075432-2c5e-42ef-91a2-7e90aa4eefa8" containerID="9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318" exitCode=0
Jul 15 22:17:48.765464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.765344    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b77655447-xg5zx"
Jul 15 22:17:48.765464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.765372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b77655447-xg5zx" event={"ID":"85075432-2c5e-42ef-91a2-7e90aa4eefa8","Type":"ContainerDied","Data":"9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318"}
Jul 15 22:17:48.765464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.765414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b77655447-xg5zx" event={"ID":"85075432-2c5e-42ef-91a2-7e90aa4eefa8","Type":"ContainerDied","Data":"cf9bdd896da83d430fb854dd682e3b3d0a6b44e641d19704be8b37123646ae73"}
Jul 15 22:17:48.773793 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.773776    2580 scope.go:117] "RemoveContainer" containerID="9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318"
Jul 15 22:17:48.781464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.781441    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"]
Jul 15 22:17:48.782636 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.782620    2580 scope.go:117] "RemoveContainer" containerID="9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318"
Jul 15 22:17:48.782908 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:17:48.782883    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318\": container with ID starting with 9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318 not found: ID does not exist" containerID="9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318"
Jul 15 22:17:48.782969 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.782922    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318"} err="failed to get container status \"9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318\": rpc error: code = NotFound desc = could not find container \"9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318\": container with ID starting with 9e73970a4b262c62d0f4d9664227b403988ce4ff3c5618fe8fe948deb65c6318 not found: ID does not exist"
Jul 15 22:17:48.785056 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.785035    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b7cbcd9dc-q9fjn"]
Jul 15 22:17:48.800339 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.800279    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b77655447-xg5zx"]
Jul 15 22:17:48.803917 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:48.803898    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b77655447-xg5zx"]
Jul 15 22:17:50.009578 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:50.009548    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85075432-2c5e-42ef-91a2-7e90aa4eefa8" path="/var/lib/kubelet/pods/85075432-2c5e-42ef-91a2-7e90aa4eefa8/volumes"
Jul 15 22:17:50.010102 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:50.009957    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3e9871-ba4e-4211-9494-3577d232e955" path="/var/lib/kubelet/pods/8a3e9871-ba4e-4211-9494-3577d232e955/volumes"
Jul 15 22:17:53.792629 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:53.792593    2580 generic.go:356] "Generic (PLEG): container finished" podID="5daaeacb-b48c-4719-869a-50ab1d541658" containerID="3e7ed2d690f1b1c3e4e5f1b87b42893e1863759c771b768d1b02809e0bd5599b" exitCode=0
Jul 15 22:17:53.792629 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:53.792622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp" event={"ID":"5daaeacb-b48c-4719-869a-50ab1d541658","Type":"ContainerDied","Data":"3e7ed2d690f1b1c3e4e5f1b87b42893e1863759c771b768d1b02809e0bd5599b"}
Jul 15 22:17:53.793144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:53.792976    2580 scope.go:117] "RemoveContainer" containerID="3e7ed2d690f1b1c3e4e5f1b87b42893e1863759c771b768d1b02809e0bd5599b"
Jul 15 22:17:54.799069 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:17:54.799035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-d8nsp" event={"ID":"5daaeacb-b48c-4719-869a-50ab1d541658","Type":"ContainerStarted","Data":"748c6e4f1e86f49b8ab84c8e7b17311c5b095611cd1bd30d9dbf396b415c3a9e"}
Jul 15 22:18:58.055974 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:18:58.055941    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5474877dd4-4pcr7"]
Jul 15 22:19:23.078021 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.077950    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5474877dd4-4pcr7" podUID="18a26036-21db-4fc4-a51c-5ee3e829bbb2" containerName="console" containerID="cri-o://8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8" gracePeriod=15
Jul 15 22:19:23.335787 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.335726    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:19:23.354573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.354538    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-oauth-config\") pod \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") "
Jul 15 22:19:23.354573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.354578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-config\") pod \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") "
Jul 15 22:19:23.354807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.354603    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-oauth-serving-cert\") pod \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") "
Jul 15 22:19:23.354807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.354623    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-trusted-ca-bundle\") pod \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") "
Jul 15 22:19:23.354807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.354641    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-serving-cert\") pod \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") "
Jul 15 22:19:23.354807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.354660    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmvk2\" (UniqueName: \"kubernetes.io/projected/18a26036-21db-4fc4-a51c-5ee3e829bbb2-kube-api-access-bmvk2\") pod \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") "
Jul 15 22:19:23.354807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.354689    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-service-ca\") pod \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\" (UID: \"18a26036-21db-4fc4-a51c-5ee3e829bbb2\") "
Jul 15 22:19:23.355104 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.355066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-config" (OuterVolumeSpecName: "console-config") pod "18a26036-21db-4fc4-a51c-5ee3e829bbb2" (UID: "18a26036-21db-4fc4-a51c-5ee3e829bbb2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:19:23.355253 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.355076    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18a26036-21db-4fc4-a51c-5ee3e829bbb2" (UID: "18a26036-21db-4fc4-a51c-5ee3e829bbb2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:19:23.355253 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.355204    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-service-ca" (OuterVolumeSpecName: "service-ca") pod "18a26036-21db-4fc4-a51c-5ee3e829bbb2" (UID: "18a26036-21db-4fc4-a51c-5ee3e829bbb2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:19:23.355378 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.355234    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18a26036-21db-4fc4-a51c-5ee3e829bbb2" (UID: "18a26036-21db-4fc4-a51c-5ee3e829bbb2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:19:23.357236 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.357211    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a26036-21db-4fc4-a51c-5ee3e829bbb2-kube-api-access-bmvk2" (OuterVolumeSpecName: "kube-api-access-bmvk2") pod "18a26036-21db-4fc4-a51c-5ee3e829bbb2" (UID: "18a26036-21db-4fc4-a51c-5ee3e829bbb2"). InnerVolumeSpecName "kube-api-access-bmvk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:19:23.357362 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.357215    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18a26036-21db-4fc4-a51c-5ee3e829bbb2" (UID: "18a26036-21db-4fc4-a51c-5ee3e829bbb2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:19:23.357362 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.357262    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18a26036-21db-4fc4-a51c-5ee3e829bbb2" (UID: "18a26036-21db-4fc4-a51c-5ee3e829bbb2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:19:23.455787 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.455747    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:19:23.455787 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.455779    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-oauth-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:19:23.455787 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.455791    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-config\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:19:23.455787 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.455800    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-oauth-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:19:23.456052 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.455808    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a26036-21db-4fc4-a51c-5ee3e829bbb2-trusted-ca-bundle\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:19:23.456052 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.455817    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a26036-21db-4fc4-a51c-5ee3e829bbb2-console-serving-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:19:23.456052 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:23.455825    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmvk2\" (UniqueName: \"kubernetes.io/projected/18a26036-21db-4fc4-a51c-5ee3e829bbb2-kube-api-access-bmvk2\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:19:24.155042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.155009    2580 generic.go:356] "Generic (PLEG): container finished" podID="18a26036-21db-4fc4-a51c-5ee3e829bbb2" containerID="8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8" exitCode=0
Jul 15 22:19:24.155500 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.155051    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5474877dd4-4pcr7"
Jul 15 22:19:24.155500 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.155056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5474877dd4-4pcr7" event={"ID":"18a26036-21db-4fc4-a51c-5ee3e829bbb2","Type":"ContainerDied","Data":"8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8"}
Jul 15 22:19:24.155500 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.155185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5474877dd4-4pcr7" event={"ID":"18a26036-21db-4fc4-a51c-5ee3e829bbb2","Type":"ContainerDied","Data":"99a837251e97144135a11160b15fdbbf19a89762323235f50b9c9557bab774af"}
Jul 15 22:19:24.155500 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.155212    2580 scope.go:117] "RemoveContainer" containerID="8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8"
Jul 15 22:19:24.163832 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.163819    2580 scope.go:117] "RemoveContainer" containerID="8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8"
Jul 15 22:19:24.164091 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:19:24.164074    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8\": container with ID starting with 8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8 not found: ID does not exist" containerID="8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8"
Jul 15 22:19:24.164133 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.164101    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8"} err="failed to get container status \"8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8\": rpc error: code = NotFound desc = could not find container \"8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8\": container with ID starting with 8498c06eb2f38f9a88c37078383202aed939b82e4d0ca5760c3fd1b4ec556cd8 not found: ID does not exist"
Jul 15 22:19:24.173156 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.173129    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5474877dd4-4pcr7"]
Jul 15 22:19:24.179100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:24.179076    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5474877dd4-4pcr7"]
Jul 15 22:19:26.009170 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:19:26.009136    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a26036-21db-4fc4-a51c-5ee3e829bbb2" path="/var/lib/kubelet/pods/18a26036-21db-4fc4-a51c-5ee3e829bbb2/volumes"
Jul 15 22:20:43.906890 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:20:43.906861    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:20:43.910291 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:20:43.910255    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:20:43.912971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:20:43.912948    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:20:43.917280 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:20:43.917212    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:20:43.923440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:20:43.923401    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 22:21:14.719357 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719324    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"]
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719627    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3e9871-ba4e-4211-9494-3577d232e955" containerName="registry"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719637    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3e9871-ba4e-4211-9494-3577d232e955" containerName="registry"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719658    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a26036-21db-4fc4-a51c-5ee3e829bbb2" containerName="console"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719663    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a26036-21db-4fc4-a51c-5ee3e829bbb2" containerName="console"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719672    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85075432-2c5e-42ef-91a2-7e90aa4eefa8" containerName="console"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719678    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="85075432-2c5e-42ef-91a2-7e90aa4eefa8" containerName="console"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719722    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3e9871-ba4e-4211-9494-3577d232e955" containerName="registry"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719732    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a26036-21db-4fc4-a51c-5ee3e829bbb2" containerName="console"
Jul 15 22:21:14.721755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.719738    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="85075432-2c5e-42ef-91a2-7e90aa4eefa8" containerName="console"
Jul 15 22:21:14.722651 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.722634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.737091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.737072    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 22:21:14.737311 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.737292    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 22:21:14.737808 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.737786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5pwh8\""
Jul 15 22:21:14.737894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.737863    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 22:21:14.737956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.737936    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 22:21:14.796076 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.796046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"]
Jul 15 22:21:14.807552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.807521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee92d8b5-1402-4c55-8375-84c08b802694-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.807709 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.807575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee92d8b5-1402-4c55-8375-84c08b802694-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.807709 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.807594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4g8m\" (UniqueName: \"kubernetes.io/projected/ee92d8b5-1402-4c55-8375-84c08b802694-kube-api-access-l4g8m\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.807709 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.807675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee92d8b5-1402-4c55-8375-84c08b802694-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.807849 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.807710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee92d8b5-1402-4c55-8375-84c08b802694-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.908234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.908196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee92d8b5-1402-4c55-8375-84c08b802694-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.908234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.908235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee92d8b5-1402-4c55-8375-84c08b802694-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.908523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.908295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee92d8b5-1402-4c55-8375-84c08b802694-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.908523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.908339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee92d8b5-1402-4c55-8375-84c08b802694-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.908523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.908355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4g8m\" (UniqueName: \"kubernetes.io/projected/ee92d8b5-1402-4c55-8375-84c08b802694-kube-api-access-l4g8m\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.908720 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.908694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee92d8b5-1402-4c55-8375-84c08b802694-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.910485 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.910456    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee92d8b5-1402-4c55-8375-84c08b802694-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.910751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.910733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee92d8b5-1402-4c55-8375-84c08b802694-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.910810 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.910763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee92d8b5-1402-4c55-8375-84c08b802694-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:14.928743 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:14.928718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4g8m\" (UniqueName: \"kubernetes.io/projected/ee92d8b5-1402-4c55-8375-84c08b802694-kube-api-access-l4g8m\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-th7tx\" (UID: \"ee92d8b5-1402-4c55-8375-84c08b802694\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:15.032226 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:15.032131    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:15.206730 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:15.206694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"]
Jul 15 22:21:15.207134 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:21:15.207107    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee92d8b5_1402_4c55_8375_84c08b802694.slice/crio-be3ed35a26e16f220c75ee017d887d898cf2c04be4a32ae53c743c4ffde5d6a3 WatchSource:0}: Error finding container be3ed35a26e16f220c75ee017d887d898cf2c04be4a32ae53c743c4ffde5d6a3: Status 404 returned error can't find the container with id be3ed35a26e16f220c75ee017d887d898cf2c04be4a32ae53c743c4ffde5d6a3
Jul 15 22:21:15.208898 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:15.208882    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:21:15.601320 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:15.601282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx" event={"ID":"ee92d8b5-1402-4c55-8375-84c08b802694","Type":"ContainerStarted","Data":"be3ed35a26e16f220c75ee017d887d898cf2c04be4a32ae53c743c4ffde5d6a3"}
Jul 15 22:21:18.622985 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:18.622894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx" event={"ID":"ee92d8b5-1402-4c55-8375-84c08b802694","Type":"ContainerStarted","Data":"fdbad1ea1c7282f854560c40bb7c736f1280b146ebc476a36f0e02db09df52f0"}
Jul 15 22:21:19.629213 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:19.629114    2580 generic.go:356] "Generic (PLEG): container finished" podID="ee92d8b5-1402-4c55-8375-84c08b802694" containerID="fdbad1ea1c7282f854560c40bb7c736f1280b146ebc476a36f0e02db09df52f0" exitCode=0
Jul 15 22:21:19.629213 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:19.629196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx" event={"ID":"ee92d8b5-1402-4c55-8375-84c08b802694","Type":"ContainerDied","Data":"fdbad1ea1c7282f854560c40bb7c736f1280b146ebc476a36f0e02db09df52f0"}
Jul 15 22:21:20.634749 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:20.634711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx" event={"ID":"ee92d8b5-1402-4c55-8375-84c08b802694","Type":"ContainerStarted","Data":"60d8213a479c532f88cd4266fa90efa38e6cdea5d47bf99a57c28bcabebad0de"}
Jul 15 22:21:20.635230 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:20.634841    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:20.666860 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:20.666779    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx" podStartSLOduration=2.228216706 podStartE2EDuration="6.666762957s" totalImagesPullingTime="3.351752576s" totalInitContainerRuntime="1.086793675s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:20.665622425 +0000 UTC m=+337.190645657" watchObservedRunningTime="2026-07-15 22:21:20.666762957 +0000 UTC m=+337.191786177"
Jul 15 22:21:31.641871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:31.641833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-th7tx"
Jul 15 22:21:45.127983 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.127902    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"]
Jul 15 22:21:45.132741 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.132721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.138083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.138061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 22:21:45.139090 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.139070    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:21:45.139175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.139109    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c4vsg\""
Jul 15 22:21:45.139264 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.139224    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 22:21:45.139264 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.139227    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 22:21:45.139376 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.139282    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 22:21:45.155962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.155939    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"]
Jul 15 22:21:45.266742 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.266702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-manager-config\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.266977 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.266753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56fst\" (UniqueName: \"kubernetes.io/projected/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-kube-api-access-56fst\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.266977 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.266798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-metrics-cert\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.266977 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.266867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-cert\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.367805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.367743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-manager-config\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.367805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.367803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56fst\" (UniqueName: \"kubernetes.io/projected/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-kube-api-access-56fst\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.368080 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.367832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-metrics-cert\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.368080 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.367865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-cert\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.368599 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.368572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-manager-config\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.370370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.370333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-metrics-cert\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.370474 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.370387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-cert\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.392699 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.392642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56fst\" (UniqueName: \"kubernetes.io/projected/2b2fc501-24e0-4e1b-be4e-1c38510ad00c-kube-api-access-56fst\") pod \"lws-controller-manager-79bbf4474c-qhpcz\" (UID: \"2b2fc501-24e0-4e1b-be4e-1c38510ad00c\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.441710 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.441676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:45.587878 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.587840    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"]
Jul 15 22:21:45.599105 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:21:45.599078    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2fc501_24e0_4e1b_be4e_1c38510ad00c.slice/crio-bc450e35a7e7cb20fc4c81bedf4503b2a239b1771c5eb1ca0d78f329e848b9a3 WatchSource:0}: Error finding container bc450e35a7e7cb20fc4c81bedf4503b2a239b1771c5eb1ca0d78f329e848b9a3: Status 404 returned error can't find the container with id bc450e35a7e7cb20fc4c81bedf4503b2a239b1771c5eb1ca0d78f329e848b9a3
Jul 15 22:21:45.741901 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:45.741868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz" event={"ID":"2b2fc501-24e0-4e1b-be4e-1c38510ad00c","Type":"ContainerStarted","Data":"bc450e35a7e7cb20fc4c81bedf4503b2a239b1771c5eb1ca0d78f329e848b9a3"}
Jul 15 22:21:48.758956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:48.758921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz" event={"ID":"2b2fc501-24e0-4e1b-be4e-1c38510ad00c","Type":"ContainerStarted","Data":"b3a0db398c874514c0f06d5502a37735571de62dd8d2b3a2e362a981efa2c399"}
Jul 15 22:21:48.759357 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:48.759035    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:21:48.900118 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:48.900067    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz" podStartSLOduration=1.3971861030000001 podStartE2EDuration="3.900050939s" totalImagesPullingTime="2.502864836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:48.889516 +0000 UTC m=+365.414539255" watchObservedRunningTime="2026-07-15 22:21:48.900050939 +0000 UTC m=+365.425074227"
Jul 15 22:21:51.189927 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.189900    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"]
Jul 15 22:21:51.193197 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.193181    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.198844 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.198821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 22:21:51.198979 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.198856    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7l4rd\""
Jul 15 22:21:51.276630 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.276602    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"]
Jul 15 22:21:51.320460 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47744ca9-46ac-4736-be26-2ebca465df04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320608 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320608 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt2vh\" (UniqueName: \"kubernetes.io/projected/47744ca9-46ac-4736-be26-2ebca465df04-kube-api-access-kt2vh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320608 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47744ca9-46ac-4736-be26-2ebca465df04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320608 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47744ca9-46ac-4736-be26-2ebca465df04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320750 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320750 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320750 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.320863 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.320790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.421817 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.421789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.421829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47744ca9-46ac-4736-be26-2ebca465df04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.421851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.421875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt2vh\" (UniqueName: \"kubernetes.io/projected/47744ca9-46ac-4736-be26-2ebca465df04-kube-api-access-kt2vh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.421901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47744ca9-46ac-4736-be26-2ebca465df04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.421917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47744ca9-46ac-4736-be26-2ebca465df04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.421968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.422006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422398 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.422037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422398 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.422362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422519 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.422423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422652 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.422630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422783 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.422763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.422971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.422946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47744ca9-46ac-4736-be26-2ebca465df04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.424171 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.424149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47744ca9-46ac-4736-be26-2ebca465df04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.424595 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.424571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47744ca9-46ac-4736-be26-2ebca465df04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.439212 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.439186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47744ca9-46ac-4736-be26-2ebca465df04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.441138 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.441086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt2vh\" (UniqueName: \"kubernetes.io/projected/47744ca9-46ac-4736-be26-2ebca465df04-kube-api-access-kt2vh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gp5hk\" (UID: \"47744ca9-46ac-4736-be26-2ebca465df04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.503802 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.503776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:51.649961 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.649922    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"]
Jul 15 22:21:51.652079 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:21:51.652048    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47744ca9_46ac_4736_be26_2ebca465df04.slice/crio-10bcf116014e180c4474103bbd625c36b848648436bb942201bea53874a5b427 WatchSource:0}: Error finding container 10bcf116014e180c4474103bbd625c36b848648436bb942201bea53874a5b427: Status 404 returned error can't find the container with id 10bcf116014e180c4474103bbd625c36b848648436bb942201bea53874a5b427
Jul 15 22:21:51.775303 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:51.775180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk" event={"ID":"47744ca9-46ac-4736-be26-2ebca465df04","Type":"ContainerStarted","Data":"10bcf116014e180c4474103bbd625c36b848648436bb942201bea53874a5b427"}
Jul 15 22:21:54.420664 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:54.420620    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:21:54.420944 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:54.420702    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:21:54.420944 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:54.420733    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:21:54.790977 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:54.790936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk" event={"ID":"47744ca9-46ac-4736-be26-2ebca465df04","Type":"ContainerStarted","Data":"205ca2fe0f48ebaf5879a7ffc6d089f17227f1283306d5f5df7de541ef0261a8"}
Jul 15 22:21:54.844117 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:54.844061    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk" podStartSLOduration=1.077843925 podStartE2EDuration="3.844044183s" totalImagesPullingTime="2.766200258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:54.841059853 +0000 UTC m=+371.366083086" watchObservedRunningTime="2026-07-15 22:21:54.844044183 +0000 UTC m=+371.369067428"
Jul 15 22:21:55.504342 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:55.504295    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:55.508846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:55.508820    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:55.795750 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:55.795653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:55.796727 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:55.796704    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gp5hk"
Jul 15 22:21:59.766705 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:21:59.766672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-qhpcz"
Jul 15 22:23:12.972173 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:12.972087    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"]
Jul 15 22:23:12.975431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:12.975413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"
Jul 15 22:23:12.980535 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:12.980508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zmvkx\""
Jul 15 22:23:12.980681 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:12.980519    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 22:23:12.980907 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:12.980889    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 22:23:12.983647 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:12.983627    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 22:23:12.985011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:12.984992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wsnn\" (UniqueName: \"kubernetes.io/projected/eff03430-f9ce-41df-9771-b152f30b251a-kube-api-access-4wsnn\") pod \"dns-operator-controller-manager-864dd78c4c-5h2t6\" (UID: \"eff03430-f9ce-41df-9771-b152f30b251a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"
Jul 15 22:23:13.001650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:13.001629    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"]
Jul 15 22:23:13.086256 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:13.086223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wsnn\" (UniqueName: \"kubernetes.io/projected/eff03430-f9ce-41df-9771-b152f30b251a-kube-api-access-4wsnn\") pod \"dns-operator-controller-manager-864dd78c4c-5h2t6\" (UID: \"eff03430-f9ce-41df-9771-b152f30b251a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"
Jul 15 22:23:13.117987 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:13.117956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wsnn\" (UniqueName: \"kubernetes.io/projected/eff03430-f9ce-41df-9771-b152f30b251a-kube-api-access-4wsnn\") pod \"dns-operator-controller-manager-864dd78c4c-5h2t6\" (UID: \"eff03430-f9ce-41df-9771-b152f30b251a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"
Jul 15 22:23:13.284904 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:13.284822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"
Jul 15 22:23:13.455390 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:13.455367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"]
Jul 15 22:23:13.457230 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:23:13.457203    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff03430_f9ce_41df_9771_b152f30b251a.slice/crio-1b606f36271d696649e8f310f6bfaac39c0a4f6e9536b87aaf41cdd4c9537bd1 WatchSource:0}: Error finding container 1b606f36271d696649e8f310f6bfaac39c0a4f6e9536b87aaf41cdd4c9537bd1: Status 404 returned error can't find the container with id 1b606f36271d696649e8f310f6bfaac39c0a4f6e9536b87aaf41cdd4c9537bd1
Jul 15 22:23:14.126739 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:14.126703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6" event={"ID":"eff03430-f9ce-41df-9771-b152f30b251a","Type":"ContainerStarted","Data":"1b606f36271d696649e8f310f6bfaac39c0a4f6e9536b87aaf41cdd4c9537bd1"}
Jul 15 22:23:16.143548 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:16.143511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6" event={"ID":"eff03430-f9ce-41df-9771-b152f30b251a","Type":"ContainerStarted","Data":"6b5a3da3d696ccd75ae967b2f6f053ecf73b483d55185de2f76c8de491303c85"}
Jul 15 22:23:16.143923 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:16.143589    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"
Jul 15 22:23:16.164291 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:16.164232    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6" podStartSLOduration=2.190095497 podStartE2EDuration="4.164216108s" totalImagesPullingTime="1.974120611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:16.162323947 +0000 UTC m=+452.687347169" watchObservedRunningTime="2026-07-15 22:23:16.164216108 +0000 UTC m=+452.689239328"
Jul 15 22:23:16.944120 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:16.944077    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"]
Jul 15 22:23:16.947478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:16.947456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:16.951618 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:16.951596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8xls\""
Jul 15 22:23:16.974172 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:16.974150    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"]
Jul 15 22:23:17.019983 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.019955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e63e57c1-8929-4cba-8793-924554895145-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:17.020118 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.020008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjcsn\" (UniqueName: \"kubernetes.io/projected/e63e57c1-8929-4cba-8793-924554895145-kube-api-access-vjcsn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:17.120923 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.120880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjcsn\" (UniqueName: \"kubernetes.io/projected/e63e57c1-8929-4cba-8793-924554895145-kube-api-access-vjcsn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:17.121104 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.120962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e63e57c1-8929-4cba-8793-924554895145-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:17.121352 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.121334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e63e57c1-8929-4cba-8793-924554895145-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:17.141341 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.141308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjcsn\" (UniqueName: \"kubernetes.io/projected/e63e57c1-8929-4cba-8793-924554895145-kube-api-access-vjcsn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:17.258013 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.257932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:17.399330 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:17.399178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"]
Jul 15 22:23:17.402308 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:23:17.402270    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63e57c1_8929_4cba_8793_924554895145.slice/crio-5e4cdf64877fb357d39f64df629aeb43f5fd39d3d16b526aa1684328b3c0699b WatchSource:0}: Error finding container 5e4cdf64877fb357d39f64df629aeb43f5fd39d3d16b526aa1684328b3c0699b: Status 404 returned error can't find the container with id 5e4cdf64877fb357d39f64df629aeb43f5fd39d3d16b526aa1684328b3c0699b
Jul 15 22:23:18.154838 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:18.154807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg" event={"ID":"e63e57c1-8929-4cba-8793-924554895145","Type":"ContainerStarted","Data":"5e4cdf64877fb357d39f64df629aeb43f5fd39d3d16b526aa1684328b3c0699b"}
Jul 15 22:23:24.184912 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:24.184872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg" event={"ID":"e63e57c1-8929-4cba-8793-924554895145","Type":"ContainerStarted","Data":"0ea759511c57efda231f4116a7fcebe6402e6c0fe693a391905ca600cc3bf8b8"}
Jul 15 22:23:24.185321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:24.185026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:24.211199 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:24.211149    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg" podStartSLOduration=2.267688751 podStartE2EDuration="8.211113402s" totalImagesPullingTime="5.943424651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:24.209961806 +0000 UTC m=+460.734985025" watchObservedRunningTime="2026-07-15 22:23:24.211113402 +0000 UTC m=+460.736136621"
Jul 15 22:23:27.150523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:27.150494    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5h2t6"
Jul 15 22:23:35.192054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:35.192023    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:36.502367 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.502328    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"]
Jul 15 22:23:36.505873 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.505852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.523128 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.523102    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"]
Jul 15 22:23:36.593793 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.593768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.593938 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.593834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmrjm\" (UniqueName: \"kubernetes.io/projected/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-kube-api-access-kmrjm\") pod \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.694775 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.694736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.694932 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.694809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmrjm\" (UniqueName: \"kubernetes.io/projected/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-kube-api-access-kmrjm\") pod \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.695203 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.695181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.711303 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.711280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmrjm\" (UniqueName: \"kubernetes.io/projected/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-kube-api-access-kmrjm\") pod \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.816164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.816071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:36.976427 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.976386    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"]
Jul 15 22:23:36.980856 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:23:36.980826    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1daf9303_ed17_4bff_a4f5_e14f5156d8e5.slice/crio-b857f8f89331a74a1a53ae31f812e9db110c4f15f0db83710a87eebc5a5855cf WatchSource:0}: Error finding container b857f8f89331a74a1a53ae31f812e9db110c4f15f0db83710a87eebc5a5855cf: Status 404 returned error can't find the container with id b857f8f89331a74a1a53ae31f812e9db110c4f15f0db83710a87eebc5a5855cf
Jul 15 22:23:36.991099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.991076    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"]
Jul 15 22:23:36.994827 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:36.994807    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"]
Jul 15 22:23:37.035178 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.035154    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"]
Jul 15 22:23:37.039616 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.039594    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"]
Jul 15 22:23:37.039718 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.039694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.039789 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.039769    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg" podUID="e63e57c1-8929-4cba-8793-924554895145" containerName="manager" containerID="cri-o://0ea759511c57efda231f4116a7fcebe6402e6c0fe693a391905ca600cc3bf8b8" gracePeriod=2
Jul 15 22:23:37.060723 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.060695    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"]
Jul 15 22:23:37.062153 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.062128    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"]
Jul 15 22:23:37.098861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.098792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzg5\" (UniqueName: \"kubernetes.io/projected/023dc787-a208-4601-bf53-b1756f934092-kube-api-access-ckzg5\") pod \"kuadrant-operator-controller-manager-55467d9f7-tcfgc\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.098861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.098831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023dc787-a208-4601-bf53-b1756f934092-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tcfgc\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.113825 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.113793    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="e63e57c1-8929-4cba-8793-924554895145" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:37.119460 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.119431    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="e63e57c1-8929-4cba-8793-924554895145" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:37.199955 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.199904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzg5\" (UniqueName: \"kubernetes.io/projected/023dc787-a208-4601-bf53-b1756f934092-kube-api-access-ckzg5\") pod \"kuadrant-operator-controller-manager-55467d9f7-tcfgc\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.199955 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.199954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023dc787-a208-4601-bf53-b1756f934092-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tcfgc\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.200359 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.200338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023dc787-a208-4601-bf53-b1756f934092-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tcfgc\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.215202 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.215169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzg5\" (UniqueName: \"kubernetes.io/projected/023dc787-a208-4601-bf53-b1756f934092-kube-api-access-ckzg5\") pod \"kuadrant-operator-controller-manager-55467d9f7-tcfgc\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.243057 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.243025    2580 generic.go:356] "Generic (PLEG): container finished" podID="e63e57c1-8929-4cba-8793-924554895145" containerID="0ea759511c57efda231f4116a7fcebe6402e6c0fe693a391905ca600cc3bf8b8" exitCode=0
Jul 15 22:23:37.244875 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.244829    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" containerName="manager" containerID="cri-o://1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af" gracePeriod=2
Jul 15 22:23:37.250001 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.249973    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:37.253092 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.253069    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="e63e57c1-8929-4cba-8793-924554895145" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:37.351990 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.351932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:37.356369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.356348    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:37.358874 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.358844    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:37.360874 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.360850    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="e63e57c1-8929-4cba-8793-924554895145" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:37.485967 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.485941    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:37.488488 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.488463    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wltzg\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="e63e57c1-8929-4cba-8793-924554895145" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:37.490766 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:37.490745    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:37.500533 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.500510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"]
Jul 15 22:23:37.502832 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.502811    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e63e57c1-8929-4cba-8793-924554895145-extensions-socket-volume\") pod \"e63e57c1-8929-4cba-8793-924554895145\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") "
Jul 15 22:23:37.503123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.502847    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjcsn\" (UniqueName: \"kubernetes.io/projected/e63e57c1-8929-4cba-8793-924554895145-kube-api-access-vjcsn\") pod \"e63e57c1-8929-4cba-8793-924554895145\" (UID: \"e63e57c1-8929-4cba-8793-924554895145\") "
Jul 15 22:23:37.503423 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.503391    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63e57c1-8929-4cba-8793-924554895145-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e63e57c1-8929-4cba-8793-924554895145" (UID: "e63e57c1-8929-4cba-8793-924554895145"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:23:37.503514 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:23:37.503425    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023dc787_a208_4601_bf53_b1756f934092.slice/crio-0af3b6ed5a4a2bac69234679deb0949912842a84c9caf42be0a3430748fa7987 WatchSource:0}: Error finding container 0af3b6ed5a4a2bac69234679deb0949912842a84c9caf42be0a3430748fa7987: Status 404 returned error can't find the container with id 0af3b6ed5a4a2bac69234679deb0949912842a84c9caf42be0a3430748fa7987
Jul 15 22:23:37.505158 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.505134    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63e57c1-8929-4cba-8793-924554895145-kube-api-access-vjcsn" (OuterVolumeSpecName: "kube-api-access-vjcsn") pod "e63e57c1-8929-4cba-8793-924554895145" (UID: "e63e57c1-8929-4cba-8793-924554895145"). InnerVolumeSpecName "kube-api-access-vjcsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:23:37.603905 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.603829    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmrjm\" (UniqueName: \"kubernetes.io/projected/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-kube-api-access-kmrjm\") pod \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") "
Jul 15 22:23:37.604043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.603924    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-extensions-socket-volume\") pod \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\" (UID: \"1daf9303-ed17-4bff-a4f5-e14f5156d8e5\") "
Jul 15 22:23:37.604188 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.604172    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e63e57c1-8929-4cba-8793-924554895145-extensions-socket-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:23:37.604260 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.604175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1daf9303-ed17-4bff-a4f5-e14f5156d8e5" (UID: "1daf9303-ed17-4bff-a4f5-e14f5156d8e5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:23:37.604260 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.604194    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjcsn\" (UniqueName: \"kubernetes.io/projected/e63e57c1-8929-4cba-8793-924554895145-kube-api-access-vjcsn\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:23:37.605817 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.605796    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-kube-api-access-kmrjm" (OuterVolumeSpecName: "kube-api-access-kmrjm") pod "1daf9303-ed17-4bff-a4f5-e14f5156d8e5" (UID: "1daf9303-ed17-4bff-a4f5-e14f5156d8e5"). InnerVolumeSpecName "kube-api-access-kmrjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:23:37.705602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.705561    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-extensions-socket-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:23:37.705602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:37.705594    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmrjm\" (UniqueName: \"kubernetes.io/projected/1daf9303-ed17-4bff-a4f5-e14f5156d8e5-kube-api-access-kmrjm\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:23:38.009729 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.009695    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" path="/var/lib/kubelet/pods/1daf9303-ed17-4bff-a4f5-e14f5156d8e5/volumes"
Jul 15 22:23:38.010040 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.010027    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e63e57c1-8929-4cba-8793-924554895145" path="/var/lib/kubelet/pods/e63e57c1-8929-4cba-8793-924554895145/volumes"
Jul 15 22:23:38.250507 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.250473    2580 generic.go:356] "Generic (PLEG): container finished" podID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" containerID="1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af" exitCode=2
Jul 15 22:23:38.250682 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.250521    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:38.250682 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.250572    2580 scope.go:117] "RemoveContainer" containerID="1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af"
Jul 15 22:23:38.252482 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.252453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc" event={"ID":"023dc787-a208-4601-bf53-b1756f934092","Type":"ContainerStarted","Data":"3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f"}
Jul 15 22:23:38.252609 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.252539    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:38.252609 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.252570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc" event={"ID":"023dc787-a208-4601-bf53-b1756f934092","Type":"ContainerStarted","Data":"0af3b6ed5a4a2bac69234679deb0949912842a84c9caf42be0a3430748fa7987"}
Jul 15 22:23:38.254186 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.254168    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wltzg"
Jul 15 22:23:38.260208 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.260187    2580 scope.go:117] "RemoveContainer" containerID="1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af"
Jul 15 22:23:38.260496 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:38.260479    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af\": container with ID starting with 1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af not found: ID does not exist" containerID="1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af"
Jul 15 22:23:38.260569 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.260508    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af"} err="failed to get container status \"1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af\": rpc error: code = NotFound desc = could not find container \"1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af\": container with ID starting with 1dbe78e39db0b73c5947b570733fc36d1cfcb40e4ba1bc333542156db257a6af not found: ID does not exist"
Jul 15 22:23:38.260569 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.260533    2580 scope.go:117] "RemoveContainer" containerID="0ea759511c57efda231f4116a7fcebe6402e6c0fe693a391905ca600cc3bf8b8"
Jul 15 22:23:38.280476 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:38.280433    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc" podStartSLOduration=1.280414532 podStartE2EDuration="1.280414532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:38.278998312 +0000 UTC m=+474.804021561" watchObservedRunningTime="2026-07-15 22:23:38.280414532 +0000 UTC m=+474.805437752"
Jul 15 22:23:38.282014 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:23:38.281987    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zh9lp\" is forbidden: User \"system:node:ip-10-0-136-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-3.ec2.internal' and this object" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zh9lp"
Jul 15 22:23:49.263372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:49.263343    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:23:54.607619 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.607579    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c48796c77-4b8wk"]
Jul 15 22:23:54.607992 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.607937    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" containerName="manager"
Jul 15 22:23:54.607992 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.607952    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" containerName="manager"
Jul 15 22:23:54.607992 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.607972    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63e57c1-8929-4cba-8793-924554895145" containerName="manager"
Jul 15 22:23:54.607992 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.607977    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63e57c1-8929-4cba-8793-924554895145" containerName="manager"
Jul 15 22:23:54.608138 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.608034    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63e57c1-8929-4cba-8793-924554895145" containerName="manager"
Jul 15 22:23:54.608138 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.608044    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1daf9303-ed17-4bff-a4f5-e14f5156d8e5" containerName="manager"
Jul 15 22:23:54.621274 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.618357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.622394 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.622367    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 22:23:54.622563 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.622536    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 22:23:54.622715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.622503    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2b7m5\""
Jul 15 22:23:54.622803 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.622760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c48796c77-4b8wk"]
Jul 15 22:23:54.624350 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.623803    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 22:23:54.624350 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.624019    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 22:23:54.624350 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.624134    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 22:23:54.627925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.627904    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 22:23:54.646503 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.646476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-config\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.646650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.646516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-service-ca\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.646650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.646534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-oauth-serving-cert\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.646650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.646615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-trusted-ca-bundle\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.646776 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.646663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-oauth-config\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.646776 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.646706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-serving-cert\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.646776 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.646724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7px\" (UniqueName: \"kubernetes.io/projected/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-kube-api-access-nb7px\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.747786 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.747748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-config\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.747786 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.747798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-service-ca\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.747814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-oauth-serving-cert\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.747852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-trusted-ca-bundle\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.747889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-oauth-config\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.747927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-serving-cert\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.747954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7px\" (UniqueName: \"kubernetes.io/projected/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-kube-api-access-nb7px\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748686 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.748659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-config\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748686 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.748671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-service-ca\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.748700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-oauth-serving-cert\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.748861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.748787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-trusted-ca-bundle\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.750538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.750516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-oauth-config\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.750623 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.750577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-console-serving-cert\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.756142 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.756118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7px\" (UniqueName: \"kubernetes.io/projected/0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70-kube-api-access-nb7px\") pod \"console-5c48796c77-4b8wk\" (UID: \"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70\") " pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:54.930862 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:54.930821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:23:55.076236 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:55.076210    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c48796c77-4b8wk"]
Jul 15 22:23:55.079028 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:23:55.078999    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5192c2_a5ae_4e9d_9f0c_46ac5b63ad70.slice/crio-1e79058e95324671064cd2c51f7a206247ba1b708edccd00c08af442fdf1edec WatchSource:0}: Error finding container 1e79058e95324671064cd2c51f7a206247ba1b708edccd00c08af442fdf1edec: Status 404 returned error can't find the container with id 1e79058e95324671064cd2c51f7a206247ba1b708edccd00c08af442fdf1edec
Jul 15 22:23:55.341733 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:55.341640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c48796c77-4b8wk" event={"ID":"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70","Type":"ContainerStarted","Data":"02b363493d3698b527b96df7a30bd11418a5b7ae580687c16d540105a9f87425"}
Jul 15 22:23:55.341733 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:55.341698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c48796c77-4b8wk" event={"ID":"0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70","Type":"ContainerStarted","Data":"1e79058e95324671064cd2c51f7a206247ba1b708edccd00c08af442fdf1edec"}
Jul 15 22:23:55.362261 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:23:55.362196    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c48796c77-4b8wk" podStartSLOduration=1.362180271 podStartE2EDuration="1.362180271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:55.361072742 +0000 UTC m=+491.886095974" watchObservedRunningTime="2026-07-15 22:23:55.362180271 +0000 UTC m=+491.887203491"
Jul 15 22:24:04.931965 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:04.931926    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:24:04.932416 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:04.931985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:24:04.936524 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:04.936498    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:24:05.392207 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:05.392120    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c48796c77-4b8wk"
Jul 15 22:24:05.963037 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:05.962999    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"]
Jul 15 22:24:05.966393 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:05.966362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:05.969123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:05.969095    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cn47g\""
Jul 15 22:24:05.982852 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:05.982817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"]
Jul 15 22:24:06.050643 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050612    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8f720c7-b611-4728-aec5-3b32a875566a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.050643 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f720c7-b611-4728-aec5-3b32a875566a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.050871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwpnz\" (UniqueName: \"kubernetes.io/projected/f8f720c7-b611-4728-aec5-3b32a875566a-kube-api-access-bwpnz\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.050871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.050871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.050871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.050871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.050871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.051082 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.050905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f720c7-b611-4728-aec5-3b32a875566a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.151651 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.151604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.151830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.151666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.151830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.151695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.151830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.151735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f720c7-b611-4728-aec5-3b32a875566a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.151830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.151821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8f720c7-b611-4728-aec5-3b32a875566a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.151866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f720c7-b611-4728-aec5-3b32a875566a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152192 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwpnz\" (UniqueName: \"kubernetes.io/projected/f8f720c7-b611-4728-aec5-3b32a875566a-kube-api-access-bwpnz\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152554 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f720c7-b611-4728-aec5-3b32a875566a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.152721 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.152703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.154543 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.154516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f720c7-b611-4728-aec5-3b32a875566a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.154639 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.154522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f720c7-b611-4728-aec5-3b32a875566a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.162489 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.162462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8f720c7-b611-4728-aec5-3b32a875566a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.162679 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.162659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwpnz\" (UniqueName: \"kubernetes.io/projected/f8f720c7-b611-4728-aec5-3b32a875566a-kube-api-access-bwpnz\") pod \"maas-default-gateway-openshift-default-56654dcf7-tqcpv\" (UID: \"f8f720c7-b611-4728-aec5-3b32a875566a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.278237 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.278143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:06.427317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.427292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"]
Jul 15 22:24:06.430088 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:24:06.430053    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f720c7_b611_4728_aec5_3b32a875566a.slice/crio-6c55e0d7ba5c6d10d0c142df8b06fcf8f6888f58c4ba19a65279f4b70ece8820 WatchSource:0}: Error finding container 6c55e0d7ba5c6d10d0c142df8b06fcf8f6888f58c4ba19a65279f4b70ece8820: Status 404 returned error can't find the container with id 6c55e0d7ba5c6d10d0c142df8b06fcf8f6888f58c4ba19a65279f4b70ece8820
Jul 15 22:24:06.432085 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.432049    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:24:06.432200 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.432122    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:24:06.432200 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.432164    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:24:06.544105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.544005    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"]
Jul 15 22:24:06.544317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.544265    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc" podUID="023dc787-a208-4601-bf53-b1756f934092" containerName="manager" containerID="cri-o://3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f" gracePeriod=10
Jul 15 22:24:06.786043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.786019    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:24:06.858842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.858768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023dc787-a208-4601-bf53-b1756f934092-extensions-socket-volume\") pod \"023dc787-a208-4601-bf53-b1756f934092\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") "
Jul 15 22:24:06.858842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.858817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckzg5\" (UniqueName: \"kubernetes.io/projected/023dc787-a208-4601-bf53-b1756f934092-kube-api-access-ckzg5\") pod \"023dc787-a208-4601-bf53-b1756f934092\" (UID: \"023dc787-a208-4601-bf53-b1756f934092\") "
Jul 15 22:24:06.859133 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.859110    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023dc787-a208-4601-bf53-b1756f934092-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "023dc787-a208-4601-bf53-b1756f934092" (UID: "023dc787-a208-4601-bf53-b1756f934092"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:24:06.861012 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.860988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023dc787-a208-4601-bf53-b1756f934092-kube-api-access-ckzg5" (OuterVolumeSpecName: "kube-api-access-ckzg5") pod "023dc787-a208-4601-bf53-b1756f934092" (UID: "023dc787-a208-4601-bf53-b1756f934092"). InnerVolumeSpecName "kube-api-access-ckzg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:24:06.960217 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.960183    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023dc787-a208-4601-bf53-b1756f934092-extensions-socket-volume\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:24:06.960217 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:06.960215    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckzg5\" (UniqueName: \"kubernetes.io/projected/023dc787-a208-4601-bf53-b1756f934092-kube-api-access-ckzg5\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:24:07.399964 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.399924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" event={"ID":"f8f720c7-b611-4728-aec5-3b32a875566a","Type":"ContainerStarted","Data":"4f4b7587a448e9f0309119cdc7ae7edb2162dda73a4d3c9b76bb8e3ed447dc06"}
Jul 15 22:24:07.400429 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.399994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" event={"ID":"f8f720c7-b611-4728-aec5-3b32a875566a","Type":"ContainerStarted","Data":"6c55e0d7ba5c6d10d0c142df8b06fcf8f6888f58c4ba19a65279f4b70ece8820"}
Jul 15 22:24:07.401263 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.401212    2580 generic.go:356] "Generic (PLEG): container finished" podID="023dc787-a208-4601-bf53-b1756f934092" containerID="3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f" exitCode=0
Jul 15 22:24:07.401349 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.401272    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"
Jul 15 22:24:07.401349 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.401299    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc" event={"ID":"023dc787-a208-4601-bf53-b1756f934092","Type":"ContainerDied","Data":"3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f"}
Jul 15 22:24:07.401349 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.401344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc" event={"ID":"023dc787-a208-4601-bf53-b1756f934092","Type":"ContainerDied","Data":"0af3b6ed5a4a2bac69234679deb0949912842a84c9caf42be0a3430748fa7987"}
Jul 15 22:24:07.401445 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.401368    2580 scope.go:117] "RemoveContainer" containerID="3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f"
Jul 15 22:24:07.410634 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.410614    2580 scope.go:117] "RemoveContainer" containerID="3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f"
Jul 15 22:24:07.410908 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:24:07.410888    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f\": container with ID starting with 3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f not found: ID does not exist" containerID="3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f"
Jul 15 22:24:07.410952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.410919    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f"} err="failed to get container status \"3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f\": rpc error: code = NotFound desc = could not find container \"3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f\": container with ID starting with 3d079625790f659b7fb25c8e6a6e5a2e494b19a0cfea43657e45f584caaa1a0f not found: ID does not exist"
Jul 15 22:24:07.448682 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.448636    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" podStartSLOduration=2.4486187839999998 podStartE2EDuration="2.448618784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:24:07.446680235 +0000 UTC m=+503.971703476" watchObservedRunningTime="2026-07-15 22:24:07.448618784 +0000 UTC m=+503.973642004"
Jul 15 22:24:07.472992 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.472961    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"]
Jul 15 22:24:07.478519 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:07.478497    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tcfgc"]
Jul 15 22:24:08.010743 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:08.010707    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023dc787-a208-4601-bf53-b1756f934092" path="/var/lib/kubelet/pods/023dc787-a208-4601-bf53-b1756f934092/volumes"
Jul 15 22:24:08.278607 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:08.278515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:08.283657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:08.283636    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:08.406713 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:08.406685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:08.407642 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:08.407627    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:24:27.455520 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.455483    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"]
Jul 15 22:24:27.456073 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.456049    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023dc787-a208-4601-bf53-b1756f934092" containerName="manager"
Jul 15 22:24:27.456073 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.456075    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="023dc787-a208-4601-bf53-b1756f934092" containerName="manager"
Jul 15 22:24:27.456213 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.456175    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="023dc787-a208-4601-bf53-b1756f934092" containerName="manager"
Jul 15 22:24:27.461367 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.461340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.464769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.464743    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 22:24:27.464871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.464827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-klg4c\""
Jul 15 22:24:27.495804 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.495761    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"]
Jul 15 22:24:27.527390 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.527354    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"]
Jul 15 22:24:27.544859 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.544823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95e42daf-715a-4aae-b3eb-9341962066f6-config-file\") pod \"limitador-limitador-64c94fd64f-tmz2v\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.545031 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.544902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfpnk\" (UniqueName: \"kubernetes.io/projected/95e42daf-715a-4aae-b3eb-9341962066f6-kube-api-access-hfpnk\") pod \"limitador-limitador-64c94fd64f-tmz2v\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.645636 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.645589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfpnk\" (UniqueName: \"kubernetes.io/projected/95e42daf-715a-4aae-b3eb-9341962066f6-kube-api-access-hfpnk\") pod \"limitador-limitador-64c94fd64f-tmz2v\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.645828 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.645685    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95e42daf-715a-4aae-b3eb-9341962066f6-config-file\") pod \"limitador-limitador-64c94fd64f-tmz2v\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.646321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.646303    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95e42daf-715a-4aae-b3eb-9341962066f6-config-file\") pod \"limitador-limitador-64c94fd64f-tmz2v\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.662725 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.662696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfpnk\" (UniqueName: \"kubernetes.io/projected/95e42daf-715a-4aae-b3eb-9341962066f6-kube-api-access-hfpnk\") pod \"limitador-limitador-64c94fd64f-tmz2v\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.771793 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.771689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:27.912269 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:27.912230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"]
Jul 15 22:24:27.914312 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:24:27.914229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e42daf_715a_4aae_b3eb_9341962066f6.slice/crio-66458d20bee1ee7512029bfac67615bc0443e26d49e9cb52619914b2ed64b171 WatchSource:0}: Error finding container 66458d20bee1ee7512029bfac67615bc0443e26d49e9cb52619914b2ed64b171: Status 404 returned error can't find the container with id 66458d20bee1ee7512029bfac67615bc0443e26d49e9cb52619914b2ed64b171
Jul 15 22:24:28.495099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.495062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v" event={"ID":"95e42daf-715a-4aae-b3eb-9341962066f6","Type":"ContainerStarted","Data":"66458d20bee1ee7512029bfac67615bc0443e26d49e9cb52619914b2ed64b171"}
Jul 15 22:24:28.652490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.651839    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5d45"]
Jul 15 22:24:28.655738 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.655713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5d45"
Jul 15 22:24:28.658433 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.658206    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-55grm\""
Jul 15 22:24:28.667601 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.667576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5d45"]
Jul 15 22:24:28.756020 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.755923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp7z9\" (UniqueName: \"kubernetes.io/projected/9186a6e8-fb70-45a4-a14a-d3a6288a2935-kube-api-access-bp7z9\") pod \"authorino-75d556bd77-z5d45\" (UID: \"9186a6e8-fb70-45a4-a14a-d3a6288a2935\") " pod="kuadrant-system/authorino-75d556bd77-z5d45"
Jul 15 22:24:28.857421 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.857287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp7z9\" (UniqueName: \"kubernetes.io/projected/9186a6e8-fb70-45a4-a14a-d3a6288a2935-kube-api-access-bp7z9\") pod \"authorino-75d556bd77-z5d45\" (UID: \"9186a6e8-fb70-45a4-a14a-d3a6288a2935\") " pod="kuadrant-system/authorino-75d556bd77-z5d45"
Jul 15 22:24:28.866814 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.866776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp7z9\" (UniqueName: \"kubernetes.io/projected/9186a6e8-fb70-45a4-a14a-d3a6288a2935-kube-api-access-bp7z9\") pod \"authorino-75d556bd77-z5d45\" (UID: \"9186a6e8-fb70-45a4-a14a-d3a6288a2935\") " pod="kuadrant-system/authorino-75d556bd77-z5d45"
Jul 15 22:24:28.971008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:28.970968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5d45"
Jul 15 22:24:29.131187 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:29.131157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5d45"]
Jul 15 22:24:29.133797 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:24:29.133761    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9186a6e8_fb70_45a4_a14a_d3a6288a2935.slice/crio-57b64d33fe41af6659e059a70b26c186098fb7d9faca13c429ce40fd3114918f WatchSource:0}: Error finding container 57b64d33fe41af6659e059a70b26c186098fb7d9faca13c429ce40fd3114918f: Status 404 returned error can't find the container with id 57b64d33fe41af6659e059a70b26c186098fb7d9faca13c429ce40fd3114918f
Jul 15 22:24:29.502456 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:29.502421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5d45" event={"ID":"9186a6e8-fb70-45a4-a14a-d3a6288a2935","Type":"ContainerStarted","Data":"57b64d33fe41af6659e059a70b26c186098fb7d9faca13c429ce40fd3114918f"}
Jul 15 22:24:31.517748 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:31.517701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v" event={"ID":"95e42daf-715a-4aae-b3eb-9341962066f6","Type":"ContainerStarted","Data":"0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691"}
Jul 15 22:24:31.518209 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:31.517872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:31.546748 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:31.546684    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v" podStartSLOduration=1.649962055 podStartE2EDuration="4.546666494s" totalImagesPullingTime="2.896704439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:24:31.54466024 +0000 UTC m=+528.069683462" watchObservedRunningTime="2026-07-15 22:24:31.546666494 +0000 UTC m=+528.071689714"
Jul 15 22:24:33.529722 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:33.529682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5d45" event={"ID":"9186a6e8-fb70-45a4-a14a-d3a6288a2935","Type":"ContainerStarted","Data":"fbde7e2fc70e49133fefdfd29d13f2ffccdc5d5703cd5b34fb5f49b43534db02"}
Jul 15 22:24:33.545259 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:33.545193    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-z5d45" podStartSLOduration=1.904204128 podStartE2EDuration="5.545178017s" totalImagesPullingTime="3.640973889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:24:33.543652302 +0000 UTC m=+530.068675523" watchObservedRunningTime="2026-07-15 22:24:33.545178017 +0000 UTC m=+530.070201236"
Jul 15 22:24:42.525218 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:42.525127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:44.377579 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:44.377491    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"]
Jul 15 22:24:44.377997 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:44.377691    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v" podUID="95e42daf-715a-4aae-b3eb-9341962066f6" containerName="limitador" containerID="cri-o://0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691" gracePeriod=30
Jul 15 22:24:44.937312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:44.937235    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:45.003099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.003065    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfpnk\" (UniqueName: \"kubernetes.io/projected/95e42daf-715a-4aae-b3eb-9341962066f6-kube-api-access-hfpnk\") pod \"95e42daf-715a-4aae-b3eb-9341962066f6\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") "
Jul 15 22:24:45.005202 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.005166    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e42daf-715a-4aae-b3eb-9341962066f6-kube-api-access-hfpnk" (OuterVolumeSpecName: "kube-api-access-hfpnk") pod "95e42daf-715a-4aae-b3eb-9341962066f6" (UID: "95e42daf-715a-4aae-b3eb-9341962066f6"). InnerVolumeSpecName "kube-api-access-hfpnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:24:45.103999 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.103959    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95e42daf-715a-4aae-b3eb-9341962066f6-config-file\") pod \"95e42daf-715a-4aae-b3eb-9341962066f6\" (UID: \"95e42daf-715a-4aae-b3eb-9341962066f6\") "
Jul 15 22:24:45.104188 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.104150    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfpnk\" (UniqueName: \"kubernetes.io/projected/95e42daf-715a-4aae-b3eb-9341962066f6-kube-api-access-hfpnk\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:24:45.104355 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.104331    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e42daf-715a-4aae-b3eb-9341962066f6-config-file" (OuterVolumeSpecName: "config-file") pod "95e42daf-715a-4aae-b3eb-9341962066f6" (UID: "95e42daf-715a-4aae-b3eb-9341962066f6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:24:45.205212 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.205130    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95e42daf-715a-4aae-b3eb-9341962066f6-config-file\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:24:45.587091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.586996    2580 generic.go:356] "Generic (PLEG): container finished" podID="95e42daf-715a-4aae-b3eb-9341962066f6" containerID="0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691" exitCode=0
Jul 15 22:24:45.587091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.587044    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"
Jul 15 22:24:45.587091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.587052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v" event={"ID":"95e42daf-715a-4aae-b3eb-9341962066f6","Type":"ContainerDied","Data":"0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691"}
Jul 15 22:24:45.587692 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.587100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tmz2v" event={"ID":"95e42daf-715a-4aae-b3eb-9341962066f6","Type":"ContainerDied","Data":"66458d20bee1ee7512029bfac67615bc0443e26d49e9cb52619914b2ed64b171"}
Jul 15 22:24:45.587692 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.587124    2580 scope.go:117] "RemoveContainer" containerID="0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691"
Jul 15 22:24:45.596589 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.596570    2580 scope.go:117] "RemoveContainer" containerID="0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691"
Jul 15 22:24:45.596851 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:24:45.596833    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691\": container with ID starting with 0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691 not found: ID does not exist" containerID="0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691"
Jul 15 22:24:45.596896 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.596858    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691"} err="failed to get container status \"0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691\": rpc error: code = NotFound desc = could not find container \"0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691\": container with ID starting with 0bd23aec2013f389358f3370a3331ea3b83dec618b7823068d595c0327e87691 not found: ID does not exist"
Jul 15 22:24:45.613962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.613937    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"]
Jul 15 22:24:45.618634 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:45.618611    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tmz2v"]
Jul 15 22:24:46.010156 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:46.010125    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e42daf-715a-4aae-b3eb-9341962066f6" path="/var/lib/kubelet/pods/95e42daf-715a-4aae-b3eb-9341962066f6/volumes"
Jul 15 22:24:50.807221 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.807182    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"]
Jul 15 22:24:50.807622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.807540    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e42daf-715a-4aae-b3eb-9341962066f6" containerName="limitador"
Jul 15 22:24:50.807622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.807552    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e42daf-715a-4aae-b3eb-9341962066f6" containerName="limitador"
Jul 15 22:24:50.807717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.807624    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e42daf-715a-4aae-b3eb-9341962066f6" containerName="limitador"
Jul 15 22:24:50.813716 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.813696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:50.820725 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.820702    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 22:24:50.820846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.820793    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 22:24:50.820846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.820823    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:24:50.822461 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.822441    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7wcdn\""
Jul 15 22:24:50.831671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.831651    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"]
Jul 15 22:24:50.846747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.846725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9r7\" (UniqueName: \"kubernetes.io/projected/87f50a9a-30cb-4b23-9365-5511971fa5e6-kube-api-access-zg9r7\") pod \"postgres-69fb4594cf-2mcjq\" (UID: \"87f50a9a-30cb-4b23-9365-5511971fa5e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:50.846876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.846755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87f50a9a-30cb-4b23-9365-5511971fa5e6-data\") pod \"postgres-69fb4594cf-2mcjq\" (UID: \"87f50a9a-30cb-4b23-9365-5511971fa5e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:50.947833 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.947795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9r7\" (UniqueName: \"kubernetes.io/projected/87f50a9a-30cb-4b23-9365-5511971fa5e6-kube-api-access-zg9r7\") pod \"postgres-69fb4594cf-2mcjq\" (UID: \"87f50a9a-30cb-4b23-9365-5511971fa5e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:50.947833 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.947835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87f50a9a-30cb-4b23-9365-5511971fa5e6-data\") pod \"postgres-69fb4594cf-2mcjq\" (UID: \"87f50a9a-30cb-4b23-9365-5511971fa5e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:50.948191 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.948174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87f50a9a-30cb-4b23-9365-5511971fa5e6-data\") pod \"postgres-69fb4594cf-2mcjq\" (UID: \"87f50a9a-30cb-4b23-9365-5511971fa5e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:50.958551 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:50.958520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9r7\" (UniqueName: \"kubernetes.io/projected/87f50a9a-30cb-4b23-9365-5511971fa5e6-kube-api-access-zg9r7\") pod \"postgres-69fb4594cf-2mcjq\" (UID: \"87f50a9a-30cb-4b23-9365-5511971fa5e6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:51.124361 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:51.124230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:51.259963 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:51.259935    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"]
Jul 15 22:24:51.261396 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:24:51.261369    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f50a9a_30cb_4b23_9365_5511971fa5e6.slice/crio-a647dbb585eba9849a4c1ccd516522b034944a93905b1720ee95d41043c9b886 WatchSource:0}: Error finding container a647dbb585eba9849a4c1ccd516522b034944a93905b1720ee95d41043c9b886: Status 404 returned error can't find the container with id a647dbb585eba9849a4c1ccd516522b034944a93905b1720ee95d41043c9b886
Jul 15 22:24:51.614490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:51.614448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq" event={"ID":"87f50a9a-30cb-4b23-9365-5511971fa5e6","Type":"ContainerStarted","Data":"a647dbb585eba9849a4c1ccd516522b034944a93905b1720ee95d41043c9b886"}
Jul 15 22:24:57.648147 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:57.648106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq" event={"ID":"87f50a9a-30cb-4b23-9365-5511971fa5e6","Type":"ContainerStarted","Data":"29884a60aa24dc41e4929f844d6629f642c6177bb6be7e846958c530b24ad86c"}
Jul 15 22:24:57.648612 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:57.648203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:24:57.669093 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:24:57.669032    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq" podStartSLOduration=2.225403942 podStartE2EDuration="7.669011444s" totalImagesPullingTime="5.443607502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:24:57.666932515 +0000 UTC m=+554.191955735" watchObservedRunningTime="2026-07-15 22:24:57.669011444 +0000 UTC m=+554.194034663"
Jul 15 22:25:03.684398 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:03.684364    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2mcjq"
Jul 15 22:25:04.544224 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:04.544186    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dd945694f-qvq8x"]
Jul 15 22:25:04.547718 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:04.547697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd945694f-qvq8x"
Jul 15 22:25:04.557413 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:04.557390    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dd945694f-qvq8x"]
Jul 15 22:25:04.666557 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:04.666524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlp8k\" (UniqueName: \"kubernetes.io/projected/ef75f61e-3105-4fe7-8c58-de911bfc535d-kube-api-access-xlp8k\") pod \"authorino-dd945694f-qvq8x\" (UID: \"ef75f61e-3105-4fe7-8c58-de911bfc535d\") " pod="kuadrant-system/authorino-dd945694f-qvq8x"
Jul 15 22:25:04.762117 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:04.762078    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dd945694f-qvq8x"]
Jul 15 22:25:04.762638 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:25:04.762390    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xlp8k], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-dd945694f-qvq8x" podUID="ef75f61e-3105-4fe7-8c58-de911bfc535d"
Jul 15 22:25:04.767615 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:04.767587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlp8k\" (UniqueName: \"kubernetes.io/projected/ef75f61e-3105-4fe7-8c58-de911bfc535d-kube-api-access-xlp8k\") pod \"authorino-dd945694f-qvq8x\" (UID: \"ef75f61e-3105-4fe7-8c58-de911bfc535d\") " pod="kuadrant-system/authorino-dd945694f-qvq8x"
Jul 15 22:25:04.786217 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:04.786189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlp8k\" (UniqueName: \"kubernetes.io/projected/ef75f61e-3105-4fe7-8c58-de911bfc535d-kube-api-access-xlp8k\") pod \"authorino-dd945694f-qvq8x\" (UID: \"ef75f61e-3105-4fe7-8c58-de911bfc535d\") " pod="kuadrant-system/authorino-dd945694f-qvq8x"
Jul 15 22:25:05.689832 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:05.689800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd945694f-qvq8x"
Jul 15 22:25:05.696966 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:05.696944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd945694f-qvq8x"
Jul 15 22:25:05.775754 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:05.775718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlp8k\" (UniqueName: \"kubernetes.io/projected/ef75f61e-3105-4fe7-8c58-de911bfc535d-kube-api-access-xlp8k\") pod \"ef75f61e-3105-4fe7-8c58-de911bfc535d\" (UID: \"ef75f61e-3105-4fe7-8c58-de911bfc535d\") "
Jul 15 22:25:05.777794 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:05.777770    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef75f61e-3105-4fe7-8c58-de911bfc535d-kube-api-access-xlp8k" (OuterVolumeSpecName: "kube-api-access-xlp8k") pod "ef75f61e-3105-4fe7-8c58-de911bfc535d" (UID: "ef75f61e-3105-4fe7-8c58-de911bfc535d"). InnerVolumeSpecName "kube-api-access-xlp8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:25:05.877207 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:05.877170    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlp8k\" (UniqueName: \"kubernetes.io/projected/ef75f61e-3105-4fe7-8c58-de911bfc535d-kube-api-access-xlp8k\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:25:06.695179 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:06.695143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd945694f-qvq8x"
Jul 15 22:25:06.725202 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:06.725166    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dd945694f-qvq8x"]
Jul 15 22:25:06.731879 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:06.731844    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-dd945694f-qvq8x"]
Jul 15 22:25:07.484715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.484677    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5d45"]
Jul 15 22:25:07.485105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.484877    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-z5d45" podUID="9186a6e8-fb70-45a4-a14a-d3a6288a2935" containerName="authorino" containerID="cri-o://fbde7e2fc70e49133fefdfd29d13f2ffccdc5d5703cd5b34fb5f49b43534db02" gracePeriod=30
Jul 15 22:25:07.703084 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.703050    2580 generic.go:356] "Generic (PLEG): container finished" podID="9186a6e8-fb70-45a4-a14a-d3a6288a2935" containerID="fbde7e2fc70e49133fefdfd29d13f2ffccdc5d5703cd5b34fb5f49b43534db02" exitCode=0
Jul 15 22:25:07.703255 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.703086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5d45" event={"ID":"9186a6e8-fb70-45a4-a14a-d3a6288a2935","Type":"ContainerDied","Data":"fbde7e2fc70e49133fefdfd29d13f2ffccdc5d5703cd5b34fb5f49b43534db02"}
Jul 15 22:25:07.743011 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.742957    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5d45"
Jul 15 22:25:07.793667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.793633    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp7z9\" (UniqueName: \"kubernetes.io/projected/9186a6e8-fb70-45a4-a14a-d3a6288a2935-kube-api-access-bp7z9\") pod \"9186a6e8-fb70-45a4-a14a-d3a6288a2935\" (UID: \"9186a6e8-fb70-45a4-a14a-d3a6288a2935\") "
Jul 15 22:25:07.795657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.795633    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9186a6e8-fb70-45a4-a14a-d3a6288a2935-kube-api-access-bp7z9" (OuterVolumeSpecName: "kube-api-access-bp7z9") pod "9186a6e8-fb70-45a4-a14a-d3a6288a2935" (UID: "9186a6e8-fb70-45a4-a14a-d3a6288a2935"). InnerVolumeSpecName "kube-api-access-bp7z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:25:07.894353 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:07.894319    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp7z9\" (UniqueName: \"kubernetes.io/projected/9186a6e8-fb70-45a4-a14a-d3a6288a2935-kube-api-access-bp7z9\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:25:08.009745 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:08.009670    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef75f61e-3105-4fe7-8c58-de911bfc535d" path="/var/lib/kubelet/pods/ef75f61e-3105-4fe7-8c58-de911bfc535d/volumes"
Jul 15 22:25:08.710118 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:08.710092    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5d45"
Jul 15 22:25:08.710118 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:08.710112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5d45" event={"ID":"9186a6e8-fb70-45a4-a14a-d3a6288a2935","Type":"ContainerDied","Data":"57b64d33fe41af6659e059a70b26c186098fb7d9faca13c429ce40fd3114918f"}
Jul 15 22:25:08.710618 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:08.710165    2580 scope.go:117] "RemoveContainer" containerID="fbde7e2fc70e49133fefdfd29d13f2ffccdc5d5703cd5b34fb5f49b43534db02"
Jul 15 22:25:08.726873 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:08.726852    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5d45"]
Jul 15 22:25:08.730572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:08.730548    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5d45"]
Jul 15 22:25:10.010656 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:10.010611    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9186a6e8-fb70-45a4-a14a-d3a6288a2935" path="/var/lib/kubelet/pods/9186a6e8-fb70-45a4-a14a-d3a6288a2935/volumes"
Jul 15 22:25:12.560620 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.560580    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8b48cfbb-rfssf"]
Jul 15 22:25:12.561126 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.561112    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9186a6e8-fb70-45a4-a14a-d3a6288a2935" containerName="authorino"
Jul 15 22:25:12.561181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.561129    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9186a6e8-fb70-45a4-a14a-d3a6288a2935" containerName="authorino"
Jul 15 22:25:12.561221 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.561213    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9186a6e8-fb70-45a4-a14a-d3a6288a2935" containerName="authorino"
Jul 15 22:25:12.565716 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.565692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.568634 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.568609    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 22:25:12.568752 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.568718    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hzjvx\""
Jul 15 22:25:12.569054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.569037    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 22:25:12.578861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.578837    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b48cfbb-rfssf"]
Jul 15 22:25:12.638894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.638858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/779e9d56-4eed-40fa-8a99-70f2e7d08b71-webhook-cert\") pod \"maas-controller-8b48cfbb-rfssf\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") " pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.638894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.638893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdlmt\" (UniqueName: \"kubernetes.io/projected/779e9d56-4eed-40fa-8a99-70f2e7d08b71-kube-api-access-zdlmt\") pod \"maas-controller-8b48cfbb-rfssf\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") " pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.740260 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.740215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/779e9d56-4eed-40fa-8a99-70f2e7d08b71-webhook-cert\") pod \"maas-controller-8b48cfbb-rfssf\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") " pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.740260 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.740262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdlmt\" (UniqueName: \"kubernetes.io/projected/779e9d56-4eed-40fa-8a99-70f2e7d08b71-kube-api-access-zdlmt\") pod \"maas-controller-8b48cfbb-rfssf\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") " pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.742818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.742792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/779e9d56-4eed-40fa-8a99-70f2e7d08b71-webhook-cert\") pod \"maas-controller-8b48cfbb-rfssf\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") " pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.754296 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.754268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdlmt\" (UniqueName: \"kubernetes.io/projected/779e9d56-4eed-40fa-8a99-70f2e7d08b71-kube-api-access-zdlmt\") pod \"maas-controller-8b48cfbb-rfssf\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") " pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.755751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.755724    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-c5nlz"]
Jul 15 22:25:12.759119 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.759099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:12.769437 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.769411    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-c5nlz"]
Jul 15 22:25:12.841607 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.841510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4pd9\" (UniqueName: \"kubernetes.io/projected/948481b1-7423-4d41-b38f-2d54840eb464-kube-api-access-w4pd9\") pod \"maas-controller-55b9df4c4b-c5nlz\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") " pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:12.841607 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.841591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/948481b1-7423-4d41-b38f-2d54840eb464-webhook-cert\") pod \"maas-controller-55b9df4c4b-c5nlz\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") " pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:12.876141 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.876110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:12.942070 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.942039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/948481b1-7423-4d41-b38f-2d54840eb464-webhook-cert\") pod \"maas-controller-55b9df4c4b-c5nlz\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") " pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:12.942204 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.942113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4pd9\" (UniqueName: \"kubernetes.io/projected/948481b1-7423-4d41-b38f-2d54840eb464-kube-api-access-w4pd9\") pod \"maas-controller-55b9df4c4b-c5nlz\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") " pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:12.944663 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.944637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/948481b1-7423-4d41-b38f-2d54840eb464-webhook-cert\") pod \"maas-controller-55b9df4c4b-c5nlz\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") " pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:12.960673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:12.960642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4pd9\" (UniqueName: \"kubernetes.io/projected/948481b1-7423-4d41-b38f-2d54840eb464-kube-api-access-w4pd9\") pod \"maas-controller-55b9df4c4b-c5nlz\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") " pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:13.071471 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:13.071420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:13.205809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:13.205782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-c5nlz"]
Jul 15 22:25:13.207192 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:25:13.207152    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948481b1_7423_4d41_b38f_2d54840eb464.slice/crio-d02878ebdf33c695dd47ba7f163b39100722a0b87af25d5d0a009eab77f9698b WatchSource:0}: Error finding container d02878ebdf33c695dd47ba7f163b39100722a0b87af25d5d0a009eab77f9698b: Status 404 returned error can't find the container with id d02878ebdf33c695dd47ba7f163b39100722a0b87af25d5d0a009eab77f9698b
Jul 15 22:25:13.221319 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:13.221282    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b48cfbb-rfssf"]
Jul 15 22:25:13.224004 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:25:13.223975    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779e9d56_4eed_40fa_8a99_70f2e7d08b71.slice/crio-a15dc20d1534a383162da4706be372f2f7ddbd30bf0f149a4b68eb4d1974e805 WatchSource:0}: Error finding container a15dc20d1534a383162da4706be372f2f7ddbd30bf0f149a4b68eb4d1974e805: Status 404 returned error can't find the container with id a15dc20d1534a383162da4706be372f2f7ddbd30bf0f149a4b68eb4d1974e805
Jul 15 22:25:13.734096 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:13.734057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz" event={"ID":"948481b1-7423-4d41-b38f-2d54840eb464","Type":"ContainerStarted","Data":"d02878ebdf33c695dd47ba7f163b39100722a0b87af25d5d0a009eab77f9698b"}
Jul 15 22:25:13.735128 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:13.735097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b48cfbb-rfssf" event={"ID":"779e9d56-4eed-40fa-8a99-70f2e7d08b71","Type":"ContainerStarted","Data":"a15dc20d1534a383162da4706be372f2f7ddbd30bf0f149a4b68eb4d1974e805"}
Jul 15 22:25:16.754309 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:16.754267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz" event={"ID":"948481b1-7423-4d41-b38f-2d54840eb464","Type":"ContainerStarted","Data":"5b2a7ce0932de5924ada3ceb21f149c90e714beb216f15c4fdf0194f3a1c37af"}
Jul 15 22:25:16.754804 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:16.754375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:16.756119 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:16.756091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b48cfbb-rfssf" event={"ID":"779e9d56-4eed-40fa-8a99-70f2e7d08b71","Type":"ContainerStarted","Data":"ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211"}
Jul 15 22:25:16.756284 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:16.756155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:16.775342 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:16.775287    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz" podStartSLOduration=1.864999436 podStartE2EDuration="4.775268675s" totalImagesPullingTime="2.910269239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:25:16.774076625 +0000 UTC m=+573.299099847" watchObservedRunningTime="2026-07-15 22:25:16.775268675 +0000 UTC m=+573.300291886"
Jul 15 22:25:16.795157 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:16.795105    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8b48cfbb-rfssf" podStartSLOduration=1.912010685 podStartE2EDuration="4.795091232s" totalImagesPullingTime="2.883080547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:25:16.793515269 +0000 UTC m=+573.318538490" watchObservedRunningTime="2026-07-15 22:25:16.795091232 +0000 UTC m=+573.320114453"
Jul 15 22:25:27.763763 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:27.763732    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:27.764172 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:27.763809    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:25:27.837046 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:27.837010    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b48cfbb-rfssf"]
Jul 15 22:25:27.837298 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:27.837189    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8b48cfbb-rfssf" podUID="779e9d56-4eed-40fa-8a99-70f2e7d08b71" containerName="manager" containerID="cri-o://ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211" gracePeriod=30
Jul 15 22:25:28.147803 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.147768    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:28.281796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.281703    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdlmt\" (UniqueName: \"kubernetes.io/projected/779e9d56-4eed-40fa-8a99-70f2e7d08b71-kube-api-access-zdlmt\") pod \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") "
Jul 15 22:25:28.281999 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.281933    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/779e9d56-4eed-40fa-8a99-70f2e7d08b71-webhook-cert\") pod \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\" (UID: \"779e9d56-4eed-40fa-8a99-70f2e7d08b71\") "
Jul 15 22:25:28.283907 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.283880    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/779e9d56-4eed-40fa-8a99-70f2e7d08b71-kube-api-access-zdlmt" (OuterVolumeSpecName: "kube-api-access-zdlmt") pod "779e9d56-4eed-40fa-8a99-70f2e7d08b71" (UID: "779e9d56-4eed-40fa-8a99-70f2e7d08b71"). InnerVolumeSpecName "kube-api-access-zdlmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:25:28.284016 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.283987    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/779e9d56-4eed-40fa-8a99-70f2e7d08b71-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "779e9d56-4eed-40fa-8a99-70f2e7d08b71" (UID: "779e9d56-4eed-40fa-8a99-70f2e7d08b71"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:25:28.383374 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.383342    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/779e9d56-4eed-40fa-8a99-70f2e7d08b71-webhook-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:25:28.383374 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.383368    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdlmt\" (UniqueName: \"kubernetes.io/projected/779e9d56-4eed-40fa-8a99-70f2e7d08b71-kube-api-access-zdlmt\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:25:28.812943 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.812906    2580 generic.go:356] "Generic (PLEG): container finished" podID="779e9d56-4eed-40fa-8a99-70f2e7d08b71" containerID="ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211" exitCode=0
Jul 15 22:25:28.813416 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.812963    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b48cfbb-rfssf"
Jul 15 22:25:28.813416 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.812993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b48cfbb-rfssf" event={"ID":"779e9d56-4eed-40fa-8a99-70f2e7d08b71","Type":"ContainerDied","Data":"ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211"}
Jul 15 22:25:28.813416 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.813087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b48cfbb-rfssf" event={"ID":"779e9d56-4eed-40fa-8a99-70f2e7d08b71","Type":"ContainerDied","Data":"a15dc20d1534a383162da4706be372f2f7ddbd30bf0f149a4b68eb4d1974e805"}
Jul 15 22:25:28.813416 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.813121    2580 scope.go:117] "RemoveContainer" containerID="ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211"
Jul 15 22:25:28.822051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.822033    2580 scope.go:117] "RemoveContainer" containerID="ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211"
Jul 15 22:25:28.822298 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:25:28.822279    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211\": container with ID starting with ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211 not found: ID does not exist" containerID="ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211"
Jul 15 22:25:28.822374 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.822306    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211"} err="failed to get container status \"ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211\": rpc error: code = NotFound desc = could not find container \"ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211\": container with ID starting with ca6634879cae491877b305bb88b89db18e4620b339d977228e5e2f4d79c80211 not found: ID does not exist"
Jul 15 22:25:28.835482 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.835457    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b48cfbb-rfssf"]
Jul 15 22:25:28.842601 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:28.842581    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8b48cfbb-rfssf"]
Jul 15 22:25:30.010033 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:30.010001    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="779e9d56-4eed-40fa-8a99-70f2e7d08b71" path="/var/lib/kubelet/pods/779e9d56-4eed-40fa-8a99-70f2e7d08b71/volumes"
Jul 15 22:25:43.950837 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:43.950804    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:25:43.953640 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:43.953617    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:25:43.957145 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:43.957127    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:25:43.959381 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:43.959363    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:25:50.703949 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.703911    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"]
Jul 15 22:25:50.704346 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.704265    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779e9d56-4eed-40fa-8a99-70f2e7d08b71" containerName="manager"
Jul 15 22:25:50.704346 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.704280    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="779e9d56-4eed-40fa-8a99-70f2e7d08b71" containerName="manager"
Jul 15 22:25:50.704421 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.704372    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="779e9d56-4eed-40fa-8a99-70f2e7d08b71" containerName="manager"
Jul 15 22:25:50.709317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.709287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.713084 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.713060    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zng5k\""
Jul 15 22:25:50.713295 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.713068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 22:25:50.720155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.720133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"]
Jul 15 22:25:50.780882 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.780854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b72af96-c097-44bf-9a22-142396a25de6-maas-api-tls\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.781015 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.780893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b72af96-c097-44bf-9a22-142396a25de6-openshift-service-ca\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.781015 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.780938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mw6z\" (UniqueName: \"kubernetes.io/projected/8b72af96-c097-44bf-9a22-142396a25de6-kube-api-access-5mw6z\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.882322 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.882284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b72af96-c097-44bf-9a22-142396a25de6-maas-api-tls\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.882471 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.882330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b72af96-c097-44bf-9a22-142396a25de6-openshift-service-ca\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.882471 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.882374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mw6z\" (UniqueName: \"kubernetes.io/projected/8b72af96-c097-44bf-9a22-142396a25de6-kube-api-access-5mw6z\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.883107 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.883086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b72af96-c097-44bf-9a22-142396a25de6-openshift-service-ca\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.884748 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.884725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b72af96-c097-44bf-9a22-142396a25de6-maas-api-tls\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:50.891025 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:50.890994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mw6z\" (UniqueName: \"kubernetes.io/projected/8b72af96-c097-44bf-9a22-142396a25de6-kube-api-access-5mw6z\") pod \"maas-api-c6768fb-7bqgg\" (UID: \"8b72af96-c097-44bf-9a22-142396a25de6\") " pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:51.020633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.020552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:51.164739 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.164714    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"]
Jul 15 22:25:51.167440 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:25:51.167408    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b72af96_c097_44bf_9a22_142396a25de6.slice/crio-e34d82605faae411cb2160c0c19386fa996ac95bf2920c4652d71e11980afc6d WatchSource:0}: Error finding container e34d82605faae411cb2160c0c19386fa996ac95bf2920c4652d71e11980afc6d: Status 404 returned error can't find the container with id e34d82605faae411cb2160c0c19386fa996ac95bf2920c4652d71e11980afc6d
Jul 15 22:25:51.277668 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.277595    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-lxw99"]
Jul 15 22:25:51.281995 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.281972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.285529 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.285507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qv5m4\""
Jul 15 22:25:51.285830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.285810    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 22:25:51.297864 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.297838    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"]
Jul 15 22:25:51.301304 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.301281    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-lxw99"]
Jul 15 22:25:51.301392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.301365    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.332182 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.332155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"]
Jul 15 22:25:51.386718 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.386683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59vv\" (UniqueName: \"kubernetes.io/projected/231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0-kube-api-access-t59vv\") pod \"payload-processing-f9b8d9b9b-lxw99\" (UID: \"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.386894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.386746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-lxw99\" (UID: \"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.386894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.386825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-wwtp5\" (UID: \"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.386894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.386859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7vc\" (UniqueName: \"kubernetes.io/projected/a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4-kube-api-access-pj7vc\") pod \"payload-pre-processing-74584bb9f8-wwtp5\" (UID: \"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.488194 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.488158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7vc\" (UniqueName: \"kubernetes.io/projected/a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4-kube-api-access-pj7vc\") pod \"payload-pre-processing-74584bb9f8-wwtp5\" (UID: \"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.488378 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.488275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59vv\" (UniqueName: \"kubernetes.io/projected/231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0-kube-api-access-t59vv\") pod \"payload-processing-f9b8d9b9b-lxw99\" (UID: \"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.488378 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.488317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-lxw99\" (UID: \"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.488378 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.488363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-wwtp5\" (UID: \"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.489055 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.489034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-wwtp5\" (UID: \"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.489116 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.489073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-lxw99\" (UID: \"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.496574 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.496548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59vv\" (UniqueName: \"kubernetes.io/projected/231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0-kube-api-access-t59vv\") pod \"payload-processing-f9b8d9b9b-lxw99\" (UID: \"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.496861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.496845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7vc\" (UniqueName: \"kubernetes.io/projected/a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4-kube-api-access-pj7vc\") pod \"payload-pre-processing-74584bb9f8-wwtp5\" (UID: \"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.592838 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.592762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:51.611390 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.611367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:51.754089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.754052    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-lxw99"]
Jul 15 22:25:51.757862 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:25:51.757819    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231bffdb_3e48_4f1b_9cad_b5cd7bbf1de0.slice/crio-45082963447f6cb31a061ea25fb66ab9794013548dad98032097ed180172e207 WatchSource:0}: Error finding container 45082963447f6cb31a061ea25fb66ab9794013548dad98032097ed180172e207: Status 404 returned error can't find the container with id 45082963447f6cb31a061ea25fb66ab9794013548dad98032097ed180172e207
Jul 15 22:25:51.932972 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.932934    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg" event={"ID":"8b72af96-c097-44bf-9a22-142396a25de6","Type":"ContainerStarted","Data":"e34d82605faae411cb2160c0c19386fa996ac95bf2920c4652d71e11980afc6d"}
Jul 15 22:25:51.934633 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.934603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99" event={"ID":"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0","Type":"ContainerStarted","Data":"45082963447f6cb31a061ea25fb66ab9794013548dad98032097ed180172e207"}
Jul 15 22:25:51.983268 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:51.978585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"]
Jul 15 22:25:51.986050 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:25:51.986014    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bd6f98_d94a_47f9_b573_7e2cdfccc2c4.slice/crio-db1bd1d89c2e12b2883af9a35ad4d2bee4f8e7146deb42ccace6e4762f20c88f WatchSource:0}: Error finding container db1bd1d89c2e12b2883af9a35ad4d2bee4f8e7146deb42ccace6e4762f20c88f: Status 404 returned error can't find the container with id db1bd1d89c2e12b2883af9a35ad4d2bee4f8e7146deb42ccace6e4762f20c88f
Jul 15 22:25:52.974007 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:52.973640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5" event={"ID":"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4","Type":"ContainerStarted","Data":"db1bd1d89c2e12b2883af9a35ad4d2bee4f8e7146deb42ccace6e4762f20c88f"}
Jul 15 22:25:53.983100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:53.983060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg" event={"ID":"8b72af96-c097-44bf-9a22-142396a25de6","Type":"ContainerStarted","Data":"3100ce68273c588c20e2937814462d76425e2df81907c809d6cc93cbcd9b9e5a"}
Jul 15 22:25:53.983597 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:53.983165    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:25:53.984679 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:53.984654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99" event={"ID":"231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0","Type":"ContainerStarted","Data":"bb4f5dda82d07f23f13d2f09afb0520dbe2d33ef3140e2a9a75e5dbe76ecb8c4"}
Jul 15 22:25:53.984812 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:53.984726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:25:53.986123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:53.986104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5" event={"ID":"a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4","Type":"ContainerStarted","Data":"007d0405357c76295fd8de3619b2f9eef7ce983156196d6ae4c0629af34eb94a"}
Jul 15 22:25:53.986233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:53.986220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:25:54.000444 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:54.000400    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg" podStartSLOduration=2.257423165 podStartE2EDuration="4.000385551s" totalImagesPullingTime="1.742962386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:25:53.999947823 +0000 UTC m=+610.524971043" watchObservedRunningTime="2026-07-15 22:25:54.000385551 +0000 UTC m=+610.525408773"
Jul 15 22:25:54.017751 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:54.017708    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99" podStartSLOduration=1.246354578 podStartE2EDuration="3.017694582s" totalImagesPullingTime="1.771340004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:25:54.016320563 +0000 UTC m=+610.541343799" watchObservedRunningTime="2026-07-15 22:25:54.017694582 +0000 UTC m=+610.542717802"
Jul 15 22:25:59.013579 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.013548    2580 generic.go:356] "Generic (PLEG): container finished" podID="f8f720c7-b611-4728-aec5-3b32a875566a" containerID="4f4b7587a448e9f0309119cdc7ae7edb2162dda73a4d3c9b76bb8e3ed447dc06" exitCode=0
Jul 15 22:25:59.014064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.013624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" event={"ID":"f8f720c7-b611-4728-aec5-3b32a875566a","Type":"ContainerDied","Data":"4f4b7587a448e9f0309119cdc7ae7edb2162dda73a4d3c9b76bb8e3ed447dc06"}
Jul 15 22:25:59.014064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.014036    2580 scope.go:117] "RemoveContainer" containerID="4f4b7587a448e9f0309119cdc7ae7edb2162dda73a4d3c9b76bb8e3ed447dc06"
Jul 15 22:25:59.015030 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.015002    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:25:59.015121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.015080    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:25:59.015182 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.015129    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:25:59.037037 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.036984    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5" podStartSLOduration=6.496926448 podStartE2EDuration="8.036964223s" totalImagesPullingTime="1.540037775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:25:54.041421385 +0000 UTC m=+610.566444606" watchObservedRunningTime="2026-07-15 22:25:59.036964223 +0000 UTC m=+615.561987447"
Jul 15 22:25:59.997303 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:25:59.997270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c6768fb-7bqgg"
Jul 15 22:26:00.020441 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:00.020403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" event={"ID":"f8f720c7-b611-4728-aec5-3b32a875566a","Type":"ContainerStarted","Data":"6d66c7b13bcf19bef92c64eff083e70279827e93529942380e9d0dd8968065db"}
Jul 15 22:26:00.278405 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:00.278307    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:26:00.278656 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:00.278631    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tqcpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 15 22:26:00.278707 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:00.278688    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" podUID="f8f720c7-b611-4728-aec5-3b32a875566a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 15 22:26:01.278995 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:01.278957    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tqcpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 15 22:26:01.279420 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:01.279015    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" podUID="f8f720c7-b611-4728-aec5-3b32a875566a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 15 22:26:02.278927 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:02.278888    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tqcpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 15 22:26:02.279104 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:02.278959    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" podUID="f8f720c7-b611-4728-aec5-3b32a875566a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 15 22:26:03.278891 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:03.278852    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tqcpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 15 22:26:03.279077 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:03.278915    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv" podUID="f8f720c7-b611-4728-aec5-3b32a875566a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 15 22:26:04.283086 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:04.283047    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:26:04.283495 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:04.283347    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:26:04.284021 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:04.284006    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tqcpv"
Jul 15 22:26:04.993374 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:04.993339    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-lxw99"
Jul 15 22:26:04.993559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:04.993418    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-wwtp5"
Jul 15 22:26:11.027737 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.027652    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"]
Jul 15 22:26:11.031087 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.031062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.035034 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.035005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tckxd\""
Jul 15 22:26:11.035303 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.035010    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 22:26:11.035440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.035065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 22:26:11.035440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.035070    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 22:26:11.044044 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.044020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"]
Jul 15 22:26:11.164652 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.164615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16729844-14a6-484d-a463-7ec7ec7d40dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.164823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.164669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.164823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.164704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44h4z\" (UniqueName: \"kubernetes.io/projected/16729844-14a6-484d-a463-7ec7ec7d40dd-kube-api-access-44h4z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.164823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.164741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.164823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.164808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.165085 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.164831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.265886 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.265848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.265886 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.265891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.266121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.265940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16729844-14a6-484d-a463-7ec7ec7d40dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.266121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.265962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.266121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.265983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44h4z\" (UniqueName: \"kubernetes.io/projected/16729844-14a6-484d-a463-7ec7ec7d40dd-kube-api-access-44h4z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.266121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.266003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.266370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.266327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.266370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.266348    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.266450 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.266385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.268294 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.268278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16729844-14a6-484d-a463-7ec7ec7d40dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.268572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.268556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16729844-14a6-484d-a463-7ec7ec7d40dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.275136 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.275111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44h4z\" (UniqueName: \"kubernetes.io/projected/16729844-14a6-484d-a463-7ec7ec7d40dd-kube-api-access-44h4z\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs\" (UID: \"16729844-14a6-484d-a463-7ec7ec7d40dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.344037 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.343964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:11.486756 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:11.486726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"]
Jul 15 22:26:11.488613 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:26:11.488583    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16729844_14a6_484d_a463_7ec7ec7d40dd.slice/crio-8ada402c4ed0286f9f87c65fad72bc6edcafc6dfbdfd4bfd64ffec84ca208b3a WatchSource:0}: Error finding container 8ada402c4ed0286f9f87c65fad72bc6edcafc6dfbdfd4bfd64ffec84ca208b3a: Status 404 returned error can't find the container with id 8ada402c4ed0286f9f87c65fad72bc6edcafc6dfbdfd4bfd64ffec84ca208b3a
Jul 15 22:26:12.084941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:12.084901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs" event={"ID":"16729844-14a6-484d-a463-7ec7ec7d40dd","Type":"ContainerStarted","Data":"8ada402c4ed0286f9f87c65fad72bc6edcafc6dfbdfd4bfd64ffec84ca208b3a"}
Jul 15 22:26:13.091678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:13.091632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs" event={"ID":"16729844-14a6-484d-a463-7ec7ec7d40dd","Type":"ContainerStarted","Data":"17ae8640bb9c6ce52c300a849939ec0f78cf08c6818744b11fcac6fb24a6e803"}
Jul 15 22:26:13.112375 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:13.112325    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs" podStartSLOduration=1.01372094 podStartE2EDuration="2.112308414s" totalImagesPullingTime="1.098587474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:26:13.110611121 +0000 UTC m=+629.635634372" watchObservedRunningTime="2026-07-15 22:26:13.112308414 +0000 UTC m=+629.637331634"
Jul 15 22:26:18.097469 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.097429    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"]
Jul 15 22:26:18.101168 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.101146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.103974 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.103956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 22:26:18.112911 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.112887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"]
Jul 15 22:26:18.235103 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.235071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.235103 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.235105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.235335 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.235148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.235335 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.235172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.235335 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.235192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwhw\" (UniqueName: \"kubernetes.io/projected/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-kube-api-access-hfwhw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.235335 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.235321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.336804 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.336769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.336978 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.336810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.336978 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.336837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwhw\" (UniqueName: \"kubernetes.io/projected/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-kube-api-access-hfwhw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.336978 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.336940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.337209 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.336987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.337209 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.337010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.337365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.337284    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.337365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.337355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.337450 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.337409    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.339135 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.339117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.339432 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.339415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.345920 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.345896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwhw\" (UniqueName: \"kubernetes.io/projected/0f8eb05b-2bc5-48b7-a9f4-3039034c7de2-kube-api-access-hfwhw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnctm\" (UID: \"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.411970 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.411881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:18.555051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.554962    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"]
Jul 15 22:26:18.557830 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:26:18.557793    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8eb05b_2bc5_48b7_a9f4_3039034c7de2.slice/crio-fe6013210f2c2feccc1c036ac8c334479d9b81ba70524330dee485e63def0b2c WatchSource:0}: Error finding container fe6013210f2c2feccc1c036ac8c334479d9b81ba70524330dee485e63def0b2c: Status 404 returned error can't find the container with id fe6013210f2c2feccc1c036ac8c334479d9b81ba70524330dee485e63def0b2c
Jul 15 22:26:18.559175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:18.559155    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:26:19.120761 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:19.120673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm" event={"ID":"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2","Type":"ContainerStarted","Data":"9a4b9ebad63bbd9ba79a5fa12a7890cb0717c970bb9862e6e4ffa37b52ff3877"}
Jul 15 22:26:19.120761 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:19.120738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm" event={"ID":"0f8eb05b-2bc5-48b7-a9f4-3039034c7de2","Type":"ContainerStarted","Data":"fe6013210f2c2feccc1c036ac8c334479d9b81ba70524330dee485e63def0b2c"}
Jul 15 22:26:19.140581 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:19.140532    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm" podStartSLOduration=0.949564261 podStartE2EDuration="1.140516638s" totalImagesPullingTime="190.952377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:26:19.139420169 +0000 UTC m=+635.664443423" watchObservedRunningTime="2026-07-15 22:26:19.140516638 +0000 UTC m=+635.665539857"
Jul 15 22:26:21.344518 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:21.344482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:21.344920 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:21.344783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:21.357072 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:21.357048    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:22.146356 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:22.146320    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs"
Jul 15 22:26:28.413013 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:28.412976    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:28.413452 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:28.413054    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:28.426369 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:28.426345    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:26:29.179158 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:26:29.179127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnctm"
Jul 15 22:29:12.772974 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:12.772883    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-c5nlz"]
Jul 15 22:29:12.773544 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:12.773115    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz" podUID="948481b1-7423-4d41-b38f-2d54840eb464" containerName="manager" containerID="cri-o://5b2a7ce0932de5924ada3ceb21f149c90e714beb216f15c4fdf0194f3a1c37af" gracePeriod=30
Jul 15 22:29:12.953954 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:12.953920    2580 generic.go:356] "Generic (PLEG): container finished" podID="948481b1-7423-4d41-b38f-2d54840eb464" containerID="5b2a7ce0932de5924ada3ceb21f149c90e714beb216f15c4fdf0194f3a1c37af" exitCode=0
Jul 15 22:29:12.954115 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:12.953994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz" event={"ID":"948481b1-7423-4d41-b38f-2d54840eb464","Type":"ContainerDied","Data":"5b2a7ce0932de5924ada3ceb21f149c90e714beb216f15c4fdf0194f3a1c37af"}
Jul 15 22:29:13.025374 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.025306    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:29:13.100165 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.100131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/948481b1-7423-4d41-b38f-2d54840eb464-webhook-cert\") pod \"948481b1-7423-4d41-b38f-2d54840eb464\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") "
Jul 15 22:29:13.100340 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.100282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4pd9\" (UniqueName: \"kubernetes.io/projected/948481b1-7423-4d41-b38f-2d54840eb464-kube-api-access-w4pd9\") pod \"948481b1-7423-4d41-b38f-2d54840eb464\" (UID: \"948481b1-7423-4d41-b38f-2d54840eb464\") "
Jul 15 22:29:13.102200 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.102162    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948481b1-7423-4d41-b38f-2d54840eb464-kube-api-access-w4pd9" (OuterVolumeSpecName: "kube-api-access-w4pd9") pod "948481b1-7423-4d41-b38f-2d54840eb464" (UID: "948481b1-7423-4d41-b38f-2d54840eb464"). InnerVolumeSpecName "kube-api-access-w4pd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:29:13.102200 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.102173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/948481b1-7423-4d41-b38f-2d54840eb464-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "948481b1-7423-4d41-b38f-2d54840eb464" (UID: "948481b1-7423-4d41-b38f-2d54840eb464"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:29:13.201236 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.201200    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4pd9\" (UniqueName: \"kubernetes.io/projected/948481b1-7423-4d41-b38f-2d54840eb464-kube-api-access-w4pd9\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:29:13.201236 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.201229    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/948481b1-7423-4d41-b38f-2d54840eb464-webhook-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:29:13.960521 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.960494    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz"
Jul 15 22:29:13.960521 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.960505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b9df4c4b-c5nlz" event={"ID":"948481b1-7423-4d41-b38f-2d54840eb464","Type":"ContainerDied","Data":"d02878ebdf33c695dd47ba7f163b39100722a0b87af25d5d0a009eab77f9698b"}
Jul 15 22:29:13.961076 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.960561    2580 scope.go:117] "RemoveContainer" containerID="5b2a7ce0932de5924ada3ceb21f149c90e714beb216f15c4fdf0194f3a1c37af"
Jul 15 22:29:13.983428 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.983398    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-c5nlz"]
Jul 15 22:29:13.987206 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:13.987183    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-c5nlz"]
Jul 15 22:29:14.017092 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.017058    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="948481b1-7423-4d41-b38f-2d54840eb464" path="/var/lib/kubelet/pods/948481b1-7423-4d41-b38f-2d54840eb464/volumes"
Jul 15 22:29:14.783466 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.783431    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-mw5pm"]
Jul 15 22:29:14.783844 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.783831    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948481b1-7423-4d41-b38f-2d54840eb464" containerName="manager"
Jul 15 22:29:14.783894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.783846    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="948481b1-7423-4d41-b38f-2d54840eb464" containerName="manager"
Jul 15 22:29:14.783934 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.783925    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="948481b1-7423-4d41-b38f-2d54840eb464" containerName="manager"
Jul 15 22:29:14.788254 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.788225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:14.792161 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.792136    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 22:29:14.792302 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.792144    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hzjvx\""
Jul 15 22:29:14.792302 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.792144    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 22:29:14.798215 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.798190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-mw5pm"]
Jul 15 22:29:14.918706 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.918667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a81c330-0873-40ce-b9d3-46bdff42b751-webhook-cert\") pod \"maas-controller-55b9df4c4b-mw5pm\" (UID: \"8a81c330-0873-40ce-b9d3-46bdff42b751\") " pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:14.918892 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:14.918743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvvw7\" (UniqueName: \"kubernetes.io/projected/8a81c330-0873-40ce-b9d3-46bdff42b751-kube-api-access-rvvw7\") pod \"maas-controller-55b9df4c4b-mw5pm\" (UID: \"8a81c330-0873-40ce-b9d3-46bdff42b751\") " pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:15.020079 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.020039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a81c330-0873-40ce-b9d3-46bdff42b751-webhook-cert\") pod \"maas-controller-55b9df4c4b-mw5pm\" (UID: \"8a81c330-0873-40ce-b9d3-46bdff42b751\") " pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:15.020524 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.020097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvw7\" (UniqueName: \"kubernetes.io/projected/8a81c330-0873-40ce-b9d3-46bdff42b751-kube-api-access-rvvw7\") pod \"maas-controller-55b9df4c4b-mw5pm\" (UID: \"8a81c330-0873-40ce-b9d3-46bdff42b751\") " pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:15.022520 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.022495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a81c330-0873-40ce-b9d3-46bdff42b751-webhook-cert\") pod \"maas-controller-55b9df4c4b-mw5pm\" (UID: \"8a81c330-0873-40ce-b9d3-46bdff42b751\") " pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:15.031830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.031805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvvw7\" (UniqueName: \"kubernetes.io/projected/8a81c330-0873-40ce-b9d3-46bdff42b751-kube-api-access-rvvw7\") pod \"maas-controller-55b9df4c4b-mw5pm\" (UID: \"8a81c330-0873-40ce-b9d3-46bdff42b751\") " pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:15.099481 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.099397    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:15.231584 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.231555    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b9df4c4b-mw5pm"]
Jul 15 22:29:15.233519 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:29:15.233493    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a81c330_0873_40ce_b9d3_46bdff42b751.slice/crio-3ce9ecfbff92c26e05c23f7344ff4423bcef87cfcde8159b7b326a00e742a7db WatchSource:0}: Error finding container 3ce9ecfbff92c26e05c23f7344ff4423bcef87cfcde8159b7b326a00e742a7db: Status 404 returned error can't find the container with id 3ce9ecfbff92c26e05c23f7344ff4423bcef87cfcde8159b7b326a00e742a7db
Jul 15 22:29:15.972758 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.972724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b9df4c4b-mw5pm" event={"ID":"8a81c330-0873-40ce-b9d3-46bdff42b751","Type":"ContainerStarted","Data":"4943633cdb5195f71d9235c8763bdb66ca4e24b117e564e3779127c61a034747"}
Jul 15 22:29:15.972958 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.972777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b9df4c4b-mw5pm" event={"ID":"8a81c330-0873-40ce-b9d3-46bdff42b751","Type":"ContainerStarted","Data":"3ce9ecfbff92c26e05c23f7344ff4423bcef87cfcde8159b7b326a00e742a7db"}
Jul 15 22:29:15.972958 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:15.972849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:29:16.011490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:16.011393    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55b9df4c4b-mw5pm" podStartSLOduration=1.519353453 podStartE2EDuration="2.011376386s" totalImagesPullingTime="492.022933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:29:16.009653619 +0000 UTC m=+812.534676840" watchObservedRunningTime="2026-07-15 22:29:16.011376386 +0000 UTC m=+812.536399634"
Jul 15 22:29:26.980202 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:29:26.980167    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55b9df4c4b-mw5pm"
Jul 15 22:30:00.150337 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:00.150298    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq"]
Jul 15 22:30:00.153705 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:00.153686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq"
Jul 15 22:30:00.156397 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:00.156376    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:30:00.161958 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:00.161923    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq"]
Jul 15 22:30:00.165708 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:00.165689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq"
Jul 15 22:30:00.310408 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:00.310379    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq"]
Jul 15 22:30:00.312740 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:30:00.312717    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3c7fa0_a464_4428_9bd3_ef41dd2f103c.slice/crio-d6b377837aceb6584716c0073219072f8e0130140428e0e8ab540820c2c7f2cf WatchSource:0}: Error finding container d6b377837aceb6584716c0073219072f8e0130140428e0e8ab540820c2c7f2cf: Status 404 returned error can't find the container with id d6b377837aceb6584716c0073219072f8e0130140428e0e8ab540820c2c7f2cf
Jul 15 22:30:01.197229 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:01.197189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq" event={"ID":"ae3c7fa0-a464-4428-9bd3-ef41dd2f103c","Type":"ContainerStarted","Data":"d6b377837aceb6584716c0073219072f8e0130140428e0e8ab540820c2c7f2cf"}
Jul 15 22:30:05.218511 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:05.218471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq" event={"ID":"ae3c7fa0-a464-4428-9bd3-ef41dd2f103c","Type":"ContainerStarted","Data":"895a193d50cbd80caeaf14004ba526772c0070942b1375ff38897cabe43c1a66"}
Jul 15 22:30:05.240151 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:05.240104    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq" podStartSLOduration=1.197819168 podStartE2EDuration="5.240090697s" totalImagesPullingTime="4.042271529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:30:05.237980324 +0000 UTC m=+861.763003543" watchObservedRunningTime="2026-07-15 22:30:05.240090697 +0000 UTC m=+861.765113917"
Jul 15 22:30:06.224585 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:06.224549    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae3c7fa0-a464-4428-9bd3-ef41dd2f103c" containerID="895a193d50cbd80caeaf14004ba526772c0070942b1375ff38897cabe43c1a66" exitCode=0
Jul 15 22:30:06.224970 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:06.224636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq" event={"ID":"ae3c7fa0-a464-4428-9bd3-ef41dd2f103c","Type":"ContainerDied","Data":"895a193d50cbd80caeaf14004ba526772c0070942b1375ff38897cabe43c1a66"}
Jul 15 22:30:07.371933 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:07.371909    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq"
Jul 15 22:30:08.235350 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:08.235314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq" event={"ID":"ae3c7fa0-a464-4428-9bd3-ef41dd2f103c","Type":"ContainerDied","Data":"d6b377837aceb6584716c0073219072f8e0130140428e0e8ab540820c2c7f2cf"}
Jul 15 22:30:08.235538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:08.235363    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6b377837aceb6584716c0073219072f8e0130140428e0e8ab540820c2c7f2cf"
Jul 15 22:30:08.235538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:08.235382    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735910-wtknq"
Jul 15 22:30:43.990565 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:43.990480    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:30:43.991117 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:43.991098    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:30:43.997588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:43.997565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:30:43.997952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:30:43.997933    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:35:44.027326 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:35:44.027296    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:35:44.028112 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:35:44.028090    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:35:44.033074 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:35:44.033051    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:35:44.033941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:35:44.033924    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:40:44.058707 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:40:44.058676    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:40:44.059315 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:40:44.059139    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:40:44.064889 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:40:44.064860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:40:44.065136 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:40:44.065120    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:41:33.162338 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.162304    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"]
Jul 15 22:41:33.164591 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.162707    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3c7fa0-a464-4428-9bd3-ef41dd2f103c" containerName="cleanup"
Jul 15 22:41:33.164591 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.162720    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3c7fa0-a464-4428-9bd3-ef41dd2f103c" containerName="cleanup"
Jul 15 22:41:33.164591 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.162799    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3c7fa0-a464-4428-9bd3-ef41dd2f103c" containerName="cleanup"
Jul 15 22:41:33.165697 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.165679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.168791 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.168767    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a0965552-openshift-default-dockercfg-6znbr\""
Jul 15 22:41:33.190542 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.190512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"]
Jul 15 22:41:33.263962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.263928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-socket\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264113 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.263966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-data\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264113 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.263996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-istio-token\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264197 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.264109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-certs\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264197 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.264150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39e43302-3efc-4312-8902-e81ea18574f9-istiod-ca-cert\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264278 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.264209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-envoy\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264314 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.264284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-credential-socket\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264359 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.264344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39e43302-3efc-4312-8902-e81ea18574f9-istio-podinfo\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.264397 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.264384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bwmn\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-kube-api-access-2bwmn\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.365688 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-envoy\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.365840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-credential-socket\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.365840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39e43302-3efc-4312-8902-e81ea18574f9-istio-podinfo\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.365840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bwmn\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-kube-api-access-2bwmn\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.365840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-socket\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.365840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-data\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.365840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-istio-token\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.366183 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-certs\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.366183 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.365925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39e43302-3efc-4312-8902-e81ea18574f9-istiod-ca-cert\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.366305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.366188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-credential-socket\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.366442 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.366417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-socket\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.366555 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.366510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-data\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.366611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.366580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-certs\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.366716 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.366694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39e43302-3efc-4312-8902-e81ea18574f9-istiod-ca-cert\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.368139 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.368119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-envoy\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.368392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.368374    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39e43302-3efc-4312-8902-e81ea18574f9-istio-podinfo\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.373938 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.373912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bwmn\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-kube-api-access-2bwmn\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.374680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.374662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-istio-token\") pod \"e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") " pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.477731 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.477700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:33.611389 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.611365    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"]
Jul 15 22:41:33.612934 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:41:33.612906    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e43302_3efc_4312_8902_e81ea18574f9.slice/crio-bbd9590deeba4da70000c5bd6cb6cddd49bb65abeeee77896eeb89e6f8f00eb7 WatchSource:0}: Error finding container bbd9590deeba4da70000c5bd6cb6cddd49bb65abeeee77896eeb89e6f8f00eb7: Status 404 returned error can't find the container with id bbd9590deeba4da70000c5bd6cb6cddd49bb65abeeee77896eeb89e6f8f00eb7
Jul 15 22:41:33.615406 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.615373    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:41:33.615482 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.615454    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:41:33.615520 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:33.615491    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:41:34.500632 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.500586    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"]
Jul 15 22:41:34.504641 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.504619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.507161 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.507138    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a0965552-serving-cert\""
Jul 15 22:41:34.512916 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.512894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"]
Jul 15 22:41:34.530168 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.530144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" event={"ID":"39e43302-3efc-4312-8902-e81ea18574f9","Type":"ContainerStarted","Data":"642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67"}
Jul 15 22:41:34.530301 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.530180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" event={"ID":"39e43302-3efc-4312-8902-e81ea18574f9","Type":"ContainerStarted","Data":"bbd9590deeba4da70000c5bd6cb6cddd49bb65abeeee77896eeb89e6f8f00eb7"}
Jul 15 22:41:34.577885 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.577858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-openshift-service-ca\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.578000 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.577931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.578000 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.577957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjr8b\" (UniqueName: \"kubernetes.io/projected/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-kube-api-access-fjr8b\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.583423 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.583378    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" podStartSLOduration=1.5833604060000002 podStartE2EDuration="1.583360406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:34.581496065 +0000 UTC m=+1551.106519287" watchObservedRunningTime="2026-07-15 22:41:34.583360406 +0000 UTC m=+1551.108383627"
Jul 15 22:41:34.679368 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.679339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-openshift-service-ca\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.679536 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.679390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.679536 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.679417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjr8b\" (UniqueName: \"kubernetes.io/projected/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-kube-api-access-fjr8b\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.679650 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:41:34.679541    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-serving-cert: secret "maas-api-e2e-ait-a0965552-serving-cert" not found
Jul 15 22:41:34.679650 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:41:34.679612    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls podName:bc8cd6b6-b68b-495f-a719-9d1a19a1a42b nodeName:}" failed. No retries permitted until 2026-07-15 22:41:35.179594027 +0000 UTC m=+1551.704617229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls") pod "maas-api-e2e-ait-a0965552-7dd7b86496-22brt" (UID: "bc8cd6b6-b68b-495f-a719-9d1a19a1a42b") : secret "maas-api-e2e-ait-a0965552-serving-cert" not found
Jul 15 22:41:34.680084 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.680067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-openshift-service-ca\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:34.691211 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:34.691189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjr8b\" (UniqueName: \"kubernetes.io/projected/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-kube-api-access-fjr8b\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:35.183358 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.183319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:35.185700 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.185673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls\") pod \"maas-api-e2e-ait-a0965552-7dd7b86496-22brt\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:35.418542 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.418508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:35.480468 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.480440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:35.486137 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.486107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:35.535994 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.535959    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:35.536861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.536835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:35.555794 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.555769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"]
Jul 15 22:41:35.558397 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:41:35.558339    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8cd6b6_b68b_495f_a719_9d1a19a1a42b.slice/crio-a00fb8903b04db596a61e1b3a0e140099871bd4c508d9e8dd82143f0e4f97519 WatchSource:0}: Error finding container a00fb8903b04db596a61e1b3a0e140099871bd4c508d9e8dd82143f0e4f97519: Status 404 returned error can't find the container with id a00fb8903b04db596a61e1b3a0e140099871bd4c508d9e8dd82143f0e4f97519
Jul 15 22:41:35.559838 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:35.559818    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:41:36.541890 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:36.541850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt" event={"ID":"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b","Type":"ContainerStarted","Data":"743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a"}
Jul 15 22:41:36.542291 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:36.541907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt" event={"ID":"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b","Type":"ContainerStarted","Data":"a00fb8903b04db596a61e1b3a0e140099871bd4c508d9e8dd82143f0e4f97519"}
Jul 15 22:41:36.561728 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:36.561677    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt" podStartSLOduration=2.061131647 podStartE2EDuration="2.561659808s" totalImagesPullingTime="500.528161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:41:36.560318423 +0000 UTC m=+1553.085341644" watchObservedRunningTime="2026-07-15 22:41:36.561659808 +0000 UTC m=+1553.086683027"
Jul 15 22:41:37.546411 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:37.546371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:43.564026 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:43.563993    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:46.601269 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:46.601215    2580 generic.go:356] "Generic (PLEG): container finished" podID="39e43302-3efc-4312-8902-e81ea18574f9" containerID="642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67" exitCode=0
Jul 15 22:41:46.601721 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:46.601276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" event={"ID":"39e43302-3efc-4312-8902-e81ea18574f9","Type":"ContainerDied","Data":"642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67"}
Jul 15 22:41:46.601721 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:46.601639    2580 scope.go:117] "RemoveContainer" containerID="642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67"
Jul 15 22:41:46.602620 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:46.602593    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:41:46.602684 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:46.602662    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:41:46.602721 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:46.602692    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:41:47.608090 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:47.608055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" event={"ID":"39e43302-3efc-4312-8902-e81ea18574f9","Type":"ContainerStarted","Data":"760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805"}
Jul 15 22:41:48.478208 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:48.478171    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:48.479160 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:48.479133    2580 patch_prober.go:28] interesting pod/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 22:41:48.479275 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:48.479181    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 22:41:49.479103 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:49.479066    2580 patch_prober.go:28] interesting pod/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 22:41:49.479517 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:49.479135    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 22:41:49.904308 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:49.904212    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"]
Jul 15 22:41:49.904530 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:49.904506    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt" podUID="bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" containerName="maas-api" containerID="cri-o://743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a" gracePeriod=30
Jul 15 22:41:50.186575 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.186551    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:50.324466 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.324438    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjr8b\" (UniqueName: \"kubernetes.io/projected/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-kube-api-access-fjr8b\") pod \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") "
Jul 15 22:41:50.324646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.324474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls\") pod \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") "
Jul 15 22:41:50.324646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.324571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-openshift-service-ca\") pod \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\" (UID: \"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b\") "
Jul 15 22:41:50.324909 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.324883    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" (UID: "bc8cd6b6-b68b-495f-a719-9d1a19a1a42b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:41:50.326584 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.326552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" (UID: "bc8cd6b6-b68b-495f-a719-9d1a19a1a42b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:41:50.326698 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.326683    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-kube-api-access-fjr8b" (OuterVolumeSpecName: "kube-api-access-fjr8b") pod "bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" (UID: "bc8cd6b6-b68b-495f-a719-9d1a19a1a42b"). InnerVolumeSpecName "kube-api-access-fjr8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:41:50.426004 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.425979    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:41:50.426004 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.426004    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjr8b\" (UniqueName: \"kubernetes.io/projected/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-kube-api-access-fjr8b\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:41:50.426162 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.426015    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:41:50.478297 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.478268    2580 patch_prober.go:28] interesting pod/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 22:41:50.478433 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.478316    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 22:41:50.536727 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.536692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:50.624982 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.624944    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" containerID="743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a" exitCode=0
Jul 15 22:41:50.625177 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.624992    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"
Jul 15 22:41:50.625177 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.625020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt" event={"ID":"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b","Type":"ContainerDied","Data":"743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a"}
Jul 15 22:41:50.625177 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.625071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt" event={"ID":"bc8cd6b6-b68b-495f-a719-9d1a19a1a42b","Type":"ContainerDied","Data":"a00fb8903b04db596a61e1b3a0e140099871bd4c508d9e8dd82143f0e4f97519"}
Jul 15 22:41:50.625177 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.625098    2580 scope.go:117] "RemoveContainer" containerID="743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a"
Jul 15 22:41:50.635028 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.634938    2580 scope.go:117] "RemoveContainer" containerID="743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a"
Jul 15 22:41:50.635344 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:41:50.635228    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a\": container with ID starting with 743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a not found: ID does not exist" containerID="743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a"
Jul 15 22:41:50.635344 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.635283    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a"} err="failed to get container status \"743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a\": rpc error: code = NotFound desc = could not find container \"743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a\": container with ID starting with 743ec88b56af6a295916878b4006891ed3b6f3374333cbd1fa2ee675b98cb84a not found: ID does not exist"
Jul 15 22:41:50.653858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.653779    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"]
Jul 15 22:41:50.653858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:50.653823    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a0965552-7dd7b86496-22brt"]
Jul 15 22:41:51.478952 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:51.478912    2580 patch_prober.go:28] interesting pod/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 22:41:51.479132 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:51.479013    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 22:41:52.009852 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:52.009811    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" path="/var/lib/kubelet/pods/bc8cd6b6-b68b-495f-a719-9d1a19a1a42b/volumes"
Jul 15 22:41:52.482689 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:52.482661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:41:52.483695 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:41:52.483676    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:42:04.677367 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:04.677331    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"]
Jul 15 22:42:04.677894 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:04.677514    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy" containerID="cri-o://760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805" gracePeriod=30
Jul 15 22:42:05.203115 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.203077    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"]
Jul 15 22:42:05.203715 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.203698    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" containerName="maas-api"
Jul 15 22:42:05.203779 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.203719    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" containerName="maas-api"
Jul 15 22:42:05.203861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.203850    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc8cd6b6-b68b-495f-a719-9d1a19a1a42b" containerName="maas-api"
Jul 15 22:42:05.208552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.208530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.211730 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.211708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-abe03dff-gw-openshift-default-dockercfg-f2z84\""
Jul 15 22:42:05.221076 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.221053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"]
Jul 15 22:42:05.349051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-istio-token\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-envoy\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-data\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svgqj\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-kube-api-access-svgqj\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d563285-30d2-461c-9196-27c0bba77111-istio-podinfo\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d563285-30d2-461c-9196-27c0bba77111-istiod-ca-cert\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-certs\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-socket\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.349539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.349349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-credential-socket\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.450769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-envoy\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.450769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-data\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svgqj\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-kube-api-access-svgqj\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d563285-30d2-461c-9196-27c0bba77111-istio-podinfo\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d563285-30d2-461c-9196-27c0bba77111-istiod-ca-cert\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-certs\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-socket\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.450979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-credential-socket\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451373 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.451038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-istio-token\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451373 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.451205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-data\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451373 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.451314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-socket\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451373 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.451352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-certs\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451630 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.451608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-credential-socket\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.451830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.451806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d563285-30d2-461c-9196-27c0bba77111-istiod-ca-cert\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.453272 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.453184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-envoy\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.453411 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.453402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d563285-30d2-461c-9196-27c0bba77111-istio-podinfo\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.458939 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.458917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-istio-token\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.459124 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.459105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svgqj\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-kube-api-access-svgqj\") pod \"e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") " pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.520391 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.520369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:05.659024 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.658993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"]
Jul 15 22:42:05.660898 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:42:05.660864    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d563285_30d2_461c_9196_27c0bba77111.slice/crio-3903b6e310e08fbf59595515349d48829f01762f8e8306bb4a1aa3991ac12300 WatchSource:0}: Error finding container 3903b6e310e08fbf59595515349d48829f01762f8e8306bb4a1aa3991ac12300: Status 404 returned error can't find the container with id 3903b6e310e08fbf59595515349d48829f01762f8e8306bb4a1aa3991ac12300
Jul 15 22:42:05.663033 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.662999    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:42:05.663121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.663062    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:42:05.663121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.663089    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:42:05.699154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:05.699127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" event={"ID":"2d563285-30d2-461c-9196-27c0bba77111","Type":"ContainerStarted","Data":"3903b6e310e08fbf59595515349d48829f01762f8e8306bb4a1aa3991ac12300"}
Jul 15 22:42:06.705864 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.705828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" event={"ID":"2d563285-30d2-461c-9196-27c0bba77111","Type":"ContainerStarted","Data":"3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5"}
Jul 15 22:42:06.732683 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.732633    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" podStartSLOduration=1.732618545 podStartE2EDuration="1.732618545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:42:06.732152334 +0000 UTC m=+1583.257175566" watchObservedRunningTime="2026-07-15 22:42:06.732618545 +0000 UTC m=+1583.257641764"
Jul 15 22:42:06.815477 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.815446    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"]
Jul 15 22:42:06.819081 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.819060    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:06.835154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.835129    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-abe03dff-serving-cert\""
Jul 15 22:42:06.839189 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.839170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"]
Jul 15 22:42:06.966755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.966671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a52538-58a1-4842-973b-c13cc098e906-openshift-service-ca\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:06.966755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.966734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2b6t\" (UniqueName: \"kubernetes.io/projected/83a52538-58a1-4842-973b-c13cc098e906-kube-api-access-s2b6t\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:06.966935 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:06.966795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.067506 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.067479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2b6t\" (UniqueName: \"kubernetes.io/projected/83a52538-58a1-4842-973b-c13cc098e906-kube-api-access-s2b6t\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.067665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.067530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.067665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.067628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a52538-58a1-4842-973b-c13cc098e906-openshift-service-ca\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.067738 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:42:07.067712    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-serving-cert: secret "maas-api-e2e-migrate-abe03dff-serving-cert" not found
Jul 15 22:42:07.067795 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:42:07.067784    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls podName:83a52538-58a1-4842-973b-c13cc098e906 nodeName:}" failed. No retries permitted until 2026-07-15 22:42:07.567764382 +0000 UTC m=+1584.092787586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls") pod "maas-api-e2e-migrate-abe03dff-595df78c95-88n74" (UID: "83a52538-58a1-4842-973b-c13cc098e906") : secret "maas-api-e2e-migrate-abe03dff-serving-cert" not found
Jul 15 22:42:07.068235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.068218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a52538-58a1-4842-973b-c13cc098e906-openshift-service-ca\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.079269 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.079220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2b6t\" (UniqueName: \"kubernetes.io/projected/83a52538-58a1-4842-973b-c13cc098e906-kube-api-access-s2b6t\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.485964 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.485930    2580 patch_prober.go:28] interesting pod/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 22:42:07.486126 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.485990    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:42:07.521325 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.521284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:07.525813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.525791    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:07.571985 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.571961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.574326 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.574307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls\") pod \"maas-api-e2e-migrate-abe03dff-595df78c95-88n74\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:07.711765 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.711732    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:07.712665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.712645    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:07.729408 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:07.729378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:08.088908 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:08.088885    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"]
Jul 15 22:42:08.090795 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:42:08.090755    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a52538_58a1_4842_973b_c13cc098e906.slice/crio-815b45d27706ba36937d9684219f22a8fcf2719bf4f3faed7d14d94d16213472 WatchSource:0}: Error finding container 815b45d27706ba36937d9684219f22a8fcf2719bf4f3faed7d14d94d16213472: Status 404 returned error can't find the container with id 815b45d27706ba36937d9684219f22a8fcf2719bf4f3faed7d14d94d16213472
Jul 15 22:42:08.718201 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:08.718165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74" event={"ID":"83a52538-58a1-4842-973b-c13cc098e906","Type":"ContainerStarted","Data":"6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1"}
Jul 15 22:42:08.718582 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:08.718276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74" event={"ID":"83a52538-58a1-4842-973b-c13cc098e906","Type":"ContainerStarted","Data":"815b45d27706ba36937d9684219f22a8fcf2719bf4f3faed7d14d94d16213472"}
Jul 15 22:42:08.718582 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:08.718435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:08.737670 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:08.737623    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74" podStartSLOduration=2.276222987 podStartE2EDuration="2.737607098s" totalImagesPullingTime="461.384111ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:42:08.734825168 +0000 UTC m=+1585.259848417" watchObservedRunningTime="2026-07-15 22:42:08.737607098 +0000 UTC m=+1585.262630559"
Jul 15 22:42:09.931472 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:09.931444    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:42:10.093157 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093128    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39e43302-3efc-4312-8902-e81ea18574f9-istio-podinfo\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-istio-token\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-envoy\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093285    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-socket\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093470 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-credential-socket\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093470 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093376    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-data\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093470 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093405    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39e43302-3efc-4312-8902-e81ea18574f9-istiod-ca-cert\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093470 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093432    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-certs\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093470 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093461    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bwmn\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-kube-api-access-2bwmn\") pod \"39e43302-3efc-4312-8902-e81ea18574f9\" (UID: \"39e43302-3efc-4312-8902-e81ea18574f9\") "
Jul 15 22:42:10.093734 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093584    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:42:10.093816 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093793    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.093875 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093825    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:42:10.093875 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.093836    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39e43302-3efc-4312-8902-e81ea18574f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:42:10.094099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.094070    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:42:10.094512 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.094492    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:42:10.095572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.095540    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:42:10.095646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.095611    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-kube-api-access-2bwmn" (OuterVolumeSpecName: "kube-api-access-2bwmn") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "kube-api-access-2bwmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:42:10.095806 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.095785    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:42:10.095898 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.095791    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39e43302-3efc-4312-8902-e81ea18574f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39e43302-3efc-4312-8902-e81ea18574f9" (UID: "39e43302-3efc-4312-8902-e81ea18574f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:42:10.194955 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.194933    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.194955 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.194954    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.195095 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.194964    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39e43302-3efc-4312-8902-e81ea18574f9-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.195095 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.194971    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.195095 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.194980    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bwmn\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-kube-api-access-2bwmn\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.195095 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.194989    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39e43302-3efc-4312-8902-e81ea18574f9-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.195095 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.194997    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39e43302-3efc-4312-8902-e81ea18574f9-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.195095 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.195004    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39e43302-3efc-4312-8902-e81ea18574f9-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:10.730873 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.730840    2580 generic.go:356] "Generic (PLEG): container finished" podID="39e43302-3efc-4312-8902-e81ea18574f9" containerID="760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805" exitCode=0
Jul 15 22:42:10.731051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.730885    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"
Jul 15 22:42:10.731051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.730929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" event={"ID":"39e43302-3efc-4312-8902-e81ea18574f9","Type":"ContainerDied","Data":"760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805"}
Jul 15 22:42:10.731051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.730984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw" event={"ID":"39e43302-3efc-4312-8902-e81ea18574f9","Type":"ContainerDied","Data":"bbd9590deeba4da70000c5bd6cb6cddd49bb65abeeee77896eeb89e6f8f00eb7"}
Jul 15 22:42:10.731051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.731008    2580 scope.go:117] "RemoveContainer" containerID="760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805"
Jul 15 22:42:10.740610 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.740593    2580 scope.go:117] "RemoveContainer" containerID="642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67"
Jul 15 22:42:10.748684 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.748670    2580 scope.go:117] "RemoveContainer" containerID="760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805"
Jul 15 22:42:10.748931 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:42:10.748910    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805\": container with ID starting with 760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805 not found: ID does not exist" containerID="760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805"
Jul 15 22:42:10.749010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.748942    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805"} err="failed to get container status \"760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805\": rpc error: code = NotFound desc = could not find container \"760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805\": container with ID starting with 760ab7d2f54082986cc3cb0a0fc691272f265fde99bf272dc1c362bfe51bb805 not found: ID does not exist"
Jul 15 22:42:10.749010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.748966    2580 scope.go:117] "RemoveContainer" containerID="642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67"
Jul 15 22:42:10.749200 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:42:10.749182    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67\": container with ID starting with 642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67 not found: ID does not exist" containerID="642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67"
Jul 15 22:42:10.749263 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.749208    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67"} err="failed to get container status \"642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67\": rpc error: code = NotFound desc = could not find container \"642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67\": container with ID starting with 642fe7ac17c3c6dc0eeb10fd94cb217a52221aba92331e7de004e9a9562e8c67 not found: ID does not exist"
Jul 15 22:42:10.753213 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.753191    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"]
Jul 15 22:42:10.757836 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.757815    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a0965552-openshift-default-6dd99b796f-6lmmw"]
Jul 15 22:42:10.966842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.966808    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"]
Jul 15 22:42:10.967216 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.967203    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy"
Jul 15 22:42:10.967279 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.967218    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy"
Jul 15 22:42:10.967322 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.967311    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy"
Jul 15 22:42:10.967354 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.967328    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy"
Jul 15 22:42:10.971860 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.971843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"
Jul 15 22:42:10.974667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.974626    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:42:10.977527 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:10.977501    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"]
Jul 15 22:42:11.103059 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:11.102969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f9b402-db13-4fa6-bad9-f4b80f9b798a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh\" (UID: \"46f9b402-db13-4fa6-bad9-f4b80f9b798a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"
Jul 15 22:42:11.204301 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:11.204269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f9b402-db13-4fa6-bad9-f4b80f9b798a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh\" (UID: \"46f9b402-db13-4fa6-bad9-f4b80f9b798a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"
Jul 15 22:42:11.204885 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:11.204861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f9b402-db13-4fa6-bad9-f4b80f9b798a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh\" (UID: \"46f9b402-db13-4fa6-bad9-f4b80f9b798a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"
Jul 15 22:42:11.284053 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:11.284019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"
Jul 15 22:42:11.420783 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:11.420756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"]
Jul 15 22:42:11.423184 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:42:11.423147    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f9b402_db13_4fa6_bad9_f4b80f9b798a.slice/crio-bd7c8dddb987cb0d02b0d1f5a26c05f808c50506367513121016c7d6e81555ac WatchSource:0}: Error finding container bd7c8dddb987cb0d02b0d1f5a26c05f808c50506367513121016c7d6e81555ac: Status 404 returned error can't find the container with id bd7c8dddb987cb0d02b0d1f5a26c05f808c50506367513121016c7d6e81555ac
Jul 15 22:42:11.744839 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:11.744794    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" event={"ID":"46f9b402-db13-4fa6-bad9-f4b80f9b798a","Type":"ContainerStarted","Data":"bd7c8dddb987cb0d02b0d1f5a26c05f808c50506367513121016c7d6e81555ac"}
Jul 15 22:42:12.010834 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:12.010803    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39e43302-3efc-4312-8902-e81ea18574f9" path="/var/lib/kubelet/pods/39e43302-3efc-4312-8902-e81ea18574f9/volumes"
Jul 15 22:42:12.755020 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:12.754973    2580 generic.go:356] "Generic (PLEG): container finished" podID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerID="f59d124ee320c9e5ae48ba76e5b4e4fe43b564355f4eba3aa7db7070fc8d9f80" exitCode=7
Jul 15 22:42:12.755290 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:12.755085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" event={"ID":"46f9b402-db13-4fa6-bad9-f4b80f9b798a","Type":"ContainerDied","Data":"f59d124ee320c9e5ae48ba76e5b4e4fe43b564355f4eba3aa7db7070fc8d9f80"}
Jul 15 22:42:12.755915 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:12.755890    2580 scope.go:117] "RemoveContainer" containerID="f59d124ee320c9e5ae48ba76e5b4e4fe43b564355f4eba3aa7db7070fc8d9f80"
Jul 15 22:42:13.765277 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:13.765226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" event={"ID":"46f9b402-db13-4fa6-bad9-f4b80f9b798a","Type":"ContainerStarted","Data":"1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca"}
Jul 15 22:42:13.765576 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:13.765498    2580 scope.go:117] "RemoveContainer" containerID="1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca"
Jul 15 22:42:13.765797 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:42:13.765770    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh_odh-ai-gateway-infra(46f9b402-db13-4fa6-bad9-f4b80f9b798a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a"
Jul 15 22:42:14.730929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:14.730850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:42:14.774083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:14.774043    2580 generic.go:356] "Generic (PLEG): container finished" podID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerID="1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca" exitCode=7
Jul 15 22:42:14.774538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:14.774091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" event={"ID":"46f9b402-db13-4fa6-bad9-f4b80f9b798a","Type":"ContainerDied","Data":"1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca"}
Jul 15 22:42:14.774538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:14.774156    2580 scope.go:117] "RemoveContainer" containerID="f59d124ee320c9e5ae48ba76e5b4e4fe43b564355f4eba3aa7db7070fc8d9f80"
Jul 15 22:42:14.774538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:14.774320    2580 scope.go:117] "RemoveContainer" containerID="1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca"
Jul 15 22:42:14.774732 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:42:14.774577    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh_odh-ai-gateway-infra(46f9b402-db13-4fa6-bad9-f4b80f9b798a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a"
Jul 15 22:42:15.781319 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:15.781283    2580 scope.go:117] "RemoveContainer" containerID="1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca"
Jul 15 22:42:15.781785 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:42:15.781537    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh_odh-ai-gateway-infra(46f9b402-db13-4fa6-bad9-f4b80f9b798a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a"
Jul 15 22:42:19.803616 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:19.803533    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d563285-30d2-461c-9196-27c0bba77111" containerID="3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5" exitCode=0
Jul 15 22:42:19.803616 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:19.803603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" event={"ID":"2d563285-30d2-461c-9196-27c0bba77111","Type":"ContainerDied","Data":"3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5"}
Jul 15 22:42:19.804064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:19.804008    2580 scope.go:117] "RemoveContainer" containerID="3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5"
Jul 15 22:42:19.804924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:19.804898    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:42:19.804975 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:19.804963    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:42:19.805012 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:19.804994    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:42:20.810174 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:20.810134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" event={"ID":"2d563285-30d2-461c-9196-27c0bba77111","Type":"ContainerStarted","Data":"d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1"}
Jul 15 22:42:21.521498 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:21.521465    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:21.522592 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:21.522564    2580 patch_prober.go:28] interesting pod/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 22:42:21.522717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:21.522613    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 22:42:22.521351 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:22.521314    2580 patch_prober.go:28] interesting pod/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 22:42:22.521759 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:22.521369    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 22:42:22.712094 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:22.712038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:23.521074 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:23.521040    2580 patch_prober.go:28] interesting pod/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 22:42:23.521266 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:23.521092    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 22:42:24.524293 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:24.524260    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:24.525163 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:24.525145    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:42:31.004436 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:31.004408    2580 scope.go:117] "RemoveContainer" containerID="1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca"
Jul 15 22:42:31.865038 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:31.865006    2580 generic.go:356] "Generic (PLEG): container finished" podID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerID="174ab12aa9dddf23d3d223a6804073f32378577ac8dfab74869ae51355672f40" exitCode=0
Jul 15 22:42:31.865171 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:31.865079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" event={"ID":"46f9b402-db13-4fa6-bad9-f4b80f9b798a","Type":"ContainerDied","Data":"174ab12aa9dddf23d3d223a6804073f32378577ac8dfab74869ae51355672f40"}
Jul 15 22:42:31.865171 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:31.865146    2580 scope.go:117] "RemoveContainer" containerID="1670463333df6bbff13dbdd166223c6c911383a79391a722239f496848eefeca"
Jul 15 22:42:32.899282 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:32.899222    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"]
Jul 15 22:42:33.007205 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.007178    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"
Jul 15 22:42:33.125309 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.125221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f9b402-db13-4fa6-bad9-f4b80f9b798a-maas-api-service-ca\") pod \"46f9b402-db13-4fa6-bad9-f4b80f9b798a\" (UID: \"46f9b402-db13-4fa6-bad9-f4b80f9b798a\") "
Jul 15 22:42:33.125661 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.125632    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f9b402-db13-4fa6-bad9-f4b80f9b798a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46f9b402-db13-4fa6-bad9-f4b80f9b798a" (UID: "46f9b402-db13-4fa6-bad9-f4b80f9b798a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:42:33.125828 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.125748    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46f9b402-db13-4fa6-bad9-f4b80f9b798a-maas-api-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:42:33.881842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.881815    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"
Jul 15 22:42:33.881842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.881836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh" event={"ID":"46f9b402-db13-4fa6-bad9-f4b80f9b798a","Type":"ContainerDied","Data":"bd7c8dddb987cb0d02b0d1f5a26c05f808c50506367513121016c7d6e81555ac"}
Jul 15 22:42:33.882052 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.881884    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd7c8dddb987cb0d02b0d1f5a26c05f808c50506367513121016c7d6e81555ac"
Jul 15 22:42:33.912338 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.912307    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"]
Jul 15 22:42:33.917560 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:33.917535    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-b68dh"]
Jul 15 22:42:34.010434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:42:34.010408    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" path="/var/lib/kubelet/pods/46f9b402-db13-4fa6-bad9-f4b80f9b798a/volumes"
Jul 15 22:43:11.085485 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:11.085448    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"]
Jul 15 22:43:11.085920 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:11.085666    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy" containerID="cri-o://d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1" gracePeriod=30
Jul 15 22:43:16.347314 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.347256    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:43:16.500060 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-certs\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500060 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-envoy\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500345 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500089    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-istio-token\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500345 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500116    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d563285-30d2-461c-9196-27c0bba77111-istio-podinfo\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500345 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500205    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d563285-30d2-461c-9196-27c0bba77111-istiod-ca-cert\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500345 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-data\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500345 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svgqj\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-kube-api-access-svgqj\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500345 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500345    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-credential-socket\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500653 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500379    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:43:16.500653 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-socket\") pod \"2d563285-30d2-461c-9196-27c0bba77111\" (UID: \"2d563285-30d2-461c-9196-27c0bba77111\") "
Jul 15 22:43:16.500653 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500590    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:43:16.500806 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500734    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.500806 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500752    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.500806 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.500756    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:43:16.501395 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.501358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:43:16.501507 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.501454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d563285-30d2-461c-9196-27c0bba77111-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:43:16.502413 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.502390    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:43:16.502500 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.502479    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-kube-api-access-svgqj" (OuterVolumeSpecName: "kube-api-access-svgqj") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "kube-api-access-svgqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:43:16.502671 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.502655    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d563285-30d2-461c-9196-27c0bba77111-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:43:16.502717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.502677    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d563285-30d2-461c-9196-27c0bba77111" (UID: "2d563285-30d2-461c-9196-27c0bba77111"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:43:16.602023 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.601939    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.602023 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.601967    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.602023 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.601978    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d563285-30d2-461c-9196-27c0bba77111-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.602023 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.601986    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d563285-30d2-461c-9196-27c0bba77111-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.602023 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.601993    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.602023 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.602001    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svgqj\" (UniqueName: \"kubernetes.io/projected/2d563285-30d2-461c-9196-27c0bba77111-kube-api-access-svgqj\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.602023 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:16.602010    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d563285-30d2-461c-9196-27c0bba77111-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:17.039175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.039138    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"]
Jul 15 22:43:17.039397 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.039364    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74" podUID="83a52538-58a1-4842-973b-c13cc098e906" containerName="maas-api" containerID="cri-o://6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1" gracePeriod=30
Jul 15 22:43:17.097634 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.097601    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d563285-30d2-461c-9196-27c0bba77111" containerID="d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1" exitCode=0
Jul 15 22:43:17.097801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.097664    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"
Jul 15 22:43:17.097801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.097693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" event={"ID":"2d563285-30d2-461c-9196-27c0bba77111","Type":"ContainerDied","Data":"d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1"}
Jul 15 22:43:17.097801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.097748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg" event={"ID":"2d563285-30d2-461c-9196-27c0bba77111","Type":"ContainerDied","Data":"3903b6e310e08fbf59595515349d48829f01762f8e8306bb4a1aa3991ac12300"}
Jul 15 22:43:17.097801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.097776    2580 scope.go:117] "RemoveContainer" containerID="d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1"
Jul 15 22:43:17.136892 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.136858    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"]
Jul 15 22:43:17.151943 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.151920    2580 scope.go:117] "RemoveContainer" containerID="3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5"
Jul 15 22:43:17.155444 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.155420    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-abe03dff-gw-openshift-default-65c648f99-t6svg"]
Jul 15 22:43:17.162121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.162094    2580 scope.go:117] "RemoveContainer" containerID="d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1"
Jul 15 22:43:17.162429 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:43:17.162405    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1\": container with ID starting with d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1 not found: ID does not exist" containerID="d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1"
Jul 15 22:43:17.162538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.162435    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1"} err="failed to get container status \"d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1\": rpc error: code = NotFound desc = could not find container \"d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1\": container with ID starting with d1f56511285bac36543d8920721f8359cde3f1c58ebf65d7bb3809e88b94fbd1 not found: ID does not exist"
Jul 15 22:43:17.162538 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.162453    2580 scope.go:117] "RemoveContainer" containerID="3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5"
Jul 15 22:43:17.162749 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:43:17.162729    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5\": container with ID starting with 3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5 not found: ID does not exist" containerID="3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5"
Jul 15 22:43:17.162813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.162753    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5"} err="failed to get container status \"3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5\": rpc error: code = NotFound desc = could not find container \"3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5\": container with ID starting with 3dc4b4ce27422d9b06e0f827b210159279d871e82798dffcb69bdef24335a7f5 not found: ID does not exist"
Jul 15 22:43:17.292364 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.292306    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:43:17.408212 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.408165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls\") pod \"83a52538-58a1-4842-973b-c13cc098e906\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") "
Jul 15 22:43:17.408678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.408272    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a52538-58a1-4842-973b-c13cc098e906-openshift-service-ca\") pod \"83a52538-58a1-4842-973b-c13cc098e906\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") "
Jul 15 22:43:17.408678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.408310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2b6t\" (UniqueName: \"kubernetes.io/projected/83a52538-58a1-4842-973b-c13cc098e906-kube-api-access-s2b6t\") pod \"83a52538-58a1-4842-973b-c13cc098e906\" (UID: \"83a52538-58a1-4842-973b-c13cc098e906\") "
Jul 15 22:43:17.408678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.408642    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83a52538-58a1-4842-973b-c13cc098e906-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83a52538-58a1-4842-973b-c13cc098e906" (UID: "83a52538-58a1-4842-973b-c13cc098e906"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:43:17.410283 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.410256    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83a52538-58a1-4842-973b-c13cc098e906" (UID: "83a52538-58a1-4842-973b-c13cc098e906"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:43:17.410354 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.410312    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a52538-58a1-4842-973b-c13cc098e906-kube-api-access-s2b6t" (OuterVolumeSpecName: "kube-api-access-s2b6t") pod "83a52538-58a1-4842-973b-c13cc098e906" (UID: "83a52538-58a1-4842-973b-c13cc098e906"). InnerVolumeSpecName "kube-api-access-s2b6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:43:17.509954 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.509921    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a52538-58a1-4842-973b-c13cc098e906-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:17.509954 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.509949    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a52538-58a1-4842-973b-c13cc098e906-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:17.509954 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:17.509957    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2b6t\" (UniqueName: \"kubernetes.io/projected/83a52538-58a1-4842-973b-c13cc098e906-kube-api-access-s2b6t\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:43:18.010674 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.010641    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d563285-30d2-461c-9196-27c0bba77111" path="/var/lib/kubelet/pods/2d563285-30d2-461c-9196-27c0bba77111/volumes"
Jul 15 22:43:18.104489 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.104399    2580 generic.go:356] "Generic (PLEG): container finished" podID="83a52538-58a1-4842-973b-c13cc098e906" containerID="6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1" exitCode=0
Jul 15 22:43:18.104489 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.104451    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"
Jul 15 22:43:18.104489 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.104464    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74" event={"ID":"83a52538-58a1-4842-973b-c13cc098e906","Type":"ContainerDied","Data":"6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1"}
Jul 15 22:43:18.104766 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.104505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74" event={"ID":"83a52538-58a1-4842-973b-c13cc098e906","Type":"ContainerDied","Data":"815b45d27706ba36937d9684219f22a8fcf2719bf4f3faed7d14d94d16213472"}
Jul 15 22:43:18.104766 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.104525    2580 scope.go:117] "RemoveContainer" containerID="6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1"
Jul 15 22:43:18.113084 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.113043    2580 scope.go:117] "RemoveContainer" containerID="6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1"
Jul 15 22:43:18.113335 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:43:18.113313    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1\": container with ID starting with 6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1 not found: ID does not exist" containerID="6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1"
Jul 15 22:43:18.113430 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.113364    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1"} err="failed to get container status \"6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1\": rpc error: code = NotFound desc = could not find container \"6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1\": container with ID starting with 6e1e98f52561dfef969c6e9e5aadc30b8f763be911bb8eaf1f1969f4783640c1 not found: ID does not exist"
Jul 15 22:43:18.120777 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.120732    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"]
Jul 15 22:43:18.123035 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:18.123015    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-abe03dff-595df78c95-88n74"]
Jul 15 22:43:20.010107 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:20.010047    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83a52538-58a1-4842-973b-c13cc098e906" path="/var/lib/kubelet/pods/83a52538-58a1-4842-973b-c13cc098e906/volumes"
Jul 15 22:43:22.926840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.926511    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"]
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927079    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy"
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927099    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy"
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927121    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy"
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927129    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy"
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927144    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927152    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927174    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy"
Jul 15 22:43:22.927181 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927183    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e43302-3efc-4312-8902-e81ea18574f9" containerName="istio-proxy"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927196    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927204    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927221    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a52538-58a1-4842-973b-c13cc098e906" containerName="maas-api"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927230    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a52538-58a1-4842-973b-c13cc098e906" containerName="maas-api"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927373    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927386    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d563285-30d2-461c-9196-27c0bba77111" containerName="istio-proxy"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927396    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927410    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:22.927583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.927418    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a52538-58a1-4842-973b-c13cc098e906" containerName="maas-api"
Jul 15 22:43:22.931955 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.931935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:22.934936 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.934917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7ab2faa6-openshift-default-dockercfg-7rlnt\""
Jul 15 22:43:22.942855 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:22.942835    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"]
Jul 15 22:43:23.063725 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.063692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-socket\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.063725 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.063727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-data\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.063929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.063798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-credential-socket\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.063929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.063823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-envoy\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.063929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.063896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8792cac-2705-4c86-ab19-d1083fadc985-istio-podinfo\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.063929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.063921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-certs\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.064054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.063978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8792cac-2705-4c86-ab19-d1083fadc985-istiod-ca-cert\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.064054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.064013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-istio-token\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.064054 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.064033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qvd\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-kube-api-access-s2qvd\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8792cac-2705-4c86-ab19-d1083fadc985-istiod-ca-cert\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-istio-token\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2qvd\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-kube-api-access-s2qvd\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-socket\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-data\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-credential-socket\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-envoy\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.165678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8792cac-2705-4c86-ab19-d1083fadc985-istio-podinfo\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.166037 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-certs\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.166037 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.165991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-socket\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.166037 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.166017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-data\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.166199 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.166147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-credential-socket\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.166199 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.166186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-certs\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.166443 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.166416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8792cac-2705-4c86-ab19-d1083fadc985-istiod-ca-cert\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.167995 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.167972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-envoy\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.168322 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.168304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8792cac-2705-4c86-ab19-d1083fadc985-istio-podinfo\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.174093 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.174072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2qvd\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-kube-api-access-s2qvd\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.174598 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.174579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-istio-token\") pod \"e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") " pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.244585 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.244528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:23.381769 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.381739    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"]
Jul 15 22:43:23.383890 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:43:23.383861    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8792cac_2705_4c86_ab19_d1083fadc985.slice/crio-80d64343c98523501b20982663ec8c45ba083206071b213287885d5bca0034f2 WatchSource:0}: Error finding container 80d64343c98523501b20982663ec8c45ba083206071b213287885d5bca0034f2: Status 404 returned error can't find the container with id 80d64343c98523501b20982663ec8c45ba083206071b213287885d5bca0034f2
Jul 15 22:43:23.385970 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.385926    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:43:23.386063 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.386009    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:43:23.386063 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:23.386038    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:43:24.135024 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.134991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" event={"ID":"f8792cac-2705-4c86-ab19-d1083fadc985","Type":"ContainerStarted","Data":"577495e5e3d5c2a50fb81939ce94115737b446e9de1b936787a397c0658cf582"}
Jul 15 22:43:24.135423 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.135045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" event={"ID":"f8792cac-2705-4c86-ab19-d1083fadc985","Type":"ContainerStarted","Data":"80d64343c98523501b20982663ec8c45ba083206071b213287885d5bca0034f2"}
Jul 15 22:43:24.180799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.180750    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" podStartSLOduration=2.180734994 podStartE2EDuration="2.180734994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:43:24.174527312 +0000 UTC m=+1660.699550569" watchObservedRunningTime="2026-07-15 22:43:24.180734994 +0000 UTC m=+1660.705758213"
Jul 15 22:43:24.245611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.245577    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:24.246747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.246686    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"]
Jul 15 22:43:24.247307 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.247284    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:24.247307 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.247304    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:24.247501 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.247396    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f9b402-db13-4fa6-bad9-f4b80f9b798a" containerName="revoke-keys"
Jul 15 22:43:24.250816 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.250792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.251307 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.251289    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:24.253747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.253725    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7ab2faa6-serving-cert\""
Jul 15 22:43:24.261096 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.261074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"]
Jul 15 22:43:24.377790 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.377755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e5dad9-7003-4515-90b0-fbd05f703287-openshift-service-ca\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.377957 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.377861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdg2d\" (UniqueName: \"kubernetes.io/projected/01e5dad9-7003-4515-90b0-fbd05f703287-kube-api-access-cdg2d\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.377957 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.377932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e5dad9-7003-4515-90b0-fbd05f703287-maas-api-tls\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.479158 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.479121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e5dad9-7003-4515-90b0-fbd05f703287-openshift-service-ca\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.479379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.479207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdg2d\" (UniqueName: \"kubernetes.io/projected/01e5dad9-7003-4515-90b0-fbd05f703287-kube-api-access-cdg2d\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.479379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.479304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e5dad9-7003-4515-90b0-fbd05f703287-maas-api-tls\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.479879 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.479853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e5dad9-7003-4515-90b0-fbd05f703287-openshift-service-ca\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.481600 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.481581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e5dad9-7003-4515-90b0-fbd05f703287-maas-api-tls\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.496154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.496127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdg2d\" (UniqueName: \"kubernetes.io/projected/01e5dad9-7003-4515-90b0-fbd05f703287-kube-api-access-cdg2d\") pod \"maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.563698 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.563672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:24.723713 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:24.723689    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"]
Jul 15 22:43:24.725069 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:43:24.725042    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e5dad9_7003_4515_90b0_fbd05f703287.slice/crio-78df3a037f9d5a2ca2da0ba78ae31eecfa02cc7439f702f189d13661b91e6834 WatchSource:0}: Error finding container 78df3a037f9d5a2ca2da0ba78ae31eecfa02cc7439f702f189d13661b91e6834: Status 404 returned error can't find the container with id 78df3a037f9d5a2ca2da0ba78ae31eecfa02cc7439f702f189d13661b91e6834
Jul 15 22:43:25.141346 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:25.141315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn" event={"ID":"01e5dad9-7003-4515-90b0-fbd05f703287","Type":"ContainerStarted","Data":"48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d"}
Jul 15 22:43:25.141849 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:25.141700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:25.141849 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:25.141747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn" event={"ID":"01e5dad9-7003-4515-90b0-fbd05f703287","Type":"ContainerStarted","Data":"78df3a037f9d5a2ca2da0ba78ae31eecfa02cc7439f702f189d13661b91e6834"}
Jul 15 22:43:25.141849 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:25.141811    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:25.142914 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:25.142888    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:25.164496 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:25.164459    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn" podStartSLOduration=0.842928003 podStartE2EDuration="1.164442753s" totalImagesPullingTime="321.51475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:43:25.16226494 +0000 UTC m=+1661.687288151" watchObservedRunningTime="2026-07-15 22:43:25.164442753 +0000 UTC m=+1661.689465973"
Jul 15 22:43:32.158476 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:32.158441    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:43:35.201096 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:35.201062    2580 generic.go:356] "Generic (PLEG): container finished" podID="f8792cac-2705-4c86-ab19-d1083fadc985" containerID="577495e5e3d5c2a50fb81939ce94115737b446e9de1b936787a397c0658cf582" exitCode=0
Jul 15 22:43:35.201603 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:35.201130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" event={"ID":"f8792cac-2705-4c86-ab19-d1083fadc985","Type":"ContainerDied","Data":"577495e5e3d5c2a50fb81939ce94115737b446e9de1b936787a397c0658cf582"}
Jul 15 22:43:35.201603 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:35.201559    2580 scope.go:117] "RemoveContainer" containerID="577495e5e3d5c2a50fb81939ce94115737b446e9de1b936787a397c0658cf582"
Jul 15 22:43:35.202570 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:35.202537    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:43:35.202676 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:35.202606    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:43:35.202676 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:35.202640    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:43:36.208051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:36.208014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" event={"ID":"f8792cac-2705-4c86-ab19-d1083fadc985","Type":"ContainerStarted","Data":"f1543339852283a223397fdd60ae41edb39bffca1e7ac96a6a21cd91b26a5883"}
Jul 15 22:43:36.245039 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:36.244996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:36.246830 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:36.246793    2580 patch_prober.go:28] interesting pod/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 22:43:36.247077 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:36.247049    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 22:43:37.245687 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:37.245649    2580 patch_prober.go:28] interesting pod/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 22:43:37.246314 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:37.246282    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 22:43:38.245438 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:38.245395    2580 patch_prober.go:28] interesting pod/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 22:43:38.245741 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:38.245707    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 22:43:39.246037 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:39.245996    2580 patch_prober.go:28] interesting pod/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 22:43:39.246673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:39.246633    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 22:43:40.142305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:40.142261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:40.249400 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:40.249366    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:43:40.250353 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:43:40.250336    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:44:30.093122 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.093087    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"]
Jul 15 22:44:30.093733 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.093356    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn" podUID="01e5dad9-7003-4515-90b0-fbd05f703287" containerName="maas-api" containerID="cri-o://48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d" gracePeriod=30
Jul 15 22:44:30.353531 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.353471    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:44:30.401664 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.401635    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdg2d\" (UniqueName: \"kubernetes.io/projected/01e5dad9-7003-4515-90b0-fbd05f703287-kube-api-access-cdg2d\") pod \"01e5dad9-7003-4515-90b0-fbd05f703287\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") "
Jul 15 22:44:30.401855 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.401695    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e5dad9-7003-4515-90b0-fbd05f703287-openshift-service-ca\") pod \"01e5dad9-7003-4515-90b0-fbd05f703287\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") "
Jul 15 22:44:30.401855 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.401718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e5dad9-7003-4515-90b0-fbd05f703287-maas-api-tls\") pod \"01e5dad9-7003-4515-90b0-fbd05f703287\" (UID: \"01e5dad9-7003-4515-90b0-fbd05f703287\") "
Jul 15 22:44:30.402076 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.402049    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e5dad9-7003-4515-90b0-fbd05f703287-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01e5dad9-7003-4515-90b0-fbd05f703287" (UID: "01e5dad9-7003-4515-90b0-fbd05f703287"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:44:30.403874 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.403849    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01e5dad9-7003-4515-90b0-fbd05f703287-kube-api-access-cdg2d" (OuterVolumeSpecName: "kube-api-access-cdg2d") pod "01e5dad9-7003-4515-90b0-fbd05f703287" (UID: "01e5dad9-7003-4515-90b0-fbd05f703287"). InnerVolumeSpecName "kube-api-access-cdg2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:44:30.403968 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.403852    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01e5dad9-7003-4515-90b0-fbd05f703287-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01e5dad9-7003-4515-90b0-fbd05f703287" (UID: "01e5dad9-7003-4515-90b0-fbd05f703287"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:44:30.478913 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.478875    2580 generic.go:356] "Generic (PLEG): container finished" podID="01e5dad9-7003-4515-90b0-fbd05f703287" containerID="48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d" exitCode=0
Jul 15 22:44:30.479064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.478928    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"
Jul 15 22:44:30.479064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.478961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn" event={"ID":"01e5dad9-7003-4515-90b0-fbd05f703287","Type":"ContainerDied","Data":"48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d"}
Jul 15 22:44:30.479064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.479020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn" event={"ID":"01e5dad9-7003-4515-90b0-fbd05f703287","Type":"ContainerDied","Data":"78df3a037f9d5a2ca2da0ba78ae31eecfa02cc7439f702f189d13661b91e6834"}
Jul 15 22:44:30.479064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.479042    2580 scope.go:117] "RemoveContainer" containerID="48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d"
Jul 15 22:44:30.490864 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.490842    2580 scope.go:117] "RemoveContainer" containerID="48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d"
Jul 15 22:44:30.491120 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:44:30.491100    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d\": container with ID starting with 48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d not found: ID does not exist" containerID="48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d"
Jul 15 22:44:30.491180 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.491129    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d"} err="failed to get container status \"48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d\": rpc error: code = NotFound desc = could not find container \"48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d\": container with ID starting with 48b81b9b1e78effe21e92920ae157e0c1d1b2fb021639801b5fc3135a25f576d not found: ID does not exist"
Jul 15 22:44:30.502685 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.502661    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdg2d\" (UniqueName: \"kubernetes.io/projected/01e5dad9-7003-4515-90b0-fbd05f703287-kube-api-access-cdg2d\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:30.502685 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.502686    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01e5dad9-7003-4515-90b0-fbd05f703287-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:30.502819 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.502700    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01e5dad9-7003-4515-90b0-fbd05f703287-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:30.507939 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.507914    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"]
Jul 15 22:44:30.514457 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:30.514434    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7ab2faa6-78b545c6fc-bkgnn"]
Jul 15 22:44:32.010559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:32.010525    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01e5dad9-7003-4515-90b0-fbd05f703287" path="/var/lib/kubelet/pods/01e5dad9-7003-4515-90b0-fbd05f703287/volumes"
Jul 15 22:44:45.403866 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.403832    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"]
Jul 15 22:44:45.404323 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.404030    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy" containerID="cri-o://f1543339852283a223397fdd60ae41edb39bffca1e7ac96a6a21cd91b26a5883" gracePeriod=30
Jul 15 22:44:45.772818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.772777    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"]
Jul 15 22:44:45.773174 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.773159    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01e5dad9-7003-4515-90b0-fbd05f703287" containerName="maas-api"
Jul 15 22:44:45.773174 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.773173    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e5dad9-7003-4515-90b0-fbd05f703287" containerName="maas-api"
Jul 15 22:44:45.773370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.773272    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01e5dad9-7003-4515-90b0-fbd05f703287" containerName="maas-api"
Jul 15 22:44:45.776302 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.776280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.779889 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.779868    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bf7f9845-openshift-default-dockercfg-sl64d\""
Jul 15 22:44:45.795508 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.795484    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"]
Jul 15 22:44:45.843358 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-data\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-credential-socket\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-socket\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfbsv\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-kube-api-access-xfbsv\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843510 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-certs\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843683 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-envoy\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843683 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-podinfo\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843683 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/185e9da1-6a55-4cee-93db-81a1583bf1ad-istiod-ca-cert\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.843791 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.843685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-token\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.944901 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.944865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-envoy\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945086 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.944908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-podinfo\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945086 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.944925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/185e9da1-6a55-4cee-93db-81a1583bf1ad-istiod-ca-cert\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945086 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.944961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-token\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945086 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.944996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-data\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945086 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-credential-socket\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945086 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-socket\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945439 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfbsv\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-kube-api-access-xfbsv\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945439 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-certs\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945556 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-socket\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945556 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-credential-socket\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945668 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-data\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945668 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-certs\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.945774 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.945733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/185e9da1-6a55-4cee-93db-81a1583bf1ad-istiod-ca-cert\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.947160 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.947127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-envoy\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.947878 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.947857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-podinfo\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.954404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.954384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-token\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:45.956927 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:45.956904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfbsv\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-kube-api-access-xfbsv\") pod \"e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") " pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:46.089801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.089718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:46.231665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.231638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"]
Jul 15 22:44:46.233561 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:44:46.233532    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185e9da1_6a55_4cee_93db_81a1583bf1ad.slice/crio-3df6d44522a887a21642d52064dec8a9b2f04dc0c3f152e9edea45df20b18f17 WatchSource:0}: Error finding container 3df6d44522a887a21642d52064dec8a9b2f04dc0c3f152e9edea45df20b18f17: Status 404 returned error can't find the container with id 3df6d44522a887a21642d52064dec8a9b2f04dc0c3f152e9edea45df20b18f17
Jul 15 22:44:46.235757 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.235726    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:44:46.235826 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.235789    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:44:46.235826 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.235820    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:44:46.563258 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.563216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" event={"ID":"185e9da1-6a55-4cee-93db-81a1583bf1ad","Type":"ContainerStarted","Data":"4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53"}
Jul 15 22:44:46.563745 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.563289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" event={"ID":"185e9da1-6a55-4cee-93db-81a1583bf1ad","Type":"ContainerStarted","Data":"3df6d44522a887a21642d52064dec8a9b2f04dc0c3f152e9edea45df20b18f17"}
Jul 15 22:44:46.594307 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:46.594225    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podStartSLOduration=1.594210541 podStartE2EDuration="1.594210541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:44:46.591217254 +0000 UTC m=+1743.116240473" watchObservedRunningTime="2026-07-15 22:44:46.594210541 +0000 UTC m=+1743.119233761"
Jul 15 22:44:47.090744 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.090705    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:47.095511 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.095488    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:47.216901 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.216867    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"]
Jul 15 22:44:47.224320 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.221760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.227735 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.225986    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-bf7f9845-serving-cert\""
Jul 15 22:44:47.237985 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.237960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"]
Jul 15 22:44:47.360333 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.360224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdbb49c-3918-4b99-82ec-e968c210ef1f-openshift-service-ca\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.360487 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.360376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbdbb49c-3918-4b99-82ec-e968c210ef1f-maas-api-tls\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.360487 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.360419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt52v\" (UniqueName: \"kubernetes.io/projected/dbdbb49c-3918-4b99-82ec-e968c210ef1f-kube-api-access-zt52v\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.461146 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.461111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdbb49c-3918-4b99-82ec-e968c210ef1f-openshift-service-ca\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.461383 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.461214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbdbb49c-3918-4b99-82ec-e968c210ef1f-maas-api-tls\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.461383 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.461279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt52v\" (UniqueName: \"kubernetes.io/projected/dbdbb49c-3918-4b99-82ec-e968c210ef1f-kube-api-access-zt52v\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.461911 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.461889    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdbb49c-3918-4b99-82ec-e968c210ef1f-openshift-service-ca\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.463652 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.463635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbdbb49c-3918-4b99-82ec-e968c210ef1f-maas-api-tls\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.487427 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.487397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt52v\" (UniqueName: \"kubernetes.io/projected/dbdbb49c-3918-4b99-82ec-e968c210ef1f-kube-api-access-zt52v\") pod \"maas-api-e2e-derive-bf7f9845-d4698948c-jb65l\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.536520 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.536485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:47.569994 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.569971    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:47.571083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.571064    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:44:47.711092 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:47.711063    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"]
Jul 15 22:44:47.712916 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:44:47.712888    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdbb49c_3918_4b99_82ec_e968c210ef1f.slice/crio-34cc8cebeb293a07e532681f2058de0e1cc0fcc359ceffd34c727f39e3656993 WatchSource:0}: Error finding container 34cc8cebeb293a07e532681f2058de0e1cc0fcc359ceffd34c727f39e3656993: Status 404 returned error can't find the container with id 34cc8cebeb293a07e532681f2058de0e1cc0fcc359ceffd34c727f39e3656993
Jul 15 22:44:48.576494 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:48.576405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l" event={"ID":"dbdbb49c-3918-4b99-82ec-e968c210ef1f","Type":"ContainerStarted","Data":"84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47"}
Jul 15 22:44:48.576494 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:48.576470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l" event={"ID":"dbdbb49c-3918-4b99-82ec-e968c210ef1f","Type":"ContainerStarted","Data":"34cc8cebeb293a07e532681f2058de0e1cc0fcc359ceffd34c727f39e3656993"}
Jul 15 22:44:48.576939 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:48.576701    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:44:48.615007 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:48.614963    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l" podStartSLOduration=1.092018447 podStartE2EDuration="1.614948206s" totalImagesPullingTime="522.929759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:44:48.612434056 +0000 UTC m=+1745.137457276" watchObservedRunningTime="2026-07-15 22:44:48.614948206 +0000 UTC m=+1745.139971477"
Jul 15 22:44:50.588946 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.588913    2580 generic.go:356] "Generic (PLEG): container finished" podID="f8792cac-2705-4c86-ab19-d1083fadc985" containerID="f1543339852283a223397fdd60ae41edb39bffca1e7ac96a6a21cd91b26a5883" exitCode=0
Jul 15 22:44:50.589404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.588979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" event={"ID":"f8792cac-2705-4c86-ab19-d1083fadc985","Type":"ContainerDied","Data":"f1543339852283a223397fdd60ae41edb39bffca1e7ac96a6a21cd91b26a5883"}
Jul 15 22:44:50.589404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.589037    2580 scope.go:117] "RemoveContainer" containerID="577495e5e3d5c2a50fb81939ce94115737b446e9de1b936787a397c0658cf582"
Jul 15 22:44:50.663929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.663875    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:44:50.794364 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794331    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-credential-socket\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794501 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794395    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-envoy\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794501 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794419    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-data\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794501 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794457    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-certs\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794643 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794522    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2qvd\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-kube-api-access-s2qvd\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794643 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8792cac-2705-4c86-ab19-d1083fadc985-istiod-ca-cert\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794643 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8792cac-2705-4c86-ab19-d1083fadc985-istio-podinfo\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794643 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794616    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-istio-token\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794844 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794632    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:44:50.794844 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-socket\") pod \"f8792cac-2705-4c86-ab19-d1083fadc985\" (UID: \"f8792cac-2705-4c86-ab19-d1083fadc985\") "
Jul 15 22:44:50.794844 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.794822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:44:50.795022 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.795002    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.795079 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.795014    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:44:50.795079 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.795026    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.795228 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.795206    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8792cac-2705-4c86-ab19-d1083fadc985-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:44:50.795384 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.795361    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:44:50.796884 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.796841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:44:50.797006 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.796979    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:44:50.797070 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.797034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8792cac-2705-4c86-ab19-d1083fadc985-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:44:50.797680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.797186    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-kube-api-access-s2qvd" (OuterVolumeSpecName: "kube-api-access-s2qvd") pod "f8792cac-2705-4c86-ab19-d1083fadc985" (UID: "f8792cac-2705-4c86-ab19-d1083fadc985"). InnerVolumeSpecName "kube-api-access-s2qvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:44:50.895960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.895923    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.895960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.895948    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.895960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.895957    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2qvd\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-kube-api-access-s2qvd\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.895960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.895968    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8792cac-2705-4c86-ab19-d1083fadc985-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.896327 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.895976    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8792cac-2705-4c86-ab19-d1083fadc985-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.896327 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.895984    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8792cac-2705-4c86-ab19-d1083fadc985-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:50.896327 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:50.895993    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8792cac-2705-4c86-ab19-d1083fadc985-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:44:51.595974 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:51.595948    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"
Jul 15 22:44:51.596432 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:51.595947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2" event={"ID":"f8792cac-2705-4c86-ab19-d1083fadc985","Type":"ContainerDied","Data":"80d64343c98523501b20982663ec8c45ba083206071b213287885d5bca0034f2"}
Jul 15 22:44:51.596432 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:51.596078    2580 scope.go:117] "RemoveContainer" containerID="f1543339852283a223397fdd60ae41edb39bffca1e7ac96a6a21cd91b26a5883"
Jul 15 22:44:51.619929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:51.619899    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"]
Jul 15 22:44:51.627969 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:51.627936    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7ab2faa6-openshift-default-767bdd8c6c-xchn2"]
Jul 15 22:44:52.010944 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:52.010911    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" path="/var/lib/kubelet/pods/f8792cac-2705-4c86-ab19-d1083fadc985/volumes"
Jul 15 22:44:54.587277 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:44:54.587232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:45:02.922083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:02.920817    2580 patch_prober.go:28] interesting pod/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:52222->10.132.0.58:15021: read: connection reset by peer" start-of-body=
Jul 15 22:45:02.922083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:02.920885    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:52222->10.132.0.58:15021: read: connection reset by peer"
Jul 15 22:45:03.660719 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:03.660686    2580 generic.go:356] "Generic (PLEG): container finished" podID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerID="4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53" exitCode=0
Jul 15 22:45:03.660889 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:03.660759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" event={"ID":"185e9da1-6a55-4cee-93db-81a1583bf1ad","Type":"ContainerDied","Data":"4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53"}
Jul 15 22:45:03.661195 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:03.661173    2580 scope.go:117] "RemoveContainer" containerID="4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53"
Jul 15 22:45:03.662221 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:03.662189    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:45:03.662349 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:03.662289    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:45:03.662349 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:03.662340    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:45:04.667935 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:04.667897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" event={"ID":"185e9da1-6a55-4cee-93db-81a1583bf1ad","Type":"ContainerStarted","Data":"8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297"}
Jul 15 22:45:05.090764 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:05.090724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:45:05.091009 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:05.090983    2580 patch_prober.go:28] interesting pod/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 22:45:05.091057 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:05.091038    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 22:45:06.090589 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:06.090555    2580 patch_prober.go:28] interesting pod/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 22:45:06.090985 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:06.090611    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 22:45:07.090956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:07.090917    2580 patch_prober.go:28] interesting pod/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 22:45:07.091402 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:07.090974    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 22:45:08.090749 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:08.090713    2580 patch_prober.go:28] interesting pod/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 15 22:45:08.090939 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:08.090769    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 15 22:45:09.093630 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:09.093598    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:45:09.094124 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:09.093998    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:45:09.094787 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:09.094768    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:45:44.089889 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:44.089856    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:45:44.092073 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:44.092046    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:45:44.095938 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:44.095913    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:45:44.098258 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:44.098218    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:45:51.920847 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:51.920805    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"]
Jul 15 22:45:51.921412 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:51.921037    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l" podUID="dbdbb49c-3918-4b99-82ec-e968c210ef1f" containerName="maas-api" containerID="cri-o://84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47" gracePeriod=30
Jul 15 22:45:52.186165 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.186078    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:45:52.375012 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.374970    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbdbb49c-3918-4b99-82ec-e968c210ef1f-maas-api-tls\") pod \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") "
Jul 15 22:45:52.375194 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.375033    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdbb49c-3918-4b99-82ec-e968c210ef1f-openshift-service-ca\") pod \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") "
Jul 15 22:45:52.375194 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.375068    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt52v\" (UniqueName: \"kubernetes.io/projected/dbdbb49c-3918-4b99-82ec-e968c210ef1f-kube-api-access-zt52v\") pod \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\" (UID: \"dbdbb49c-3918-4b99-82ec-e968c210ef1f\") "
Jul 15 22:45:52.375480 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.375452    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbdbb49c-3918-4b99-82ec-e968c210ef1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dbdbb49c-3918-4b99-82ec-e968c210ef1f" (UID: "dbdbb49c-3918-4b99-82ec-e968c210ef1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:45:52.377293 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.377258    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbdbb49c-3918-4b99-82ec-e968c210ef1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dbdbb49c-3918-4b99-82ec-e968c210ef1f" (UID: "dbdbb49c-3918-4b99-82ec-e968c210ef1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:45:52.377416 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.377330    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbdbb49c-3918-4b99-82ec-e968c210ef1f-kube-api-access-zt52v" (OuterVolumeSpecName: "kube-api-access-zt52v") pod "dbdbb49c-3918-4b99-82ec-e968c210ef1f" (UID: "dbdbb49c-3918-4b99-82ec-e968c210ef1f"). InnerVolumeSpecName "kube-api-access-zt52v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:45:52.476175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.476085    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbdbb49c-3918-4b99-82ec-e968c210ef1f-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:45:52.476175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.476117    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbdbb49c-3918-4b99-82ec-e968c210ef1f-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:45:52.476175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.476128    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt52v\" (UniqueName: \"kubernetes.io/projected/dbdbb49c-3918-4b99-82ec-e968c210ef1f-kube-api-access-zt52v\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:45:52.916694 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.916600    2580 generic.go:356] "Generic (PLEG): container finished" podID="dbdbb49c-3918-4b99-82ec-e968c210ef1f" containerID="84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47" exitCode=0
Jul 15 22:45:52.916694 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.916643    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"
Jul 15 22:45:52.916876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.916692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l" event={"ID":"dbdbb49c-3918-4b99-82ec-e968c210ef1f","Type":"ContainerDied","Data":"84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47"}
Jul 15 22:45:52.916876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.916748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l" event={"ID":"dbdbb49c-3918-4b99-82ec-e968c210ef1f","Type":"ContainerDied","Data":"34cc8cebeb293a07e532681f2058de0e1cc0fcc359ceffd34c727f39e3656993"}
Jul 15 22:45:52.916876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.916774    2580 scope.go:117] "RemoveContainer" containerID="84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47"
Jul 15 22:45:52.926666 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.926513    2580 scope.go:117] "RemoveContainer" containerID="84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47"
Jul 15 22:45:52.926871 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:45:52.926765    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47\": container with ID starting with 84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47 not found: ID does not exist" containerID="84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47"
Jul 15 22:45:52.926871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.926791    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47"} err="failed to get container status \"84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47\": rpc error: code = NotFound desc = could not find container \"84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47\": container with ID starting with 84d76c61d200a17fc3299094714b4ae864b476cbfc4c80577acbec5b9f05bb47 not found: ID does not exist"
Jul 15 22:45:52.939420 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.939399    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"]
Jul 15 22:45:52.941471 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:52.941449    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf7f9845-d4698948c-jb65l"]
Jul 15 22:45:54.011121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:45:54.011081    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbdbb49c-3918-4b99-82ec-e968c210ef1f" path="/var/lib/kubelet/pods/dbdbb49c-3918-4b99-82ec-e968c210ef1f/volumes"
Jul 15 22:46:06.618596 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:06.618557    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"]
Jul 15 22:46:06.619068 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:06.618769    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy" containerID="cri-o://8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297" gracePeriod=30
Jul 15 22:46:09.096776 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:09.096733    2580 patch_prober.go:28] interesting pod/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 22:46:09.097176 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:09.096806    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:46:11.878107 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.878076    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:46:11.948352 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-data\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948365    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-podinfo\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948383    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-envoy\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948401    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/185e9da1-6a55-4cee-93db-81a1583bf1ad-istiod-ca-cert\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-certs\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948753 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948531    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-socket\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948753 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948563    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-token\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948753 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948606    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-credential-socket\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948753 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948663    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfbsv\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-kube-api-access-xfbsv\") pod \"185e9da1-6a55-4cee-93db-81a1583bf1ad\" (UID: \"185e9da1-6a55-4cee-93db-81a1583bf1ad\") "
Jul 15 22:46:11.948943 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.948827    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/185e9da1-6a55-4cee-93db-81a1583bf1ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:46:11.949053 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.949027    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/185e9da1-6a55-4cee-93db-81a1583bf1ad-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:11.949323 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.949198    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:46:11.949323 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.949227    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:46:11.949323 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.949267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:46:11.949481 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.949324    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:46:11.950611 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.950583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:46:11.950923 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.950901    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:46:11.951003 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.950965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-kube-api-access-xfbsv" (OuterVolumeSpecName: "kube-api-access-xfbsv") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "kube-api-access-xfbsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:46:11.951310 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:11.951281    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "185e9da1-6a55-4cee-93db-81a1583bf1ad" (UID: "185e9da1-6a55-4cee-93db-81a1583bf1ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:46:12.015184 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.015154    2580 generic.go:356] "Generic (PLEG): container finished" podID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerID="8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297" exitCode=0
Jul 15 22:46:12.015316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.015195    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"
Jul 15 22:46:12.015316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.015231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" event={"ID":"185e9da1-6a55-4cee-93db-81a1583bf1ad","Type":"ContainerDied","Data":"8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297"}
Jul 15 22:46:12.015316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.015294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4" event={"ID":"185e9da1-6a55-4cee-93db-81a1583bf1ad","Type":"ContainerDied","Data":"3df6d44522a887a21642d52064dec8a9b2f04dc0c3f152e9edea45df20b18f17"}
Jul 15 22:46:12.015451 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.015323    2580 scope.go:117] "RemoveContainer" containerID="8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297"
Jul 15 22:46:12.025379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.025359    2580 scope.go:117] "RemoveContainer" containerID="4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53"
Jul 15 22:46:12.033279 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.033262    2580 scope.go:117] "RemoveContainer" containerID="8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297"
Jul 15 22:46:12.033537 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:46:12.033514    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297\": container with ID starting with 8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297 not found: ID does not exist" containerID="8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297"
Jul 15 22:46:12.033610 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.033547    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297"} err="failed to get container status \"8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297\": rpc error: code = NotFound desc = could not find container \"8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297\": container with ID starting with 8be7c8f980c85d11727e9479baf9a88d99dd9bf077e027878e458b3bb57e2297 not found: ID does not exist"
Jul 15 22:46:12.033610 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.033568    2580 scope.go:117] "RemoveContainer" containerID="4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53"
Jul 15 22:46:12.033783 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:46:12.033763    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53\": container with ID starting with 4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53 not found: ID does not exist" containerID="4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53"
Jul 15 22:46:12.033845 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.033789    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53"} err="failed to get container status \"4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53\": rpc error: code = NotFound desc = could not find container \"4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53\": container with ID starting with 4c30dbcc75ad507201db596f4ec020108bcfe95fcaad28b26bc27323eda05d53 not found: ID does not exist"
Jul 15 22:46:12.038276 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.038221    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"]
Jul 15 22:46:12.041960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.041939    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bf7f9845-openshift-default-75d6b7885f-dzgm4"]
Jul 15 22:46:12.050468 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050447    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:12.050579 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050562    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:12.050631 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050586    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:12.050631 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050596    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfbsv\" (UniqueName: \"kubernetes.io/projected/185e9da1-6a55-4cee-93db-81a1583bf1ad-kube-api-access-xfbsv\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:12.050631 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050607    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:12.050631 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050615    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:12.050631 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050623    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:12.050631 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:12.050630    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/185e9da1-6a55-4cee-93db-81a1583bf1ad-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:46:14.015684 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:46:14.015646    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" path="/var/lib/kubelet/pods/185e9da1-6a55-4cee-93db-81a1583bf1ad/volumes"
Jul 15 22:47:42.364451 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364418    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"]
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364788    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364799    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364814    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364819    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364836    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364841    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364850    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbdbb49c-3918-4b99-82ec-e968c210ef1f" containerName="maas-api"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364856    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbdbb49c-3918-4b99-82ec-e968c210ef1f" containerName="maas-api"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364915    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy"
Jul 15 22:47:42.364921 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364923    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy"
Jul 15 22:47:42.365290 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364932    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8792cac-2705-4c86-ab19-d1083fadc985" containerName="istio-proxy"
Jul 15 22:47:42.365290 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.364942    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbdbb49c-3918-4b99-82ec-e968c210ef1f" containerName="maas-api"
Jul 15 22:47:42.367941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.367925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.371679 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.371653    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-12a4c319-openshift-default-dockercfg-q2hjv\""
Jul 15 22:47:42.394052 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.394027    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"]
Jul 15 22:47:42.462646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462612    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9mz\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-kube-api-access-2h9mz\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.462822 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-istio-token\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.462822 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff817a51-bc35-4833-aba8-afee98d96e54-istiod-ca-cert\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.462822 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff817a51-bc35-4833-aba8-afee98d96e54-istio-podinfo\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.462959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-data\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.462959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-envoy\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.462959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-socket\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.463076 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.462965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-credential-socket\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.463076 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.463011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-certs\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.564597 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9mz\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-kube-api-access-2h9mz\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.564809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-istio-token\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.564809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff817a51-bc35-4833-aba8-afee98d96e54-istiod-ca-cert\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.564809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff817a51-bc35-4833-aba8-afee98d96e54-istio-podinfo\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.564809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-data\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.564809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-envoy\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.564809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-socket\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.565149 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-credential-socket\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.565149 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.564863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-certs\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.565281 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.565164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-data\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.565375 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.565354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-socket\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.565436 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.565370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-certs\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.565488 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.565478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff817a51-bc35-4833-aba8-afee98d96e54-istiod-ca-cert\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.565646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.565626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-credential-socket\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.567622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.567594    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-envoy\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.567927 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.567904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff817a51-bc35-4833-aba8-afee98d96e54-istio-podinfo\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.572954 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.572926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-istio-token\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.573096 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.573076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9mz\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-kube-api-access-2h9mz\") pod \"e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") " pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.678352 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.678310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:42.817939 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.817912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"]
Jul 15 22:47:42.819940 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:47:42.819908    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff817a51_bc35_4833_aba8_afee98d96e54.slice/crio-22e38bdd1ee215e537f48be340b2be1179f6bd94076ab7c87ed6e89a79e1a87c WatchSource:0}: Error finding container 22e38bdd1ee215e537f48be340b2be1179f6bd94076ab7c87ed6e89a79e1a87c: Status 404 returned error can't find the container with id 22e38bdd1ee215e537f48be340b2be1179f6bd94076ab7c87ed6e89a79e1a87c
Jul 15 22:47:42.822563 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.822529    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:47:42.822637 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.822591    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:47:42.822637 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:42.822619    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:47:43.456097 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:43.456060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" event={"ID":"ff817a51-bc35-4833-aba8-afee98d96e54","Type":"ContainerStarted","Data":"2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083"}
Jul 15 22:47:43.456590 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:43.456120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" event={"ID":"ff817a51-bc35-4833-aba8-afee98d96e54","Type":"ContainerStarted","Data":"22e38bdd1ee215e537f48be340b2be1179f6bd94076ab7c87ed6e89a79e1a87c"}
Jul 15 22:47:43.479157 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:43.479106    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" podStartSLOduration=1.479090288 podStartE2EDuration="1.479090288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:47:43.477698427 +0000 UTC m=+1920.002721661" watchObservedRunningTime="2026-07-15 22:47:43.479090288 +0000 UTC m=+1920.004113506"
Jul 15 22:47:43.678503 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:43.678455    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:43.683123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:43.683096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:44.461665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:44.461623    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:44.462683 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:44.462661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:45.606118 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.606083    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"]
Jul 15 22:47:45.606618 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.606514    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy"
Jul 15 22:47:45.606618 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.606530    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy"
Jul 15 22:47:45.606753 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.606628    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="185e9da1-6a55-4cee-93db-81a1583bf1ad" containerName="istio-proxy"
Jul 15 22:47:45.609974 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.609952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.612584 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.612563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-12a4c319-serving-cert\""
Jul 15 22:47:45.621638 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.621617    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"]
Jul 15 22:47:45.696399 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.696369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdb552f-94e3-4db6-b47a-556a9715dc8d-openshift-service-ca\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.696560 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.696427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm59t\" (UniqueName: \"kubernetes.io/projected/ffdb552f-94e3-4db6-b47a-556a9715dc8d-kube-api-access-bm59t\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.696560 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.696511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.797909 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.797875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.798105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.797938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdb552f-94e3-4db6-b47a-556a9715dc8d-openshift-service-ca\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.798105 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.797981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm59t\" (UniqueName: \"kubernetes.io/projected/ffdb552f-94e3-4db6-b47a-556a9715dc8d-kube-api-access-bm59t\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.798105 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:47:45.798049    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-serving-cert: secret "maas-api-e2e-mt-12a4c319-serving-cert" not found
Jul 15 22:47:45.798308 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:47:45.798118    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls podName:ffdb552f-94e3-4db6-b47a-556a9715dc8d nodeName:}" failed. No retries permitted until 2026-07-15 22:47:46.29809523 +0000 UTC m=+1922.823118444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls") pod "maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw" (UID: "ffdb552f-94e3-4db6-b47a-556a9715dc8d") : secret "maas-api-e2e-mt-12a4c319-serving-cert" not found
Jul 15 22:47:45.798695 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.798675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdb552f-94e3-4db6-b47a-556a9715dc8d-openshift-service-ca\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:45.806639 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:45.806615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm59t\" (UniqueName: \"kubernetes.io/projected/ffdb552f-94e3-4db6-b47a-556a9715dc8d-kube-api-access-bm59t\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:46.302899 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:46.302861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:46.305370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:46.305348    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls\") pod \"maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:46.523109 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:46.523074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:46.662300 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:46.662266    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"]
Jul 15 22:47:46.663854 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:47:46.663820    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdb552f_94e3_4db6_b47a_556a9715dc8d.slice/crio-e882e9368b33e39847b6d701be4ff8dea9cd517f7fa4c2af8baa6c1ee80b3f5e WatchSource:0}: Error finding container e882e9368b33e39847b6d701be4ff8dea9cd517f7fa4c2af8baa6c1ee80b3f5e: Status 404 returned error can't find the container with id e882e9368b33e39847b6d701be4ff8dea9cd517f7fa4c2af8baa6c1ee80b3f5e
Jul 15 22:47:46.665442 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:46.665422    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:47:47.478570 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:47.478532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw" event={"ID":"ffdb552f-94e3-4db6-b47a-556a9715dc8d","Type":"ContainerStarted","Data":"e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8"}
Jul 15 22:47:47.478730 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:47.478588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw" event={"ID":"ffdb552f-94e3-4db6-b47a-556a9715dc8d","Type":"ContainerStarted","Data":"e882e9368b33e39847b6d701be4ff8dea9cd517f7fa4c2af8baa6c1ee80b3f5e"}
Jul 15 22:47:47.478730 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:47.478680    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:47.497486 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:47.497438    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw" podStartSLOduration=1.854322177 podStartE2EDuration="2.497424576s" totalImagesPullingTime="643.102399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:47:47.49641174 +0000 UTC m=+1924.021434960" watchObservedRunningTime="2026-07-15 22:47:47.497424576 +0000 UTC m=+1924.022447843"
Jul 15 22:47:53.490257 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:53.490205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:47:58.535786 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:58.535751    2580 generic.go:356] "Generic (PLEG): container finished" podID="ff817a51-bc35-4833-aba8-afee98d96e54" containerID="2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083" exitCode=0
Jul 15 22:47:58.536206 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:58.535797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" event={"ID":"ff817a51-bc35-4833-aba8-afee98d96e54","Type":"ContainerDied","Data":"2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083"}
Jul 15 22:47:58.536206 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:58.536163    2580 scope.go:117] "RemoveContainer" containerID="2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083"
Jul 15 22:47:58.537177 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:58.537144    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:47:58.537283 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:58.537233    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:47:58.537362 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:58.537328    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:47:59.462286 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:59.462226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:59.544982 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:59.544940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" event={"ID":"ff817a51-bc35-4833-aba8-afee98d96e54","Type":"ContainerStarted","Data":"d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b"}
Jul 15 22:47:59.678464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:59.678427    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:47:59.679669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:59.679638    2580 patch_prober.go:28] interesting pod/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 22:47:59.679800 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:47:59.679697    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 22:48:00.679319 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:00.679278    2580 patch_prober.go:28] interesting pod/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 22:48:00.679707 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:00.679347    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 22:48:01.679164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:01.679125    2580 patch_prober.go:28] interesting pod/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 22:48:01.679378 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:01.679177    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 22:48:02.679456 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:02.679414    2580 patch_prober.go:28] interesting pod/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 22:48:02.679865 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:02.679482    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 22:48:03.678945 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:03.678902    2580 patch_prober.go:28] interesting pod/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 22:48:03.679155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:03.678971    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 22:48:04.684146 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:04.684108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:48:04.684569 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:04.684508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:48:04.685230 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:04.685211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:48:07.991260 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:07.991210    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"]
Jul 15 22:48:07.991756 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:07.991450    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw" podUID="ffdb552f-94e3-4db6-b47a-556a9715dc8d" containerName="maas-api" containerID="cri-o://e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8" gracePeriod=30
Jul 15 22:48:08.250802 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.250736    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:48:08.314029 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.313993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls\") pod \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") "
Jul 15 22:48:08.314203 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.314046    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdb552f-94e3-4db6-b47a-556a9715dc8d-openshift-service-ca\") pod \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") "
Jul 15 22:48:08.314203 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.314109    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm59t\" (UniqueName: \"kubernetes.io/projected/ffdb552f-94e3-4db6-b47a-556a9715dc8d-kube-api-access-bm59t\") pod \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\" (UID: \"ffdb552f-94e3-4db6-b47a-556a9715dc8d\") "
Jul 15 22:48:08.314499 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.314472    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffdb552f-94e3-4db6-b47a-556a9715dc8d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffdb552f-94e3-4db6-b47a-556a9715dc8d" (UID: "ffdb552f-94e3-4db6-b47a-556a9715dc8d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:48:08.316171 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.316148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffdb552f-94e3-4db6-b47a-556a9715dc8d" (UID: "ffdb552f-94e3-4db6-b47a-556a9715dc8d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:48:08.316278 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.316149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffdb552f-94e3-4db6-b47a-556a9715dc8d-kube-api-access-bm59t" (OuterVolumeSpecName: "kube-api-access-bm59t") pod "ffdb552f-94e3-4db6-b47a-556a9715dc8d" (UID: "ffdb552f-94e3-4db6-b47a-556a9715dc8d"). InnerVolumeSpecName "kube-api-access-bm59t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:48:08.415842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.415809    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdb552f-94e3-4db6-b47a-556a9715dc8d-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:08.415842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.415837    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm59t\" (UniqueName: \"kubernetes.io/projected/ffdb552f-94e3-4db6-b47a-556a9715dc8d-kube-api-access-bm59t\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:08.415842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.415847    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdb552f-94e3-4db6-b47a-556a9715dc8d-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:08.601467 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.601380    2580 generic.go:356] "Generic (PLEG): container finished" podID="ffdb552f-94e3-4db6-b47a-556a9715dc8d" containerID="e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8" exitCode=0
Jul 15 22:48:08.601467 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.601422    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"
Jul 15 22:48:08.601667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.601465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw" event={"ID":"ffdb552f-94e3-4db6-b47a-556a9715dc8d","Type":"ContainerDied","Data":"e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8"}
Jul 15 22:48:08.601667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.601519    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw" event={"ID":"ffdb552f-94e3-4db6-b47a-556a9715dc8d","Type":"ContainerDied","Data":"e882e9368b33e39847b6d701be4ff8dea9cd517f7fa4c2af8baa6c1ee80b3f5e"}
Jul 15 22:48:08.601667 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.601542    2580 scope.go:117] "RemoveContainer" containerID="e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8"
Jul 15 22:48:08.610878 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.610859    2580 scope.go:117] "RemoveContainer" containerID="e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8"
Jul 15 22:48:08.611155 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:48:08.611135    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8\": container with ID starting with e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8 not found: ID does not exist" containerID="e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8"
Jul 15 22:48:08.611228 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.611167    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8"} err="failed to get container status \"e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8\": rpc error: code = NotFound desc = could not find container \"e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8\": container with ID starting with e43160fe73c0e120d6c39558178217f9712569a8540f59568fd661af56842fb8 not found: ID does not exist"
Jul 15 22:48:08.624085 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.624060    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"]
Jul 15 22:48:08.629810 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:08.629789    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12a4c319-ccbb965bd-28tsw"]
Jul 15 22:48:10.010093 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:10.010049    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffdb552f-94e3-4db6-b47a-556a9715dc8d" path="/var/lib/kubelet/pods/ffdb552f-94e3-4db6-b47a-556a9715dc8d/volumes"
Jul 15 22:48:23.111434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:23.111399    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"]
Jul 15 22:48:23.111968 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:23.111629    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy" containerID="cri-o://d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b" gracePeriod=30
Jul 15 22:48:28.374293 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.374218    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:48:28.505184 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505148    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-certs\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-data\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505281    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff817a51-bc35-4833-aba8-afee98d96e54-istio-podinfo\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-envoy\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-istio-token\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-credential-socket\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505449    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff817a51-bc35-4833-aba8-afee98d96e54-istiod-ca-cert\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505479    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h9mz\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-kube-api-access-2h9mz\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505505    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-socket\") pod \"ff817a51-bc35-4833-aba8-afee98d96e54\" (UID: \"ff817a51-bc35-4833-aba8-afee98d96e54\") "
Jul 15 22:48:28.505669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505506    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:48:28.505888 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505764    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:48:28.505948 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505879    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff817a51-bc35-4833-aba8-afee98d96e54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:48:28.506005 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505960    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.506005 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505958    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:48:28.506005 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.505986    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.506174 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.506124    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:48:28.507657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.507612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:48:28.507657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.507647    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff817a51-bc35-4833-aba8-afee98d96e54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:48:28.507823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.507670    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-kube-api-access-2h9mz" (OuterVolumeSpecName: "kube-api-access-2h9mz") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "kube-api-access-2h9mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:48:28.507823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.507730    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff817a51-bc35-4833-aba8-afee98d96e54" (UID: "ff817a51-bc35-4833-aba8-afee98d96e54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:48:28.607333 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.607296    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff817a51-bc35-4833-aba8-afee98d96e54-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.607333 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.607326    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h9mz\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-kube-api-access-2h9mz\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.607333 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.607336    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.607552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.607345    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.607552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.607353    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff817a51-bc35-4833-aba8-afee98d96e54-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.607552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.607360    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff817a51-bc35-4833-aba8-afee98d96e54-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.607552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.607366    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff817a51-bc35-4833-aba8-afee98d96e54-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:48:28.699502 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.699474    2580 generic.go:356] "Generic (PLEG): container finished" podID="ff817a51-bc35-4833-aba8-afee98d96e54" containerID="d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b" exitCode=0
Jul 15 22:48:28.699657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.699518    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"
Jul 15 22:48:28.699657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.699556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" event={"ID":"ff817a51-bc35-4833-aba8-afee98d96e54","Type":"ContainerDied","Data":"d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b"}
Jul 15 22:48:28.699657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.699617    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr" event={"ID":"ff817a51-bc35-4833-aba8-afee98d96e54","Type":"ContainerDied","Data":"22e38bdd1ee215e537f48be340b2be1179f6bd94076ab7c87ed6e89a79e1a87c"}
Jul 15 22:48:28.699657 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.699640    2580 scope.go:117] "RemoveContainer" containerID="d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b"
Jul 15 22:48:28.709174 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.709158    2580 scope.go:117] "RemoveContainer" containerID="2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083"
Jul 15 22:48:28.717153 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.717134    2580 scope.go:117] "RemoveContainer" containerID="d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b"
Jul 15 22:48:28.717480 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:48:28.717460    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b\": container with ID starting with d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b not found: ID does not exist" containerID="d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b"
Jul 15 22:48:28.717573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.717493    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b"} err="failed to get container status \"d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b\": rpc error: code = NotFound desc = could not find container \"d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b\": container with ID starting with d6e784d420202ea6533b27133d9fb7d1907e67ba5ec07cf37b1530091c851d7b not found: ID does not exist"
Jul 15 22:48:28.717573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.717518    2580 scope.go:117] "RemoveContainer" containerID="2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083"
Jul 15 22:48:28.717757 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:48:28.717739    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083\": container with ID starting with 2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083 not found: ID does not exist" containerID="2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083"
Jul 15 22:48:28.717797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.717764    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083"} err="failed to get container status \"2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083\": rpc error: code = NotFound desc = could not find container \"2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083\": container with ID starting with 2a7c2d777fd05dc180e456837e3fab375f8e760be65a2ee5a5de133d67670083 not found: ID does not exist"
Jul 15 22:48:28.722729 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.722708    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"]
Jul 15 22:48:28.726871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:28.726850    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-12a4c319-openshift-default-84d9fbbff-lvdlr"]
Jul 15 22:48:30.010131 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:30.010096    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" path="/var/lib/kubelet/pods/ff817a51-bc35-4833-aba8-afee98d96e54/volumes"
Jul 15 22:48:42.495502 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495405    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"]
Jul 15 22:48:42.495925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495827    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy"
Jul 15 22:48:42.495925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495841    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy"
Jul 15 22:48:42.495925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495851    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy"
Jul 15 22:48:42.495925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495857    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy"
Jul 15 22:48:42.495925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495872    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdb552f-94e3-4db6-b47a-556a9715dc8d" containerName="maas-api"
Jul 15 22:48:42.495925 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495878    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdb552f-94e3-4db6-b47a-556a9715dc8d" containerName="maas-api"
Jul 15 22:48:42.496236 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495954    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy"
Jul 15 22:48:42.496236 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495966    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff817a51-bc35-4833-aba8-afee98d96e54" containerName="istio-proxy"
Jul 15 22:48:42.496236 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.495978    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffdb552f-94e3-4db6-b47a-556a9715dc8d" containerName="maas-api"
Jul 15 22:48:42.500598 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.500575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.503222 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.503202    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-79ecefd7-openshift-default-dockercfg-j4s5z\""
Jul 15 22:48:42.513489 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.513465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"]
Jul 15 22:48:42.641485 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-certs\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-data\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-envoy\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e63418-20b0-419f-b5aa-164ba57b49f8-istiod-ca-cert\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-socket\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgzjn\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-kube-api-access-jgzjn\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-credential-socket\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641870 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-podinfo\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.641870 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.641775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-token\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.742539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.742507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-data\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.742539 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.742543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-envoy\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.742805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.742564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e63418-20b0-419f-b5aa-164ba57b49f8-istiod-ca-cert\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.742805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.742607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-socket\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.742805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.742640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgzjn\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-kube-api-access-jgzjn\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.742805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.742665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-credential-socket\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.742805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.742693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-podinfo\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.743114 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.743008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-data\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.743114 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.743061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-socket\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.743114 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.743075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-token\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.743317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.743159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-certs\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.743405 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.743378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e63418-20b0-419f-b5aa-164ba57b49f8-istiod-ca-cert\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.743541 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.743471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-certs\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.743609 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.743565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-credential-socket\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.745016 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.744982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-envoy\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.745283 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.745261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-podinfo\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.751747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.751689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-token\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.751747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.751728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgzjn\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-kube-api-access-jgzjn\") pod \"e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") " pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.811239 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.811212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:42.953696 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.953655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"]
Jul 15 22:48:42.956663 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:48:42.956623    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e63418_20b0_419f_b5aa_164ba57b49f8.slice/crio-8c5bf1776edc2e293289a6b2a775df4dd5b76653ecdc2dbb3b853dcff2a5c0d8 WatchSource:0}: Error finding container 8c5bf1776edc2e293289a6b2a775df4dd5b76653ecdc2dbb3b853dcff2a5c0d8: Status 404 returned error can't find the container with id 8c5bf1776edc2e293289a6b2a775df4dd5b76653ecdc2dbb3b853dcff2a5c0d8
Jul 15 22:48:42.959106 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.959071    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:48:42.959220 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.959147    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:48:42.959220 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:42.959188    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:48:43.774072 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:43.774037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" event={"ID":"86e63418-20b0-419f-b5aa-164ba57b49f8","Type":"ContainerStarted","Data":"db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a"}
Jul 15 22:48:43.774495 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:43.774094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" event={"ID":"86e63418-20b0-419f-b5aa-164ba57b49f8","Type":"ContainerStarted","Data":"8c5bf1776edc2e293289a6b2a775df4dd5b76653ecdc2dbb3b853dcff2a5c0d8"}
Jul 15 22:48:43.795803 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:43.795756    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" podStartSLOduration=1.795742059 podStartE2EDuration="1.795742059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:48:43.793631853 +0000 UTC m=+1980.318655100" watchObservedRunningTime="2026-07-15 22:48:43.795742059 +0000 UTC m=+1980.320765277"
Jul 15 22:48:43.811621 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:43.811596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:44.196233 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:44.196206    2580 scope.go:117] "RemoveContainer" containerID="174ab12aa9dddf23d3d223a6804073f32378577ac8dfab74869ae51355672f40"
Jul 15 22:48:44.817141 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:44.817106    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:45.758364 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.758328    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"]
Jul 15 22:48:45.763578 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.763559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.767422 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.767399    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-79ecefd7-serving-cert\""
Jul 15 22:48:45.773676 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.773606    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"]
Jul 15 22:48:45.784205 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.784188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:45.785291 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.785269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:48:45.874750 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.874714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.875203 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.874887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-openshift-service-ca\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.875203 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.874987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55vwg\" (UniqueName: \"kubernetes.io/projected/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-kube-api-access-55vwg\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.975459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.975421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-openshift-service-ca\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.975654 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.975508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vwg\" (UniqueName: \"kubernetes.io/projected/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-kube-api-access-55vwg\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.975654 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.975540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.975805 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:48:45.975788    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-serving-cert: secret "maas-api-e2e-mt-79ecefd7-serving-cert" not found
Jul 15 22:48:45.975869 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:48:45.975857    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls podName:21c083dd-c6a2-4cf5-9b5d-4401c21f4c87 nodeName:}" failed. No retries permitted until 2026-07-15 22:48:46.47583501 +0000 UTC m=+1983.000858217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls") pod "maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" (UID: "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87") : secret "maas-api-e2e-mt-79ecefd7-serving-cert" not found
Jul 15 22:48:45.976370 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.976343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-openshift-service-ca\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:45.986877 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:45.986846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vwg\" (UniqueName: \"kubernetes.io/projected/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-kube-api-access-55vwg\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:46.479490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:46.479442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:46.479676 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:48:46.479601    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-serving-cert: secret "maas-api-e2e-mt-79ecefd7-serving-cert" not found
Jul 15 22:48:46.479728 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:48:46.479681    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls podName:21c083dd-c6a2-4cf5-9b5d-4401c21f4c87 nodeName:}" failed. No retries permitted until 2026-07-15 22:48:47.47965964 +0000 UTC m=+1984.004682850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls") pod "maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" (UID: "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87") : secret "maas-api-e2e-mt-79ecefd7-serving-cert" not found
Jul 15 22:48:47.487442 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:47.487404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:47.489774 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:47.489747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls\") pod \"maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:47.574819 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:47.574787    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:47.722880 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:47.722852    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"]
Jul 15 22:48:47.724681 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:48:47.724655    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c083dd_c6a2_4cf5_9b5d_4401c21f4c87.slice/crio-7290bca768e36ca33dc6536fa538f68cc8a7d52cc75beb98d2901bafe791114a WatchSource:0}: Error finding container 7290bca768e36ca33dc6536fa538f68cc8a7d52cc75beb98d2901bafe791114a: Status 404 returned error can't find the container with id 7290bca768e36ca33dc6536fa538f68cc8a7d52cc75beb98d2901bafe791114a
Jul 15 22:48:47.794971 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:47.794887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" event={"ID":"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87","Type":"ContainerStarted","Data":"7290bca768e36ca33dc6536fa538f68cc8a7d52cc75beb98d2901bafe791114a"}
Jul 15 22:48:48.801183 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:48.801145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" event={"ID":"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87","Type":"ContainerStarted","Data":"2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e"}
Jul 15 22:48:48.801634 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:48.801217    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:48.820900 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:48.820856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" podStartSLOduration=3.425104686 podStartE2EDuration="3.820842157s" totalImagesPullingTime="395.737471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:48:48.818952172 +0000 UTC m=+1985.343975391" watchObservedRunningTime="2026-07-15 22:48:48.820842157 +0000 UTC m=+1985.345865375"
Jul 15 22:48:54.813010 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:54.812973    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:48:59.861807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:59.861715    2580 generic.go:356] "Generic (PLEG): container finished" podID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerID="db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a" exitCode=0
Jul 15 22:48:59.862364 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:59.861796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" event={"ID":"86e63418-20b0-419f-b5aa-164ba57b49f8","Type":"ContainerDied","Data":"db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a"}
Jul 15 22:48:59.862445 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:59.862364    2580 scope.go:117] "RemoveContainer" containerID="db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a"
Jul 15 22:48:59.863427 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:59.863400    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:48:59.863499 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:59.863469    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:48:59.863535 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:48:59.863500    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:49:00.784864 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:00.784815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:49:00.868871 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:00.868827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" event={"ID":"86e63418-20b0-419f-b5aa-164ba57b49f8","Type":"ContainerStarted","Data":"a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6"}
Jul 15 22:49:01.812365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:01.812325    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:49:01.813736 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:01.813710    2580 patch_prober.go:28] interesting pod/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 15 22:49:01.813850 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:01.813772    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 15 22:49:02.812223 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:02.812179    2580 patch_prober.go:28] interesting pod/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 15 22:49:02.812754 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:02.812710    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 15 22:49:03.811959 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:03.811920    2580 patch_prober.go:28] interesting pod/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 15 22:49:03.812144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:03.811982    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 15 22:49:04.815386 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:04.815357    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:49:04.815841 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:04.815591    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:49:04.816437 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:04.816420    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:49:33.700953 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:33.700916    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"]
Jul 15 22:49:33.701574 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:33.701175    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" podUID="21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" containerName="maas-api" containerID="cri-o://2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e" gracePeriod=30
Jul 15 22:49:33.963266 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:33.963170    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:49:34.029273 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.029216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55vwg\" (UniqueName: \"kubernetes.io/projected/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-kube-api-access-55vwg\") pod \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") "
Jul 15 22:49:34.029273 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.029282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls\") pod \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") "
Jul 15 22:49:34.029543 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.029310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-openshift-service-ca\") pod \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\" (UID: \"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87\") "
Jul 15 22:49:34.029857 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.029809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" (UID: "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:49:34.030648 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.030620    2580 generic.go:356] "Generic (PLEG): container finished" podID="21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" containerID="2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e" exitCode=0
Jul 15 22:49:34.030759 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.030667    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"
Jul 15 22:49:34.030759 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.030693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" event={"ID":"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87","Type":"ContainerDied","Data":"2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e"}
Jul 15 22:49:34.030759 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.030747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv" event={"ID":"21c083dd-c6a2-4cf5-9b5d-4401c21f4c87","Type":"ContainerDied","Data":"7290bca768e36ca33dc6536fa538f68cc8a7d52cc75beb98d2901bafe791114a"}
Jul 15 22:49:34.030929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.030769    2580 scope.go:117] "RemoveContainer" containerID="2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e"
Jul 15 22:49:34.031594 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.031573    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" (UID: "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:49:34.031702 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.031675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-kube-api-access-55vwg" (OuterVolumeSpecName: "kube-api-access-55vwg") pod "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" (UID: "21c083dd-c6a2-4cf5-9b5d-4401c21f4c87"). InnerVolumeSpecName "kube-api-access-55vwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:49:34.050442 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.050421    2580 scope.go:117] "RemoveContainer" containerID="2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e"
Jul 15 22:49:34.050764 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:49:34.050745    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e\": container with ID starting with 2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e not found: ID does not exist" containerID="2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e"
Jul 15 22:49:34.050812 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.050774    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e"} err="failed to get container status \"2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e\": rpc error: code = NotFound desc = could not find container \"2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e\": container with ID starting with 2cc701c09627770a96746d41fa2fb55ad4397b7d0a7cd4d559cf991c173d3a3e not found: ID does not exist"
Jul 15 22:49:34.130713 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.130675    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55vwg\" (UniqueName: \"kubernetes.io/projected/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-kube-api-access-55vwg\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:49:34.130713 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.130708    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:49:34.130713 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.130717    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:49:34.352258 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.352192    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"]
Jul 15 22:49:34.354813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:34.354790    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-79ecefd7-bf48d89cb-thdxv"]
Jul 15 22:49:36.010455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:49:36.010422    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" path="/var/lib/kubelet/pods/21c083dd-c6a2-4cf5-9b5d-4401c21f4c87/volumes"
Jul 15 22:50:30.589854 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:30.589814    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"]
Jul 15 22:50:30.590375 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:30.590054    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy" containerID="cri-o://a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6" gracePeriod=30
Jul 15 22:50:34.817573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:34.817529    2580 patch_prober.go:28] interesting pod/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 22:50:34.817935 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:34.817597    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:50:35.852251 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.852181    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:50:35.911064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911029    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-data\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911282 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-certs\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911282 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911116    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-token\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911282 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911153    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-credential-socket\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911282 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911215    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgzjn\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-kube-api-access-jgzjn\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911282 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e63418-20b0-419f-b5aa-164ba57b49f8-istiod-ca-cert\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911561 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911296    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-envoy\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911561 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-podinfo\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911561 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911422    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:50:35.911561 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-socket\") pod \"86e63418-20b0-419f-b5aa-164ba57b49f8\" (UID: \"86e63418-20b0-419f-b5aa-164ba57b49f8\") "
Jul 15 22:50:35.911770 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911652    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:50:35.911840 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911823    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:35.911897 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911843    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:35.911897 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.911849    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86e63418-20b0-419f-b5aa-164ba57b49f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:50:35.912106 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.912080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:50:35.912190 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.912121    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:50:35.913960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.913936    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:50:35.913960 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.913943    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:50:35.914088 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.914049    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-kube-api-access-jgzjn" (OuterVolumeSpecName: "kube-api-access-jgzjn") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "kube-api-access-jgzjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:50:35.914277 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:35.914255    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "86e63418-20b0-419f-b5aa-164ba57b49f8" (UID: "86e63418-20b0-419f-b5aa-164ba57b49f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:50:36.012261 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.012215    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:36.012261 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.012257    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:36.012462 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.012271    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:36.012462 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.012282    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:36.012462 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.012293    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e63418-20b0-419f-b5aa-164ba57b49f8-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:36.012462 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.012304    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgzjn\" (UniqueName: \"kubernetes.io/projected/86e63418-20b0-419f-b5aa-164ba57b49f8-kube-api-access-jgzjn\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:36.012462 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.012317    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e63418-20b0-419f-b5aa-164ba57b49f8-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:50:36.336114 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.336082    2580 generic.go:356] "Generic (PLEG): container finished" podID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerID="a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6" exitCode=0
Jul 15 22:50:36.336312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.336131    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"
Jul 15 22:50:36.336312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.336148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" event={"ID":"86e63418-20b0-419f-b5aa-164ba57b49f8","Type":"ContainerDied","Data":"a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6"}
Jul 15 22:50:36.336312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.336191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q" event={"ID":"86e63418-20b0-419f-b5aa-164ba57b49f8","Type":"ContainerDied","Data":"8c5bf1776edc2e293289a6b2a775df4dd5b76653ecdc2dbb3b853dcff2a5c0d8"}
Jul 15 22:50:36.336312 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.336213    2580 scope.go:117] "RemoveContainer" containerID="a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6"
Jul 15 22:50:36.345670 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.345652    2580 scope.go:117] "RemoveContainer" containerID="db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a"
Jul 15 22:50:36.353677 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.353660    2580 scope.go:117] "RemoveContainer" containerID="a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6"
Jul 15 22:50:36.353924 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:50:36.353901    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6\": container with ID starting with a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6 not found: ID does not exist" containerID="a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6"
Jul 15 22:50:36.353990 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.353933    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6"} err="failed to get container status \"a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6\": rpc error: code = NotFound desc = could not find container \"a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6\": container with ID starting with a16af1fda88c7c03439e02efeaaf7ce35fc4aab706503f3f9a8652baa3aa57b6 not found: ID does not exist"
Jul 15 22:50:36.353990 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.353949    2580 scope.go:117] "RemoveContainer" containerID="db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a"
Jul 15 22:50:36.354177 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:50:36.354162    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a\": container with ID starting with db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a not found: ID does not exist" containerID="db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a"
Jul 15 22:50:36.354218 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.354180    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a"} err="failed to get container status \"db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a\": rpc error: code = NotFound desc = could not find container \"db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a\": container with ID starting with db93bca8c285a87d55acfe13b66ea7a32fa5ad35cab42c6ad2b45d2291de217a not found: ID does not exist"
Jul 15 22:50:36.359459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.359434    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"]
Jul 15 22:50:36.365484 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:36.365455    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-79ecefd7-openshift-default-55c78ff947-jfn7q"]
Jul 15 22:50:38.010799 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:38.010765    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" path="/var/lib/kubelet/pods/86e63418-20b0-419f-b5aa-164ba57b49f8/volumes"
Jul 15 22:50:44.120677 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:44.120644    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:50:44.123793 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:44.123766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:50:44.126923 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:44.126905    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:50:44.129936 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:50:44.129918    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:51:25.507976 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.507939    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"]
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508387    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" containerName="maas-api"
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" containerName="maas-api"
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508409    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy"
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508416    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy"
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508422    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy"
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508427    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy"
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508490    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy"
Jul 15 22:51:25.508587 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.508501    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c083dd-c6a2-4cf5-9b5d-4401c21f4c87" containerName="maas-api"
Jul 15 22:51:25.511491 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.511473    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.515549 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.515518    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-30c9f8-openshift-default-dockercfg-pp8mp\""
Jul 15 22:51:25.528992 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.528968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"]
Jul 15 22:51:25.663690 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-certs\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.663897 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-data\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.663897 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-credential-socket\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.663897 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-token\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.663897 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-envoy\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.663897 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-podinfo\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.664099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881e4f74-b92c-4c99-8d75-529e1965a9b7-istiod-ca-cert\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.664099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-socket\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.664099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.663965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd5nz\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-kube-api-access-zd5nz\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.764938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-token\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.764985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-envoy\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-podinfo\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881e4f74-b92c-4c99-8d75-529e1965a9b7-istiod-ca-cert\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-socket\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd5nz\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-kube-api-access-zd5nz\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-certs\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-data\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765404 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-credential-socket\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765782 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-socket\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765782 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-certs\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765782 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-data\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.765782 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.765736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-credential-socket\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.766040 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.766017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881e4f74-b92c-4c99-8d75-529e1965a9b7-istiod-ca-cert\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.767396 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.767374    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-envoy\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.767626 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.767606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-podinfo\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.776265 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.776212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd5nz\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-kube-api-access-zd5nz\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.776473 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.776455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-token\") pod \"e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") " pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.822446 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.822389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:25.972515 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.972487    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"]
Jul 15 22:51:25.973820 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:51:25.973794    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881e4f74_b92c_4c99_8d75_529e1965a9b7.slice/crio-88e771212880093c2a0e225a2a57cf85abbce9dd8456cfaef9cc9974e37bdb79 WatchSource:0}: Error finding container 88e771212880093c2a0e225a2a57cf85abbce9dd8456cfaef9cc9974e37bdb79: Status 404 returned error can't find the container with id 88e771212880093c2a0e225a2a57cf85abbce9dd8456cfaef9cc9974e37bdb79
Jul 15 22:51:25.975962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.975929    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:25.976033 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.975997    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:25.976033 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:25.976025    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:26.582392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:26.582351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" event={"ID":"881e4f74-b92c-4c99-8d75-529e1965a9b7","Type":"ContainerStarted","Data":"1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300"}
Jul 15 22:51:26.582816 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:26.582417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" event={"ID":"881e4f74-b92c-4c99-8d75-529e1965a9b7","Type":"ContainerStarted","Data":"88e771212880093c2a0e225a2a57cf85abbce9dd8456cfaef9cc9974e37bdb79"}
Jul 15 22:51:26.610986 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:26.610933    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" podStartSLOduration=1.610916494 podStartE2EDuration="1.610916494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:51:26.607630024 +0000 UTC m=+2143.132653242" watchObservedRunningTime="2026-07-15 22:51:26.610916494 +0000 UTC m=+2143.135939712"
Jul 15 22:51:26.823409 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:26.823370    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:27.827495 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:27.827457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:28.593080 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.593046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:28.593943 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.593919    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:28.813219 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.813172    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"]
Jul 15 22:51:28.813681 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.813665    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e63418-20b0-419f-b5aa-164ba57b49f8" containerName="istio-proxy"
Jul 15 22:51:28.816933 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.816910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:28.819649 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.819627    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-30c9f8-serving-cert\""
Jul 15 22:51:28.833939 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.833910    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"]
Jul 15 22:51:28.898176 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.898084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6331c4e-e84d-48b9-aa44-4d407fc09485-maas-api-tls\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:28.898176 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.898130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdchs\" (UniqueName: \"kubernetes.io/projected/e6331c4e-e84d-48b9-aa44-4d407fc09485-kube-api-access-mdchs\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:28.898176 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.898172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6331c4e-e84d-48b9-aa44-4d407fc09485-openshift-service-ca\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:28.999621 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.999587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6331c4e-e84d-48b9-aa44-4d407fc09485-maas-api-tls\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:28.999794 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.999632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdchs\" (UniqueName: \"kubernetes.io/projected/e6331c4e-e84d-48b9-aa44-4d407fc09485-kube-api-access-mdchs\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:28.999878 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:28.999804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6331c4e-e84d-48b9-aa44-4d407fc09485-openshift-service-ca\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:29.000524 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:29.000502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6331c4e-e84d-48b9-aa44-4d407fc09485-openshift-service-ca\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:29.002051 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:29.002030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6331c4e-e84d-48b9-aa44-4d407fc09485-maas-api-tls\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:29.010321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:29.010298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdchs\" (UniqueName: \"kubernetes.io/projected/e6331c4e-e84d-48b9-aa44-4d407fc09485-kube-api-access-mdchs\") pod \"maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:29.130651 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:29.130611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:29.536193 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:29.536160    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"]
Jul 15 22:51:29.537868 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:51:29.537817    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6331c4e_e84d_48b9_aa44_4d407fc09485.slice/crio-780ae5501241dbaa76f9161a8e3d9fd2b79f86d61574449415b294a6367a12f9 WatchSource:0}: Error finding container 780ae5501241dbaa76f9161a8e3d9fd2b79f86d61574449415b294a6367a12f9: Status 404 returned error can't find the container with id 780ae5501241dbaa76f9161a8e3d9fd2b79f86d61574449415b294a6367a12f9
Jul 15 22:51:29.599483 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:29.599438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf" event={"ID":"e6331c4e-e84d-48b9-aa44-4d407fc09485","Type":"ContainerStarted","Data":"780ae5501241dbaa76f9161a8e3d9fd2b79f86d61574449415b294a6367a12f9"}
Jul 15 22:51:30.606043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:30.605994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf" event={"ID":"e6331c4e-e84d-48b9-aa44-4d407fc09485","Type":"ContainerStarted","Data":"695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456"}
Jul 15 22:51:30.606542 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:30.606075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:30.627432 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:30.627376    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf" podStartSLOduration=2.208814403 podStartE2EDuration="2.627360902s" totalImagesPullingTime="418.546499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:51:30.624666202 +0000 UTC m=+2147.149689420" watchObservedRunningTime="2026-07-15 22:51:30.627360902 +0000 UTC m=+2147.152384119"
Jul 15 22:51:33.682883 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.682845    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"]
Jul 15 22:51:33.687371 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.687347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.690777 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.690751    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-7fdd49-openshift-default-dockercfg-brkp7\""
Jul 15 22:51:33.698021 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.697993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"]
Jul 15 22:51:33.848846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.848807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-envoy\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.848853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-certs\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.848879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-data\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.848930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-socket\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.848966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/762a9f8e-f004-45e2-8a70-4312b536997c-istio-podinfo\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.849019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/762a9f8e-f004-45e2-8a70-4312b536997c-istiod-ca-cert\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.849049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-credential-socket\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.849075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdbqk\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-kube-api-access-sdbqk\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.849155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.849120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-istio-token\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-istio-token\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-envoy\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-certs\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-data\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-socket\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/762a9f8e-f004-45e2-8a70-4312b536997c-istio-podinfo\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/762a9f8e-f004-45e2-8a70-4312b536997c-istiod-ca-cert\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-credential-socket\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.950673 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdbqk\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-kube-api-access-sdbqk\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.951039 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-socket\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.951039 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.950975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-data\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.951039 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.951004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-certs\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.951214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.951193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-credential-socket\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.951434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.951413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/762a9f8e-f004-45e2-8a70-4312b536997c-istiod-ca-cert\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.952853 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.952832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-envoy\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.953050 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.953031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/762a9f8e-f004-45e2-8a70-4312b536997c-istio-podinfo\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.959434 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.959413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-istio-token\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.959544 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.959482    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdbqk\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-kube-api-access-sdbqk\") pod \"e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") " pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:33.999597 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:33.999566    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:34.146535 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:34.146507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"]
Jul 15 22:51:34.147893 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:51:34.147863    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762a9f8e_f004_45e2_8a70_4312b536997c.slice/crio-2cabc811c154cf3c76cb3ee4dbcadab482b235f533781cbfe080f35fed1be7a5 WatchSource:0}: Error finding container 2cabc811c154cf3c76cb3ee4dbcadab482b235f533781cbfe080f35fed1be7a5: Status 404 returned error can't find the container with id 2cabc811c154cf3c76cb3ee4dbcadab482b235f533781cbfe080f35fed1be7a5
Jul 15 22:51:34.150707 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:34.150673    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:34.150791 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:34.150739    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:34.150791 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:34.150765    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:34.626962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:34.626874    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" event={"ID":"762a9f8e-f004-45e2-8a70-4312b536997c","Type":"ContainerStarted","Data":"42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106"}
Jul 15 22:51:34.626962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:34.626928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" event={"ID":"762a9f8e-f004-45e2-8a70-4312b536997c","Type":"ContainerStarted","Data":"2cabc811c154cf3c76cb3ee4dbcadab482b235f533781cbfe080f35fed1be7a5"}
Jul 15 22:51:34.666211 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:34.666159    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" podStartSLOduration=1.666143304 podStartE2EDuration="1.666143304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:51:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:51:34.6650908 +0000 UTC m=+2151.190114029" watchObservedRunningTime="2026-07-15 22:51:34.666143304 +0000 UTC m=+2151.191166523"
Jul 15 22:51:35.000629 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:35.000593    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:35.005700 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:35.005676    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:35.631852 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:35.631817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:35.632710 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:35.632689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:36.618875 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.618795    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:51:36.872848 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.872749    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"]
Jul 15 22:51:36.876588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.876564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:36.880694 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.880670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7fdd49-serving-cert\""
Jul 15 22:51:36.901803 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.901775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"]
Jul 15 22:51:36.981501 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.981463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2254be25-5a60-4bff-80c5-5add9558fc2b-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:36.981682 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.981641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj79t\" (UniqueName: \"kubernetes.io/projected/2254be25-5a60-4bff-80c5-5add9558fc2b-kube-api-access-nj79t\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:36.981747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:36.981705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2254be25-5a60-4bff-80c5-5add9558fc2b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.082941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.082900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2254be25-5a60-4bff-80c5-5add9558fc2b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.082941 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.082945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2254be25-5a60-4bff-80c5-5add9558fc2b-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.083154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.083048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj79t\" (UniqueName: \"kubernetes.io/projected/2254be25-5a60-4bff-80c5-5add9558fc2b-kube-api-access-nj79t\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.083646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.083621    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2254be25-5a60-4bff-80c5-5add9558fc2b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.085537 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.085512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2254be25-5a60-4bff-80c5-5add9558fc2b-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.102930 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.102898    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj79t\" (UniqueName: \"kubernetes.io/projected/2254be25-5a60-4bff-80c5-5add9558fc2b-kube-api-access-nj79t\") pod \"maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.189820 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.189790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:37.368042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.368016    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"]
Jul 15 22:51:37.369711 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:51:37.369682    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2254be25_5a60_4bff_80c5_5add9558fc2b.slice/crio-8ba7e092bd1df5610d489708d840af8634e9f987b57f6b4d28a36a11d8f39b74 WatchSource:0}: Error finding container 8ba7e092bd1df5610d489708d840af8634e9f987b57f6b4d28a36a11d8f39b74: Status 404 returned error can't find the container with id 8ba7e092bd1df5610d489708d840af8634e9f987b57f6b4d28a36a11d8f39b74
Jul 15 22:51:37.642942 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:37.642847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb" event={"ID":"2254be25-5a60-4bff-80c5-5add9558fc2b","Type":"ContainerStarted","Data":"8ba7e092bd1df5610d489708d840af8634e9f987b57f6b4d28a36a11d8f39b74"}
Jul 15 22:51:38.662917 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:38.662866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb" event={"ID":"2254be25-5a60-4bff-80c5-5add9558fc2b","Type":"ContainerStarted","Data":"603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2"}
Jul 15 22:51:38.663366 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:38.662996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:38.687755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:38.687701    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb" podStartSLOduration=2.302229738 podStartE2EDuration="2.687685842s" totalImagesPullingTime="385.456104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:51:38.685860885 +0000 UTC m=+2155.210884105" watchObservedRunningTime="2026-07-15 22:51:38.687685842 +0000 UTC m=+2155.212709075"
Jul 15 22:51:44.647274 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:44.634548    2580 patch_prober.go:28] interesting pod/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 22:51:44.647274 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:44.634635    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 22:51:44.673412 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:44.673378    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:51:45.702617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:45.702580    2580 generic.go:356] "Generic (PLEG): container finished" podID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerID="1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300" exitCode=0
Jul 15 22:51:45.703020 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:45.702624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" event={"ID":"881e4f74-b92c-4c99-8d75-529e1965a9b7","Type":"ContainerDied","Data":"1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300"}
Jul 15 22:51:45.703062 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:45.703020    2580 scope.go:117] "RemoveContainer" containerID="1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300"
Jul 15 22:51:45.704048 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:45.704017    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:45.704102 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:45.704088    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:45.704143 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:45.704123    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:46.709518 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:46.709485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" event={"ID":"881e4f74-b92c-4c99-8d75-529e1965a9b7","Type":"ContainerStarted","Data":"f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189"}
Jul 15 22:51:46.822915 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:46.822874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:46.823136 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:46.823112    2580 patch_prober.go:28] interesting pod/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:51:46.823179 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:46.823166    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:51:47.823495 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:47.823457    2580 patch_prober.go:28] interesting pod/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:51:47.823904 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:47.823516    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:51:48.823593 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:48.823538    2580 patch_prober.go:28] interesting pod/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:51:48.824118 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:48.823616    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:51:49.822955 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:49.822901    2580 patch_prober.go:28] interesting pod/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:51:49.823160 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:49.822986    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:51:50.826607 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:50.826569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:50.827018 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:50.826850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:50.827518 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:50.827496    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:51:51.416480 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.415441    2580 patch_prober.go:28] interesting pod/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:52084->10.132.0.66:15021: read: connection reset by peer" start-of-body=
Jul 15 22:51:51.416480 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.415520    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:52084->10.132.0.66:15021: read: connection reset by peer"
Jul 15 22:51:51.736989 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.736954    2580 generic.go:356] "Generic (PLEG): container finished" podID="762a9f8e-f004-45e2-8a70-4312b536997c" containerID="42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106" exitCode=0
Jul 15 22:51:51.737172 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.737035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" event={"ID":"762a9f8e-f004-45e2-8a70-4312b536997c","Type":"ContainerDied","Data":"42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106"}
Jul 15 22:51:51.737643 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.737627    2580 scope.go:117] "RemoveContainer" containerID="42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106"
Jul 15 22:51:51.738658 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.738628    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:51.738747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.738694    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:51.738747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:51.738726    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:51:52.747655 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:52.747610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" event={"ID":"762a9f8e-f004-45e2-8a70-4312b536997c","Type":"ContainerStarted","Data":"d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4"}
Jul 15 22:51:53.000469 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:53.000364    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:53.000635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:53.000591    2580 patch_prober.go:28] interesting pod/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 22:51:53.000680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:53.000637    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 22:51:54.000039 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:54.000000    2580 patch_prober.go:28] interesting pod/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 22:51:54.000503 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:54.000071    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 22:51:55.000426 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:55.000390    2580 patch_prober.go:28] interesting pod/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 22:51:55.000858 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:55.000451    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 22:51:56.000064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:56.000031    2580 patch_prober.go:28] interesting pod/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 15 22:51:56.000288 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:56.000085    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 15 22:51:57.003645 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:57.003608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:57.004185 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:57.003874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:51:57.004819 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:51:57.004798    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:52:51.377371 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.377335    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"]
Jul 15 22:52:51.377972 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.377570    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf" podUID="e6331c4e-e84d-48b9-aa44-4d407fc09485" containerName="maas-api" containerID="cri-o://695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456" gracePeriod=30
Jul 15 22:52:51.647825 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.647798    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:52:51.731083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.731045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdchs\" (UniqueName: \"kubernetes.io/projected/e6331c4e-e84d-48b9-aa44-4d407fc09485-kube-api-access-mdchs\") pod \"e6331c4e-e84d-48b9-aa44-4d407fc09485\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") "
Jul 15 22:52:51.731316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.731106    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6331c4e-e84d-48b9-aa44-4d407fc09485-maas-api-tls\") pod \"e6331c4e-e84d-48b9-aa44-4d407fc09485\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") "
Jul 15 22:52:51.731316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.731162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6331c4e-e84d-48b9-aa44-4d407fc09485-openshift-service-ca\") pod \"e6331c4e-e84d-48b9-aa44-4d407fc09485\" (UID: \"e6331c4e-e84d-48b9-aa44-4d407fc09485\") "
Jul 15 22:52:51.731506 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.731481    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6331c4e-e84d-48b9-aa44-4d407fc09485-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6331c4e-e84d-48b9-aa44-4d407fc09485" (UID: "e6331c4e-e84d-48b9-aa44-4d407fc09485"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:52:51.733317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.733288    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6331c4e-e84d-48b9-aa44-4d407fc09485-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6331c4e-e84d-48b9-aa44-4d407fc09485" (UID: "e6331c4e-e84d-48b9-aa44-4d407fc09485"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:52:51.733429 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.733379    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6331c4e-e84d-48b9-aa44-4d407fc09485-kube-api-access-mdchs" (OuterVolumeSpecName: "kube-api-access-mdchs") pod "e6331c4e-e84d-48b9-aa44-4d407fc09485" (UID: "e6331c4e-e84d-48b9-aa44-4d407fc09485"). InnerVolumeSpecName "kube-api-access-mdchs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:52:51.832956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.832915    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdchs\" (UniqueName: \"kubernetes.io/projected/e6331c4e-e84d-48b9-aa44-4d407fc09485-kube-api-access-mdchs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:52:51.832956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.832950    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6331c4e-e84d-48b9-aa44-4d407fc09485-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:52:51.832956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:51.832960    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6331c4e-e84d-48b9-aa44-4d407fc09485-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:52:52.060698 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.060663    2580 generic.go:356] "Generic (PLEG): container finished" podID="e6331c4e-e84d-48b9-aa44-4d407fc09485" containerID="695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456" exitCode=0
Jul 15 22:52:52.060862 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.060713    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"
Jul 15 22:52:52.060862 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.060750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf" event={"ID":"e6331c4e-e84d-48b9-aa44-4d407fc09485","Type":"ContainerDied","Data":"695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456"}
Jul 15 22:52:52.060862 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.060807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf" event={"ID":"e6331c4e-e84d-48b9-aa44-4d407fc09485","Type":"ContainerDied","Data":"780ae5501241dbaa76f9161a8e3d9fd2b79f86d61574449415b294a6367a12f9"}
Jul 15 22:52:52.060862 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.060837    2580 scope.go:117] "RemoveContainer" containerID="695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456"
Jul 15 22:52:52.069760 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.069747    2580 scope.go:117] "RemoveContainer" containerID="695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456"
Jul 15 22:52:52.070045 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:52:52.070025    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456\": container with ID starting with 695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456 not found: ID does not exist" containerID="695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456"
Jul 15 22:52:52.070090 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.070054    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456"} err="failed to get container status \"695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456\": rpc error: code = NotFound desc = could not find container \"695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456\": container with ID starting with 695a424d33703a1d6bc1266f442657d112ab22bf764196bfe49a77d9f8f30456 not found: ID does not exist"
Jul 15 22:52:52.079139 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.079114    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"]
Jul 15 22:52:52.089350 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:52.084026    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf"]
Jul 15 22:52:54.011213 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:54.011175    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6331c4e-e84d-48b9-aa44-4d407fc09485" path="/var/lib/kubelet/pods/e6331c4e-e84d-48b9-aa44-4d407fc09485/volumes"
Jul 15 22:52:54.611813 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:52:54.611767    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-30c9f8-956c9bbcf-2d7kf" podUID="e6331c4e-e84d-48b9-aa44-4d407fc09485" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.65:8443/health\": context deadline exceeded"
Jul 15 22:53:06.561680 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:06.561595    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"]
Jul 15 22:53:06.562098 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:06.561840    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy" containerID="cri-o://f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189" gracePeriod=30
Jul 15 22:53:11.829134 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.829048    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:53:11.927758 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927717    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-socket\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.927758 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927762    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-envoy\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928014 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-certs\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928014 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927829    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd5nz\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-kube-api-access-zd5nz\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928014 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927854    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-credential-socket\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928014 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927870    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-token\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928014 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927897    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-podinfo\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928014 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927927    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-data\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928014 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.927994    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881e4f74-b92c-4c99-8d75-529e1965a9b7-istiod-ca-cert\") pod \"881e4f74-b92c-4c99-8d75-529e1965a9b7\" (UID: \"881e4f74-b92c-4c99-8d75-529e1965a9b7\") "
Jul 15 22:53:11.928368 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.928099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:11.928368 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.928204    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:11.928493 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.928393    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:11.928493 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.928410    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:11.928599 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.928535    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/881e4f74-b92c-4c99-8d75-529e1965a9b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:53:11.928652 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.928587    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:11.929235 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.929210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:11.930146 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.930116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:53:11.930261 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.930148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-kube-api-access-zd5nz" (OuterVolumeSpecName: "kube-api-access-zd5nz") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "kube-api-access-zd5nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:53:11.930446 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.930426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:11.930488 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:11.930462    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "881e4f74-b92c-4c99-8d75-529e1965a9b7" (UID: "881e4f74-b92c-4c99-8d75-529e1965a9b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:53:12.029712 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.029675    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:12.029712 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.029707    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:12.029712 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.029715    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:12.029929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.029723    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/881e4f74-b92c-4c99-8d75-529e1965a9b7-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:12.029929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.029731    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:12.029929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.029740    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/881e4f74-b92c-4c99-8d75-529e1965a9b7-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:12.029929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.029750    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd5nz\" (UniqueName: \"kubernetes.io/projected/881e4f74-b92c-4c99-8d75-529e1965a9b7-kube-api-access-zd5nz\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:12.175950 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.175916    2580 generic.go:356] "Generic (PLEG): container finished" podID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerID="f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189" exitCode=0
Jul 15 22:53:12.176123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.175992    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"
Jul 15 22:53:12.176123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.176008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" event={"ID":"881e4f74-b92c-4c99-8d75-529e1965a9b7","Type":"ContainerDied","Data":"f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189"}
Jul 15 22:53:12.176123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.176081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr" event={"ID":"881e4f74-b92c-4c99-8d75-529e1965a9b7","Type":"ContainerDied","Data":"88e771212880093c2a0e225a2a57cf85abbce9dd8456cfaef9cc9974e37bdb79"}
Jul 15 22:53:12.176123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.176118    2580 scope.go:117] "RemoveContainer" containerID="f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189"
Jul 15 22:53:12.187031 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.187005    2580 scope.go:117] "RemoveContainer" containerID="1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300"
Jul 15 22:53:12.194552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.194524    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"]
Jul 15 22:53:12.196520 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.196499    2580 scope.go:117] "RemoveContainer" containerID="f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189"
Jul 15 22:53:12.196837 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:12.196817    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189\": container with ID starting with f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189 not found: ID does not exist" containerID="f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189"
Jul 15 22:53:12.196958 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.196849    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189"} err="failed to get container status \"f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189\": rpc error: code = NotFound desc = could not find container \"f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189\": container with ID starting with f049a15c05d7d607c0893cc375a7316e7e88477994d41d3089d140fc8c1fa189 not found: ID does not exist"
Jul 15 22:53:12.196958 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.196872    2580 scope.go:117] "RemoveContainer" containerID="1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300"
Jul 15 22:53:12.197175 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:12.197143    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300\": container with ID starting with 1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300 not found: ID does not exist" containerID="1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300"
Jul 15 22:53:12.197382 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.197183    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300"} err="failed to get container status \"1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300\": rpc error: code = NotFound desc = could not find container \"1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300\": container with ID starting with 1ca623456569d89735f940ec932ca228fc336e84b2355700299c20252b17d300 not found: ID does not exist"
Jul 15 22:53:12.200005 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:12.199983    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-30c9f8-openshift-default-8444489b59-txpkr"]
Jul 15 22:53:14.010672 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:14.010637    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" path="/var/lib/kubelet/pods/881e4f74-b92c-4c99-8d75-529e1965a9b7/volumes"
Jul 15 22:53:17.649924 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.649887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"]
Jul 15 22:53:17.650383 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.650095    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb" podUID="2254be25-5a60-4bff-80c5-5add9558fc2b" containerName="maas-api" containerID="cri-o://603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2" gracePeriod=30
Jul 15 22:53:17.909371 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.909311    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:53:17.987854 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.987823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2254be25-5a60-4bff-80c5-5add9558fc2b-openshift-service-ca\") pod \"2254be25-5a60-4bff-80c5-5add9558fc2b\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") "
Jul 15 22:53:17.988016 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.987926    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj79t\" (UniqueName: \"kubernetes.io/projected/2254be25-5a60-4bff-80c5-5add9558fc2b-kube-api-access-nj79t\") pod \"2254be25-5a60-4bff-80c5-5add9558fc2b\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") "
Jul 15 22:53:17.988016 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.987969    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2254be25-5a60-4bff-80c5-5add9558fc2b-maas-api-tls\") pod \"2254be25-5a60-4bff-80c5-5add9558fc2b\" (UID: \"2254be25-5a60-4bff-80c5-5add9558fc2b\") "
Jul 15 22:53:17.988184 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.988160    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2254be25-5a60-4bff-80c5-5add9558fc2b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2254be25-5a60-4bff-80c5-5add9558fc2b" (UID: "2254be25-5a60-4bff-80c5-5add9558fc2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:53:17.990042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.990018    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2254be25-5a60-4bff-80c5-5add9558fc2b-kube-api-access-nj79t" (OuterVolumeSpecName: "kube-api-access-nj79t") pod "2254be25-5a60-4bff-80c5-5add9558fc2b" (UID: "2254be25-5a60-4bff-80c5-5add9558fc2b"). InnerVolumeSpecName "kube-api-access-nj79t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:53:17.990151 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:17.990056    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2254be25-5a60-4bff-80c5-5add9558fc2b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2254be25-5a60-4bff-80c5-5add9558fc2b" (UID: "2254be25-5a60-4bff-80c5-5add9558fc2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:53:18.089029 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.089000    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj79t\" (UniqueName: \"kubernetes.io/projected/2254be25-5a60-4bff-80c5-5add9558fc2b-kube-api-access-nj79t\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:18.089029 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.089026    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2254be25-5a60-4bff-80c5-5add9558fc2b-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:18.089201 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.089035    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2254be25-5a60-4bff-80c5-5add9558fc2b-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:18.207339 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.207302    2580 generic.go:356] "Generic (PLEG): container finished" podID="2254be25-5a60-4bff-80c5-5add9558fc2b" containerID="603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2" exitCode=0
Jul 15 22:53:18.207339 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.207342    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"
Jul 15 22:53:18.207559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.207381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb" event={"ID":"2254be25-5a60-4bff-80c5-5add9558fc2b","Type":"ContainerDied","Data":"603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2"}
Jul 15 22:53:18.207559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.207440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb" event={"ID":"2254be25-5a60-4bff-80c5-5add9558fc2b","Type":"ContainerDied","Data":"8ba7e092bd1df5610d489708d840af8634e9f987b57f6b4d28a36a11d8f39b74"}
Jul 15 22:53:18.207559 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.207463    2580 scope.go:117] "RemoveContainer" containerID="603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2"
Jul 15 22:53:18.216077 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.216049    2580 scope.go:117] "RemoveContainer" containerID="603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2"
Jul 15 22:53:18.216379 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:18.216356    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2\": container with ID starting with 603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2 not found: ID does not exist" containerID="603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2"
Jul 15 22:53:18.216499 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.216384    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2"} err="failed to get container status \"603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2\": rpc error: code = NotFound desc = could not find container \"603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2\": container with ID starting with 603806d99f2b071eeabbf8cf36bb8c5956cbe7345a4d0bb19bb2e587f0f6a3c2 not found: ID does not exist"
Jul 15 22:53:18.226460 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.226434    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"]
Jul 15 22:53:18.230930 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:18.230901    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fdd49-75f648f467-5wrjb"]
Jul 15 22:53:20.012158 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:20.012123    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2254be25-5a60-4bff-80c5-5add9558fc2b" path="/var/lib/kubelet/pods/2254be25-5a60-4bff-80c5-5add9558fc2b/volumes"
Jul 15 22:53:32.672166 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:32.672131    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"]
Jul 15 22:53:32.672741 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:32.672380    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy" containerID="cri-o://d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4" gracePeriod=30
Jul 15 22:53:33.541146 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541114    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"]
Jul 15 22:53:33.541549 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541534    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6331c4e-e84d-48b9-aa44-4d407fc09485" containerName="maas-api"
Jul 15 22:53:33.541549 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541550    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6331c4e-e84d-48b9-aa44-4d407fc09485" containerName="maas-api"
Jul 15 22:53:33.541647 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541559    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy"
Jul 15 22:53:33.541647 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541565    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy"
Jul 15 22:53:33.541647 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541579    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy"
Jul 15 22:53:33.541647 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541586    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy"
Jul 15 22:53:33.541647 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541600    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2254be25-5a60-4bff-80c5-5add9558fc2b" containerName="maas-api"
Jul 15 22:53:33.541647 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541605    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2254be25-5a60-4bff-80c5-5add9558fc2b" containerName="maas-api"
Jul 15 22:53:33.541838 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541668    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy"
Jul 15 22:53:33.541838 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541675    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="881e4f74-b92c-4c99-8d75-529e1965a9b7" containerName="istio-proxy"
Jul 15 22:53:33.541838 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541682    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6331c4e-e84d-48b9-aa44-4d407fc09485" containerName="maas-api"
Jul 15 22:53:33.541838 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.541689    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2254be25-5a60-4bff-80c5-5add9558fc2b" containerName="maas-api"
Jul 15 22:53:33.544935 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.544917    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.547583 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.547563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d5616e-openshift-default-dockercfg-9fsrz\""
Jul 15 22:53:33.560043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.560020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"]
Jul 15 22:53:33.628317 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpzsj\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-kube-api-access-jpzsj\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-certs\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628440 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-istio-token\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628542 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-envoy\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628542 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a51ba4f6-0295-48bb-b62a-50689771daac-istiod-ca-cert\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-credential-socket\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628646 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-data\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628756 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a51ba4f6-0295-48bb-b62a-50689771daac-istio-podinfo\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.628756 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.628709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-socket\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.729645 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-certs\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-istio-token\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-envoy\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a51ba4f6-0295-48bb-b62a-50689771daac-istiod-ca-cert\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-credential-socket\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-data\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a51ba4f6-0295-48bb-b62a-50689771daac-istio-podinfo\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.729908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-socket\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.730035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpzsj\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-kube-api-access-jpzsj\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730504 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.730147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-credential-socket\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730504 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.730217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-certs\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730504 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.730285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-data\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730656 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.730531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-socket\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.730656 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.730542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a51ba4f6-0295-48bb-b62a-50689771daac-istiod-ca-cert\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.732368 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.732347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a51ba4f6-0295-48bb-b62a-50689771daac-istio-podinfo\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.732466 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.732376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-envoy\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.738218 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.738197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-istio-token\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.738469 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.738451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpzsj\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-kube-api-access-jpzsj\") pod \"e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") " pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.854928 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.854860    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:33.994932 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.994907    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"]
Jul 15 22:53:33.996579 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:53:33.996548    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51ba4f6_0295_48bb_b62a_50689771daac.slice/crio-3d80b647780d0d83858da731cc25fdeb47c59c1cf7093c89b66b45d83179d09e WatchSource:0}: Error finding container 3d80b647780d0d83858da731cc25fdeb47c59c1cf7093c89b66b45d83179d09e: Status 404 returned error can't find the container with id 3d80b647780d0d83858da731cc25fdeb47c59c1cf7093c89b66b45d83179d09e
Jul 15 22:53:33.998868 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.998827    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:33.998962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.998892    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:33.998962 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:33.998923    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:34.292881 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:34.292847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" event={"ID":"a51ba4f6-0295-48bb-b62a-50689771daac","Type":"ContainerStarted","Data":"e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8"}
Jul 15 22:53:34.293056 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:34.292899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" event={"ID":"a51ba4f6-0295-48bb-b62a-50689771daac","Type":"ContainerStarted","Data":"3d80b647780d0d83858da731cc25fdeb47c59c1cf7093c89b66b45d83179d09e"}
Jul 15 22:53:34.317956 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:34.317889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" podStartSLOduration=1.317868998 podStartE2EDuration="1.317868998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:53:34.315193418 +0000 UTC m=+2270.840216648" watchObservedRunningTime="2026-07-15 22:53:34.317868998 +0000 UTC m=+2270.842892219"
Jul 15 22:53:34.855853 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:34.855823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:35.860596 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:35.860564    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:36.302672 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.302628    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:36.303607 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.303584    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:36.388461 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.388424    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"]
Jul 15 22:53:36.392164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.392132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.396018 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.395995    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d5616e-serving-cert\""
Jul 15 22:53:36.413477 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.413453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"]
Jul 15 22:53:36.559444 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.559344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.559594 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.559454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2znrg\" (UniqueName: \"kubernetes.io/projected/f8f5c247-55a4-4086-a374-84c5745dca55-kube-api-access-2znrg\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.559594 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.559480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5c247-55a4-4086-a374-84c5745dca55-openshift-service-ca\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.660321 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.660288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znrg\" (UniqueName: \"kubernetes.io/projected/f8f5c247-55a4-4086-a374-84c5745dca55-kube-api-access-2znrg\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.660483 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.660325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5c247-55a4-4086-a374-84c5745dca55-openshift-service-ca\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.660483 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.660424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.660565 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:36.660538    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-serving-cert: secret "maas-api-e2e-api-a-d5616e-serving-cert" not found
Jul 15 22:53:36.660644 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:36.660631    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls podName:f8f5c247-55a4-4086-a374-84c5745dca55 nodeName:}" failed. No retries permitted until 2026-07-15 22:53:37.160606351 +0000 UTC m=+2273.685629567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls") pod "maas-api-e2e-api-a-d5616e-666f49cf68-74f7j" (UID: "f8f5c247-55a4-4086-a374-84c5745dca55") : secret "maas-api-e2e-api-a-d5616e-serving-cert" not found
Jul 15 22:53:36.661100 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.661082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5c247-55a4-4086-a374-84c5745dca55-openshift-service-ca\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:36.674491 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:36.674468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2znrg\" (UniqueName: \"kubernetes.io/projected/f8f5c247-55a4-4086-a374-84c5745dca55-kube-api-access-2znrg\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:37.165659 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:37.165292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:37.168443 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:37.168414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls\") pod \"maas-api-e2e-api-a-d5616e-666f49cf68-74f7j\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:37.304138 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:37.304098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:37.445452 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:37.445422    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"]
Jul 15 22:53:37.446927 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:53:37.446903    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f5c247_55a4_4086_a374_84c5745dca55.slice/crio-42950416d905216c49bb3f414a7d871b30ac6df57d80b552bc6c3b4a88c8099f WatchSource:0}: Error finding container 42950416d905216c49bb3f414a7d871b30ac6df57d80b552bc6c3b4a88c8099f: Status 404 returned error can't find the container with id 42950416d905216c49bb3f414a7d871b30ac6df57d80b552bc6c3b4a88c8099f
Jul 15 22:53:37.448542 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:37.448521    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:53:37.920533 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:37.920509    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:53:38.075985 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.075960    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-socket\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076084 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-envoy\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076084 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-istio-token\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076196 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076101    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdbqk\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-kube-api-access-sdbqk\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076196 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076145    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-data\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076400 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076229    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-credential-socket\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076400 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076237    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:38.076400 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-certs\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076400 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076338    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/762a9f8e-f004-45e2-8a70-4312b536997c-istio-podinfo\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076400 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076374    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/762a9f8e-f004-45e2-8a70-4312b536997c-istiod-ca-cert\") pod \"762a9f8e-f004-45e2-8a70-4312b536997c\" (UID: \"762a9f8e-f004-45e2-8a70-4312b536997c\") "
Jul 15 22:53:38.076668 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076491    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:38.076727 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076659    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:38.076781 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076753    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762a9f8e-f004-45e2-8a70-4312b536997c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:53:38.076845 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076781    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.076845 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076803    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.076845 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.076818    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.077617 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.077589    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-data" (OuterVolumeSpecName: "istio-data") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:38.078399 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.078368    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:53:38.078490 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.078443    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-istio-token" (OuterVolumeSpecName: "istio-token") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:53:38.078613 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.078575    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/762a9f8e-f004-45e2-8a70-4312b536997c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:53:38.078700 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.078617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-kube-api-access-sdbqk" (OuterVolumeSpecName: "kube-api-access-sdbqk") pod "762a9f8e-f004-45e2-8a70-4312b536997c" (UID: "762a9f8e-f004-45e2-8a70-4312b536997c"). InnerVolumeSpecName "kube-api-access-sdbqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:53:38.178267 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.178224    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.178267 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.178273    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.178650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.178284    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdbqk\" (UniqueName: \"kubernetes.io/projected/762a9f8e-f004-45e2-8a70-4312b536997c-kube-api-access-sdbqk\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.178650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.178293    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/762a9f8e-f004-45e2-8a70-4312b536997c-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.178650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.178302    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/762a9f8e-f004-45e2-8a70-4312b536997c-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.178650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.178309    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/762a9f8e-f004-45e2-8a70-4312b536997c-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:53:38.315595 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.315497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j" event={"ID":"f8f5c247-55a4-4086-a374-84c5745dca55","Type":"ContainerStarted","Data":"195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e"}
Jul 15 22:53:38.315595 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.315574    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:38.315807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.315600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j" event={"ID":"f8f5c247-55a4-4086-a374-84c5745dca55","Type":"ContainerStarted","Data":"42950416d905216c49bb3f414a7d871b30ac6df57d80b552bc6c3b4a88c8099f"}
Jul 15 22:53:38.317134 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.317109    2580 generic.go:356] "Generic (PLEG): container finished" podID="762a9f8e-f004-45e2-8a70-4312b536997c" containerID="d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4" exitCode=0
Jul 15 22:53:38.317281 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.317153    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"
Jul 15 22:53:38.317281 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.317190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" event={"ID":"762a9f8e-f004-45e2-8a70-4312b536997c","Type":"ContainerDied","Data":"d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4"}
Jul 15 22:53:38.317281 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.317235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7" event={"ID":"762a9f8e-f004-45e2-8a70-4312b536997c","Type":"ContainerDied","Data":"2cabc811c154cf3c76cb3ee4dbcadab482b235f533781cbfe080f35fed1be7a5"}
Jul 15 22:53:38.317281 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.317271    2580 scope.go:117] "RemoveContainer" containerID="d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4"
Jul 15 22:53:38.327050 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.327030    2580 scope.go:117] "RemoveContainer" containerID="42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106"
Jul 15 22:53:38.334805 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.334766    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j" podStartSLOduration=1.7957583449999999 podStartE2EDuration="2.334753379s" totalImagesPullingTime="538.995034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:53:38.333513964 +0000 UTC m=+2274.858537185" watchObservedRunningTime="2026-07-15 22:53:38.334753379 +0000 UTC m=+2274.859776613"
Jul 15 22:53:38.335499 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.335480    2580 scope.go:117] "RemoveContainer" containerID="d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4"
Jul 15 22:53:38.335734 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:38.335712    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4\": container with ID starting with d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4 not found: ID does not exist" containerID="d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4"
Jul 15 22:53:38.335801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.335741    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4"} err="failed to get container status \"d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4\": rpc error: code = NotFound desc = could not find container \"d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4\": container with ID starting with d0aac84ce00967fad21df44ae406e8e6e6aab777270b42dce7d4474da926d5b4 not found: ID does not exist"
Jul 15 22:53:38.335801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.335758    2580 scope.go:117] "RemoveContainer" containerID="42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106"
Jul 15 22:53:38.335945 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:38.335926    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106\": container with ID starting with 42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106 not found: ID does not exist" containerID="42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106"
Jul 15 22:53:38.336006 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.335952    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106"} err="failed to get container status \"42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106\": rpc error: code = NotFound desc = could not find container \"42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106\": container with ID starting with 42ec9d11a709cecd338a55920ebe6895647f6d277fc866904e5b7ff4417d8106 not found: ID does not exist"
Jul 15 22:53:38.348878 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.348854    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"]
Jul 15 22:53:38.357277 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:38.357237    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-7fdd49-openshift-default-795cff5b7f-g5qg7"]
Jul 15 22:53:40.010985 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:40.010943    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" path="/var/lib/kubelet/pods/762a9f8e-f004-45e2-8a70-4312b536997c/volumes"
Jul 15 22:53:41.515081 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.515044    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"]
Jul 15 22:53:41.515523 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.515507    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy"
Jul 15 22:53:41.515571 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.515525    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy"
Jul 15 22:53:41.515571 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.515543    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy"
Jul 15 22:53:41.515571 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.515549    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy"
Jul 15 22:53:41.515669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.515614    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy"
Jul 15 22:53:41.515669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.515625    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="762a9f8e-f004-45e2-8a70-4312b536997c" containerName="istio-proxy"
Jul 15 22:53:41.520096 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.520079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.524635 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.524612    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-72a6d5-openshift-default-dockercfg-ft8rt\""
Jul 15 22:53:41.535426 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.535401    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"]
Jul 15 22:53:41.609009 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.608982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c22e58-09ff-4686-ae4e-870f963a404e-istiod-ca-cert\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-credential-socket\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609144 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-istio-token\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609229 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdk66\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-kube-api-access-hdk66\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609229 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-envoy\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609229 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-certs\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609360 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c22e58-09ff-4686-ae4e-870f963a404e-istio-podinfo\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609360 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-socket\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.609428 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.609361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-data\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.709887 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.709854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-istio-token\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.710059 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.709907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdk66\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-kube-api-access-hdk66\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.710059 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.709946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-envoy\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.710461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-certs\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.710817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-certs\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.710841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c22e58-09ff-4686-ae4e-870f963a404e-istio-podinfo\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.710924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-socket\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.710982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-data\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.711025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c22e58-09ff-4686-ae4e-870f963a404e-istiod-ca-cert\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.711098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-credential-socket\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.711492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-credential-socket\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.711733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-socket\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712214 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.711962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-data\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.712820 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.712665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c22e58-09ff-4686-ae4e-870f963a404e-istiod-ca-cert\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.718327 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.713334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-envoy\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.718327 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.713733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c22e58-09ff-4686-ae4e-870f963a404e-istio-podinfo\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.719602 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.719577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdk66\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-kube-api-access-hdk66\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.720036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.720018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-istio-token\") pod \"e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") " pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.830711 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.830636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:41.976429 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.976409    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"]
Jul 15 22:53:41.979147 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:53:41.979117    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c22e58_09ff_4686_ae4e_870f963a404e.slice/crio-f5dfcd802bc499d01dd138e494d3d61d284059542c655c81eda6c71b9816c61b WatchSource:0}: Error finding container f5dfcd802bc499d01dd138e494d3d61d284059542c655c81eda6c71b9816c61b: Status 404 returned error can't find the container with id f5dfcd802bc499d01dd138e494d3d61d284059542c655c81eda6c71b9816c61b
Jul 15 22:53:41.981573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.981526    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:41.981668 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.981601    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:41.981668 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:41.981642    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:42.341528 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:42.341483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" event={"ID":"18c22e58-09ff-4686-ae4e-870f963a404e","Type":"ContainerStarted","Data":"6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815"}
Jul 15 22:53:42.341734 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:42.341556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" event={"ID":"18c22e58-09ff-4686-ae4e-870f963a404e","Type":"ContainerStarted","Data":"f5dfcd802bc499d01dd138e494d3d61d284059542c655c81eda6c71b9816c61b"}
Jul 15 22:53:42.378945 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:42.378879    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podStartSLOduration=1.378853908 podStartE2EDuration="1.378853908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:53:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:53:42.375525705 +0000 UTC m=+2278.900548926" watchObservedRunningTime="2026-07-15 22:53:42.378853908 +0000 UTC m=+2278.903877130"
Jul 15 22:53:42.830990 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:42.830943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:43.848463 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:43.848428    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:44.328937 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.328907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:53:44.361266 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.360484    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:44.363056 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.363036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:53:44.630091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.630006    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"]
Jul 15 22:53:44.646730 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.646698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.659115 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.656531    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-72a6d5-serving-cert\""
Jul 15 22:53:44.659115 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.656655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"]
Jul 15 22:53:44.763753 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.763711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb74196-5630-4a73-9288-efa4e301d513-openshift-service-ca\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.763946 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.763765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xj62\" (UniqueName: \"kubernetes.io/projected/6bb74196-5630-4a73-9288-efa4e301d513-kube-api-access-6xj62\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.764043 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.764014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.864610 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.864570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.865068 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.864627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb74196-5630-4a73-9288-efa4e301d513-openshift-service-ca\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.865068 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:44.864722    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-serving-cert: secret "maas-api-e2e-api-b-72a6d5-serving-cert" not found
Jul 15 22:53:44.865068 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.864760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xj62\" (UniqueName: \"kubernetes.io/projected/6bb74196-5630-4a73-9288-efa4e301d513-kube-api-access-6xj62\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.865068 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:53:44.864799    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls podName:6bb74196-5630-4a73-9288-efa4e301d513 nodeName:}" failed. No retries permitted until 2026-07-15 22:53:45.364780834 +0000 UTC m=+2281.889804032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls") pod "maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf" (UID: "6bb74196-5630-4a73-9288-efa4e301d513") : secret "maas-api-e2e-api-b-72a6d5-serving-cert" not found
Jul 15 22:53:44.865355 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.865337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb74196-5630-4a73-9288-efa4e301d513-openshift-service-ca\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:44.876036 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:44.876005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xj62\" (UniqueName: \"kubernetes.io/projected/6bb74196-5630-4a73-9288-efa4e301d513-kube-api-access-6xj62\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:45.370195 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:45.370158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:45.372591 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:45.372564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls\") pod \"maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:45.582195 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:45.582163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:45.762997 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:45.762961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"]
Jul 15 22:53:45.764877 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:53:45.764841    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb74196_5630_4a73_9288_efa4e301d513.slice/crio-76ebda2ddfdd247062841ba63ae6b2f4b7485c18fc3d51cc9420d9bf4bf9ea3f WatchSource:0}: Error finding container 76ebda2ddfdd247062841ba63ae6b2f4b7485c18fc3d51cc9420d9bf4bf9ea3f: Status 404 returned error can't find the container with id 76ebda2ddfdd247062841ba63ae6b2f4b7485c18fc3d51cc9420d9bf4bf9ea3f
Jul 15 22:53:46.371458 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:46.371354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf" event={"ID":"6bb74196-5630-4a73-9288-efa4e301d513","Type":"ContainerStarted","Data":"bd6aeadb6ba3519228dd22c332ab0dd1e3766c6c60280a76209ea35d190974f9"}
Jul 15 22:53:46.371458 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:46.371411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf" event={"ID":"6bb74196-5630-4a73-9288-efa4e301d513","Type":"ContainerStarted","Data":"76ebda2ddfdd247062841ba63ae6b2f4b7485c18fc3d51cc9420d9bf4bf9ea3f"}
Jul 15 22:53:46.394603 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:46.394550    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf" podStartSLOduration=2.069902529 podStartE2EDuration="2.394533759s" totalImagesPullingTime="324.63123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:53:46.392895193 +0000 UTC m=+2282.917918412" watchObservedRunningTime="2026-07-15 22:53:46.394533759 +0000 UTC m=+2282.919556978"
Jul 15 22:53:47.378862 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:47.378828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:49.389916 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:49.389818    2580 generic.go:356] "Generic (PLEG): container finished" podID="a51ba4f6-0295-48bb-b62a-50689771daac" containerID="e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8" exitCode=0
Jul 15 22:53:49.389916 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:49.389895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" event={"ID":"a51ba4f6-0295-48bb-b62a-50689771daac","Type":"ContainerDied","Data":"e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8"}
Jul 15 22:53:49.390464 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:49.390354    2580 scope.go:117] "RemoveContainer" containerID="e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8"
Jul 15 22:53:49.391506 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:49.391476    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:49.391622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:49.391540    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:49.391622 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:49.391570    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:53:50.398215 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:50.398181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" event={"ID":"a51ba4f6-0295-48bb-b62a-50689771daac","Type":"ContainerStarted","Data":"72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0"}
Jul 15 22:53:50.856189 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:50.856145    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:50.857509 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:50.857472    2580 patch_prober.go:28] interesting pod/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 22:53:50.857632 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:50.857541    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 22:53:51.303155 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:51.303112    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:51.855326 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:51.855282    2580 patch_prober.go:28] interesting pod/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 22:53:51.855929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:51.855896    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 22:53:52.855706 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:52.855657    2580 patch_prober.go:28] interesting pod/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 22:53:52.856271 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:52.855728    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 22:53:53.390077 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:53.390040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:53:53.855498 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:53.855455    2580 patch_prober.go:28] interesting pod/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 22:53:53.855807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:53.855774    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 22:53:54.860537 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:54.860503    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:54.861501 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:54.861479    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:53:59.458757 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:59.457775    2580 patch_prober.go:28] interesting pod/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:47054->10.132.0.70:15021: read: connection reset by peer" start-of-body=
Jul 15 22:53:59.458757 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:53:59.457837    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:47054->10.132.0.70:15021: read: connection reset by peer"
Jul 15 22:54:00.454154 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:00.454118    2580 generic.go:356] "Generic (PLEG): container finished" podID="18c22e58-09ff-4686-ae4e-870f963a404e" containerID="6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815" exitCode=0
Jul 15 22:54:00.454372 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:00.454189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" event={"ID":"18c22e58-09ff-4686-ae4e-870f963a404e","Type":"ContainerDied","Data":"6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815"}
Jul 15 22:54:00.454669 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:00.454654    2580 scope.go:117] "RemoveContainer" containerID="6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815"
Jul 15 22:54:00.455684 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:00.455654    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:00.455756 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:00.455738    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:00.455793 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:00.455783    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:01.462920 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:01.462885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" event={"ID":"18c22e58-09ff-4686-ae4e-870f963a404e","Type":"ContainerStarted","Data":"b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7"}
Jul 15 22:54:01.831121 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:01.831028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:54:01.831305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:01.831192    2580 patch_prober.go:28] interesting pod/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 22:54:01.831305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:01.831265    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 22:54:02.831351 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:02.831311    2580 patch_prober.go:28] interesting pod/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 22:54:02.831764 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:02.831370    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 22:54:03.831758 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:03.831721    2580 patch_prober.go:28] interesting pod/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 22:54:03.832232 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:03.831778    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 22:54:04.831920 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:04.831885    2580 patch_prober.go:28] interesting pod/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 15 22:54:04.832335 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:04.831949    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 15 22:54:05.834411 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:05.834377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:54:05.834911 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:05.834783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:54:05.835446 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:05.835426    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:54:07.840020 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:07.839985    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"]
Jul 15 22:54:07.840423 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:07.840226    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j" podUID="f8f5c247-55a4-4086-a374-84c5745dca55" containerName="maas-api" containerID="cri-o://195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e" gracePeriod=30
Jul 15 22:54:08.102703 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.102635    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:54:08.218228 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.218190    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls\") pod \"f8f5c247-55a4-4086-a374-84c5745dca55\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") "
Jul 15 22:54:08.218422 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.218275    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2znrg\" (UniqueName: \"kubernetes.io/projected/f8f5c247-55a4-4086-a374-84c5745dca55-kube-api-access-2znrg\") pod \"f8f5c247-55a4-4086-a374-84c5745dca55\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") "
Jul 15 22:54:08.218422 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.218417    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5c247-55a4-4086-a374-84c5745dca55-openshift-service-ca\") pod \"f8f5c247-55a4-4086-a374-84c5745dca55\" (UID: \"f8f5c247-55a4-4086-a374-84c5745dca55\") "
Jul 15 22:54:08.218761 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.218731    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f5c247-55a4-4086-a374-84c5745dca55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8f5c247-55a4-4086-a374-84c5745dca55" (UID: "f8f5c247-55a4-4086-a374-84c5745dca55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:54:08.220455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.220426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f5c247-55a4-4086-a374-84c5745dca55-kube-api-access-2znrg" (OuterVolumeSpecName: "kube-api-access-2znrg") pod "f8f5c247-55a4-4086-a374-84c5745dca55" (UID: "f8f5c247-55a4-4086-a374-84c5745dca55"). InnerVolumeSpecName "kube-api-access-2znrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:54:08.220455 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.220450    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8f5c247-55a4-4086-a374-84c5745dca55" (UID: "f8f5c247-55a4-4086-a374-84c5745dca55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:54:08.319588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.319546    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8f5c247-55a4-4086-a374-84c5745dca55-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:08.319588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.319583    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8f5c247-55a4-4086-a374-84c5745dca55-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:08.319588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.319593    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2znrg\" (UniqueName: \"kubernetes.io/projected/f8f5c247-55a4-4086-a374-84c5745dca55-kube-api-access-2znrg\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:08.500016 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.499980    2580 generic.go:356] "Generic (PLEG): container finished" podID="f8f5c247-55a4-4086-a374-84c5745dca55" containerID="195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e" exitCode=0
Jul 15 22:54:08.500224 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.500026    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"
Jul 15 22:54:08.500224 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.500075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j" event={"ID":"f8f5c247-55a4-4086-a374-84c5745dca55","Type":"ContainerDied","Data":"195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e"}
Jul 15 22:54:08.500224 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.500131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j" event={"ID":"f8f5c247-55a4-4086-a374-84c5745dca55","Type":"ContainerDied","Data":"42950416d905216c49bb3f414a7d871b30ac6df57d80b552bc6c3b4a88c8099f"}
Jul 15 22:54:08.500224 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.500160    2580 scope.go:117] "RemoveContainer" containerID="195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e"
Jul 15 22:54:08.510073 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.510054    2580 scope.go:117] "RemoveContainer" containerID="195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e"
Jul 15 22:54:08.510381 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:08.510361    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e\": container with ID starting with 195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e not found: ID does not exist" containerID="195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e"
Jul 15 22:54:08.510458 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.510395    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e"} err="failed to get container status \"195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e\": rpc error: code = NotFound desc = could not find container \"195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e\": container with ID starting with 195a0edc43b2e33fa3f883ac3eea6e62cbda0da929dfa8217d2a6f7f2fae454e not found: ID does not exist"
Jul 15 22:54:08.522807 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.522784    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"]
Jul 15 22:54:08.526176 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:08.526156    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d5616e-666f49cf68-74f7j"]
Jul 15 22:54:10.011033 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:10.010997    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f5c247-55a4-4086-a374-84c5745dca55" path="/var/lib/kubelet/pods/f8f5c247-55a4-4086-a374-84c5745dca55/volumes"
Jul 15 22:54:22.700351 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:22.700310    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"]
Jul 15 22:54:22.700775 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:22.700519    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy" containerID="cri-o://72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0" gracePeriod=30
Jul 15 22:54:24.863365 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:24.863325    2580 patch_prober.go:28] interesting pod/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 22:54:24.863755 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:24.863379    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:54:27.960024 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:27.959998    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:54:28.108573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a51ba4f6-0295-48bb-b62a-50689771daac-istiod-ca-cert\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.108573 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108554    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-certs\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.108796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108584    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a51ba4f6-0295-48bb-b62a-50689771daac-istio-podinfo\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.108796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108630    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-istio-token\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.108796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108666    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-data\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.108796 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108765    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-socket\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.109008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108821    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-credential-socket\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.109008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-envoy\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.109008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108893    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:28.109008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108907    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpzsj\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-kube-api-access-jpzsj\") pod \"a51ba4f6-0295-48bb-b62a-50689771daac\" (UID: \"a51ba4f6-0295-48bb-b62a-50689771daac\") "
Jul 15 22:54:28.109008 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.108915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51ba4f6-0295-48bb-b62a-50689771daac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:54:28.109305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.109050    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:28.109305 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.109169    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:28.109426 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.109388    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.109426 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.109409    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.109426 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.109422    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.109591 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.109437    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a51ba4f6-0295-48bb-b62a-50689771daac-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.109818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.109791    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-data" (OuterVolumeSpecName: "istio-data") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:28.111180 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.111149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a51ba4f6-0295-48bb-b62a-50689771daac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:54:28.111296 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.111194    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:28.111296 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.111223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-kube-api-access-jpzsj" (OuterVolumeSpecName: "kube-api-access-jpzsj") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "kube-api-access-jpzsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:54:28.111397 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.111368    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-istio-token" (OuterVolumeSpecName: "istio-token") pod "a51ba4f6-0295-48bb-b62a-50689771daac" (UID: "a51ba4f6-0295-48bb-b62a-50689771daac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:54:28.210175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.210143    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a51ba4f6-0295-48bb-b62a-50689771daac-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.210175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.210173    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.210392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.210184    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.210392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.210196    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a51ba4f6-0295-48bb-b62a-50689771daac-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.210392 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.210207    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpzsj\" (UniqueName: \"kubernetes.io/projected/a51ba4f6-0295-48bb-b62a-50689771daac-kube-api-access-jpzsj\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:28.602537 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.602501    2580 generic.go:356] "Generic (PLEG): container finished" podID="a51ba4f6-0295-48bb-b62a-50689771daac" containerID="72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0" exitCode=0
Jul 15 22:54:28.602714 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.602554    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"
Jul 15 22:54:28.602714 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.602561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" event={"ID":"a51ba4f6-0295-48bb-b62a-50689771daac","Type":"ContainerDied","Data":"72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0"}
Jul 15 22:54:28.602714 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.602669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8" event={"ID":"a51ba4f6-0295-48bb-b62a-50689771daac","Type":"ContainerDied","Data":"3d80b647780d0d83858da731cc25fdeb47c59c1cf7093c89b66b45d83179d09e"}
Jul 15 22:54:28.602714 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.602691    2580 scope.go:117] "RemoveContainer" containerID="72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0"
Jul 15 22:54:28.615964 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.615941    2580 scope.go:117] "RemoveContainer" containerID="e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8"
Jul 15 22:54:28.624175 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.624153    2580 scope.go:117] "RemoveContainer" containerID="72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0"
Jul 15 22:54:28.624485 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:28.624459    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0\": container with ID starting with 72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0 not found: ID does not exist" containerID="72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0"
Jul 15 22:54:28.624605 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.624488    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0"} err="failed to get container status \"72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0\": rpc error: code = NotFound desc = could not find container \"72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0\": container with ID starting with 72d766687f9e4bab32c40903b30922b7f032e1634b3f62b403fa31eb911758d0 not found: ID does not exist"
Jul 15 22:54:28.624605 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.624505    2580 scope.go:117] "RemoveContainer" containerID="e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8"
Jul 15 22:54:28.624764 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:28.624745    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8\": container with ID starting with e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8 not found: ID does not exist" containerID="e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8"
Jul 15 22:54:28.624827 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.624773    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8"} err="failed to get container status \"e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8\": rpc error: code = NotFound desc = could not find container \"e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8\": container with ID starting with e55c017fe55debe0277e645e321c1e4bfab97993a5c5bdce05aa28f0b31898c8 not found: ID does not exist"
Jul 15 22:54:28.626318 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.626296    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"]
Jul 15 22:54:28.631258 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:28.631223    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d5616e-openshift-default-697b896b4f-96nv8"]
Jul 15 22:54:30.011091 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:30.011060    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" path="/var/lib/kubelet/pods/a51ba4f6-0295-48bb-b62a-50689771daac/volumes"
Jul 15 22:54:33.511436 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.511400    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"]
Jul 15 22:54:33.511899 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.511651    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf" podUID="6bb74196-5630-4a73-9288-efa4e301d513" containerName="maas-api" containerID="cri-o://bd6aeadb6ba3519228dd22c332ab0dd1e3766c6c60280a76209ea35d190974f9" gracePeriod=30
Jul 15 22:54:33.628498 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.628465    2580 generic.go:356] "Generic (PLEG): container finished" podID="6bb74196-5630-4a73-9288-efa4e301d513" containerID="bd6aeadb6ba3519228dd22c332ab0dd1e3766c6c60280a76209ea35d190974f9" exitCode=0
Jul 15 22:54:33.628616 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.628528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf" event={"ID":"6bb74196-5630-4a73-9288-efa4e301d513","Type":"ContainerDied","Data":"bd6aeadb6ba3519228dd22c332ab0dd1e3766c6c60280a76209ea35d190974f9"}
Jul 15 22:54:33.768899 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.768846    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:54:33.859113 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.859081    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls\") pod \"6bb74196-5630-4a73-9288-efa4e301d513\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") "
Jul 15 22:54:33.859283 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.859208    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb74196-5630-4a73-9288-efa4e301d513-openshift-service-ca\") pod \"6bb74196-5630-4a73-9288-efa4e301d513\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") "
Jul 15 22:54:33.859283 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.859271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xj62\" (UniqueName: \"kubernetes.io/projected/6bb74196-5630-4a73-9288-efa4e301d513-kube-api-access-6xj62\") pod \"6bb74196-5630-4a73-9288-efa4e301d513\" (UID: \"6bb74196-5630-4a73-9288-efa4e301d513\") "
Jul 15 22:54:33.859599 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.859569    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb74196-5630-4a73-9288-efa4e301d513-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6bb74196-5630-4a73-9288-efa4e301d513" (UID: "6bb74196-5630-4a73-9288-efa4e301d513"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:54:33.861320 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.861293    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6bb74196-5630-4a73-9288-efa4e301d513" (UID: "6bb74196-5630-4a73-9288-efa4e301d513"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:54:33.861414 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.861387    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb74196-5630-4a73-9288-efa4e301d513-kube-api-access-6xj62" (OuterVolumeSpecName: "kube-api-access-6xj62") pod "6bb74196-5630-4a73-9288-efa4e301d513" (UID: "6bb74196-5630-4a73-9288-efa4e301d513"). InnerVolumeSpecName "kube-api-access-6xj62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:54:33.960876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.960847    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb74196-5630-4a73-9288-efa4e301d513-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:33.960876 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.960872    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xj62\" (UniqueName: \"kubernetes.io/projected/6bb74196-5630-4a73-9288-efa4e301d513-kube-api-access-6xj62\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:33.961031 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:33.960882    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb74196-5630-4a73-9288-efa4e301d513-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:34.633801 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:34.633771    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"
Jul 15 22:54:34.634366 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:34.633770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf" event={"ID":"6bb74196-5630-4a73-9288-efa4e301d513","Type":"ContainerDied","Data":"76ebda2ddfdd247062841ba63ae6b2f4b7485c18fc3d51cc9420d9bf4bf9ea3f"}
Jul 15 22:54:34.634366 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:34.633908    2580 scope.go:117] "RemoveContainer" containerID="bd6aeadb6ba3519228dd22c332ab0dd1e3766c6c60280a76209ea35d190974f9"
Jul 15 22:54:34.651374 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:34.651351    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"]
Jul 15 22:54:34.653487 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:34.653466    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-72a6d5-6c7546cc65-thnqf"]
Jul 15 22:54:36.010666 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:36.010630    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb74196-5630-4a73-9288-efa4e301d513" path="/var/lib/kubelet/pods/6bb74196-5630-4a73-9288-efa4e301d513/volumes"
Jul 15 22:54:48.886220 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:48.886184    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"]
Jul 15 22:54:48.886709 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:48.886436    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy" containerID="cri-o://b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7" gracePeriod=30
Jul 15 22:54:49.946541 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946506    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"]
Jul 15 22:54:49.946915 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946892    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f5c247-55a4-4086-a374-84c5745dca55" containerName="maas-api"
Jul 15 22:54:49.946915 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946904    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f5c247-55a4-4086-a374-84c5745dca55" containerName="maas-api"
Jul 15 22:54:49.946915 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946915    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb74196-5630-4a73-9288-efa4e301d513" containerName="maas-api"
Jul 15 22:54:49.947017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946920    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb74196-5630-4a73-9288-efa4e301d513" containerName="maas-api"
Jul 15 22:54:49.947017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946930    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy"
Jul 15 22:54:49.947017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946936    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy"
Jul 15 22:54:49.947017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946949    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy"
Jul 15 22:54:49.947017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.946954    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy"
Jul 15 22:54:49.947017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.947010    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb74196-5630-4a73-9288-efa4e301d513" containerName="maas-api"
Jul 15 22:54:49.947017 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.947018    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy"
Jul 15 22:54:49.947234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.947025    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51ba4f6-0295-48bb-b62a-50689771daac" containerName="istio-proxy"
Jul 15 22:54:49.947234 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.947034    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8f5c247-55a4-4086-a374-84c5745dca55" containerName="maas-api"
Jul 15 22:54:49.956015 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.955988    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:49.959854 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.959828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d5b2a8-openshift-default-dockercfg-wzzlj\""
Jul 15 22:54:49.989022 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:49.988985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"]
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.000802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-credential-socket\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.000863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-data\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.000893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istiod-ca-cert\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.000919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-podinfo\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.000949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-token\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.000985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zgs4\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-kube-api-access-2zgs4\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.001033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-envoy\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.001075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-certs\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.001431 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.001230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-socket\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102436 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-data\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102436 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istiod-ca-cert\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102661 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-podinfo\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102661 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-token\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102661 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zgs4\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-kube-api-access-2zgs4\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-envoy\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-certs\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102917 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-socket\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102917 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-data\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.102917 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.102868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-credential-socket\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.103186 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.103163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-credential-socket\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.103341 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.103209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istiod-ca-cert\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.103511 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.103486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-socket\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.103564 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.103502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-certs\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.105068 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.105040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-envoy\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.105164 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.105087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-podinfo\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.112478 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.112459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-token\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.112809 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.112782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zgs4\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-kube-api-access-2zgs4\") pod \"e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") " pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.266346 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.266262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:50.415935 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.415905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"]
Jul 15 22:54:50.416735 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:54:50.416708    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2803bb7a_ce0a_4ba5_9623_0ceeb3620068.slice/crio-54feeaf5efa161a0eb1c7ec3d2f0f53bfe712ea2c61326cb97f82e6c7d6b97a0 WatchSource:0}: Error finding container 54feeaf5efa161a0eb1c7ec3d2f0f53bfe712ea2c61326cb97f82e6c7d6b97a0: Status 404 returned error can't find the container with id 54feeaf5efa161a0eb1c7ec3d2f0f53bfe712ea2c61326cb97f82e6c7d6b97a0
Jul 15 22:54:50.418929 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.418890    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:50.419045 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.418956    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:50.419045 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.418985    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:50.722743 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.722698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" event={"ID":"2803bb7a-ce0a-4ba5-9623-0ceeb3620068","Type":"ContainerStarted","Data":"ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c"}
Jul 15 22:54:50.722940 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.722770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" event={"ID":"2803bb7a-ce0a-4ba5-9623-0ceeb3620068","Type":"ContainerStarted","Data":"54feeaf5efa161a0eb1c7ec3d2f0f53bfe712ea2c61326cb97f82e6c7d6b97a0"}
Jul 15 22:54:50.750258 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.750194    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" podStartSLOduration=1.750173383 podStartE2EDuration="1.750173383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:54:50.746320206 +0000 UTC m=+2347.271343427" watchObservedRunningTime="2026-07-15 22:54:50.750173383 +0000 UTC m=+2347.275196604"
Jul 15 22:54:50.837582 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.837542    2580 patch_prober.go:28] interesting pod/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 22:54:50.837747 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:50.837606    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:54:51.267062 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:51.267029    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:51.271480 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:51.271457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:51.727599 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:51.727572    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:51.728459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:51.728436    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:54:52.740426 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.740389    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"]
Jul 15 22:54:52.744688 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.744662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.747328 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.747306    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-d5b2a8-serving-cert\""
Jul 15 22:54:52.754192 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.754170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"]
Jul 15 22:54:52.830316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.830282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a451b-8b2c-4960-b158-4759012af183-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.830472 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.830342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.830517 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.830473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-888vj\" (UniqueName: \"kubernetes.io/projected/6b1a451b-8b2c-4960-b158-4759012af183-kube-api-access-888vj\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.931286 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.931232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-888vj\" (UniqueName: \"kubernetes.io/projected/6b1a451b-8b2c-4960-b158-4759012af183-kube-api-access-888vj\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.931466 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.931350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a451b-8b2c-4960-b158-4759012af183-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.931466 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.931386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.931562 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:52.931505    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-serving-cert: secret "maas-api-e2e-shared-a-d5b2a8-serving-cert" not found
Jul 15 22:54:52.931604 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:52.931579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls podName:6b1a451b-8b2c-4960-b158-4759012af183 nodeName:}" failed. No retries permitted until 2026-07-15 22:54:53.431558188 +0000 UTC m=+2349.956581386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls") pod "maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" (UID: "6b1a451b-8b2c-4960-b158-4759012af183") : secret "maas-api-e2e-shared-a-d5b2a8-serving-cert" not found
Jul 15 22:54:52.932073 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.932054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a451b-8b2c-4960-b158-4759012af183-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:52.941728 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:52.941701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-888vj\" (UniqueName: \"kubernetes.io/projected/6b1a451b-8b2c-4960-b158-4759012af183-kube-api-access-888vj\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:53.435316 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:53.435236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:53.435508 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:53.435360    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-serving-cert: secret "maas-api-e2e-shared-a-d5b2a8-serving-cert" not found
Jul 15 22:54:53.435508 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:53.435440    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls podName:6b1a451b-8b2c-4960-b158-4759012af183 nodeName:}" failed. No retries permitted until 2026-07-15 22:54:54.435417164 +0000 UTC m=+2350.960440372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls") pod "maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" (UID: "6b1a451b-8b2c-4960-b158-4759012af183") : secret "maas-api-e2e-shared-a-d5b2a8-serving-cert" not found
Jul 15 22:54:54.139218 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.139191    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:54:54.244672 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244638    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-data\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.244842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244697    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c22e58-09ff-4686-ae4e-870f963a404e-istiod-ca-cert\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.244842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-credential-socket\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.244842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244778    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdk66\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-kube-api-access-hdk66\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.244842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-envoy\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.244842 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244833    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-certs\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.245123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244864    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c22e58-09ff-4686-ae4e-870f963a404e-istio-podinfo\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.245123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244889    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-istio-token\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.245123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.244921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-socket\") pod \"18c22e58-09ff-4686-ae4e-870f963a404e\" (UID: \"18c22e58-09ff-4686-ae4e-870f963a404e\") "
Jul 15 22:54:54.245123 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.245039    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:54.245358 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.245197    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18c22e58-09ff-4686-ae4e-870f963a404e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:54:54.245358 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.245300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:54.245438 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.245358    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.245519 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.245448    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:54.245649 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.245623    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-data" (OuterVolumeSpecName: "istio-data") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:54.247038 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.247013    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-kube-api-access-hdk66" (OuterVolumeSpecName: "kube-api-access-hdk66") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "kube-api-access-hdk66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:54:54.247148 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.247053    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:54:54.247148 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.247119    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-istio-token" (OuterVolumeSpecName: "istio-token") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:54:54.247225 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.247175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18c22e58-09ff-4686-ae4e-870f963a404e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18c22e58-09ff-4686-ae4e-870f963a404e" (UID: "18c22e58-09ff-4686-ae4e-870f963a404e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:54:54.346354 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346321    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c22e58-09ff-4686-ae4e-870f963a404e-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.346354 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346349    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdk66\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-kube-api-access-hdk66\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.346354 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346360    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.346552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346368    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.346552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346376    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c22e58-09ff-4686-ae4e-870f963a404e-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.346552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346384    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c22e58-09ff-4686-ae4e-870f963a404e-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.346552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346391    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.346552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.346399    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c22e58-09ff-4686-ae4e-870f963a404e-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 22:54:54.447684 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.447651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:54.449934 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.449908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls\") pod \"maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:54.560543 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.560480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:54.705834 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.705809    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"]
Jul 15 22:54:54.707614 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:54:54.707585    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1a451b_8b2c_4960_b158_4759012af183.slice/crio-396d8e745169b2ce3bf484174e40ab3e159555223bf993fba7852575235e0b12 WatchSource:0}: Error finding container 396d8e745169b2ce3bf484174e40ab3e159555223bf993fba7852575235e0b12: Status 404 returned error can't find the container with id 396d8e745169b2ce3bf484174e40ab3e159555223bf993fba7852575235e0b12
Jul 15 22:54:54.747903 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.747873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" event={"ID":"6b1a451b-8b2c-4960-b158-4759012af183","Type":"ContainerStarted","Data":"396d8e745169b2ce3bf484174e40ab3e159555223bf993fba7852575235e0b12"}
Jul 15 22:54:54.749349 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.749321    2580 generic.go:356] "Generic (PLEG): container finished" podID="18c22e58-09ff-4686-ae4e-870f963a404e" containerID="b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7" exitCode=0
Jul 15 22:54:54.749435 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.749392    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"
Jul 15 22:54:54.749483 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.749390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" event={"ID":"18c22e58-09ff-4686-ae4e-870f963a404e","Type":"ContainerDied","Data":"b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7"}
Jul 15 22:54:54.749517 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.749508    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9" event={"ID":"18c22e58-09ff-4686-ae4e-870f963a404e","Type":"ContainerDied","Data":"f5dfcd802bc499d01dd138e494d3d61d284059542c655c81eda6c71b9816c61b"}
Jul 15 22:54:54.749553 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.749536    2580 scope.go:117] "RemoveContainer" containerID="b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7"
Jul 15 22:54:54.759332 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.759308    2580 scope.go:117] "RemoveContainer" containerID="6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815"
Jul 15 22:54:54.767572 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.767557    2580 scope.go:117] "RemoveContainer" containerID="b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7"
Jul 15 22:54:54.767789 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:54.767769    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7\": container with ID starting with b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7 not found: ID does not exist" containerID="b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7"
Jul 15 22:54:54.767846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.767798    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7"} err="failed to get container status \"b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7\": rpc error: code = NotFound desc = could not find container \"b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7\": container with ID starting with b0d5ebaf551bc25229d0c5d6b5f6c3e5e34033d9d00f27b937230ad537ca33c7 not found: ID does not exist"
Jul 15 22:54:54.767846 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.767816    2580 scope.go:117] "RemoveContainer" containerID="6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815"
Jul 15 22:54:54.768046 ip-10-0-136-3 kubenswrapper[2580]: E0715 22:54:54.768030    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815\": container with ID starting with 6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815 not found: ID does not exist" containerID="6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815"
Jul 15 22:54:54.768087 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.768050    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815"} err="failed to get container status \"6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815\": rpc error: code = NotFound desc = could not find container \"6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815\": container with ID starting with 6f94abd72550152a58d89d8829e499b39037f4cb7f588967a9428d49f0d6a815 not found: ID does not exist"
Jul 15 22:54:54.772870 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.772848    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"]
Jul 15 22:54:54.776632 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:54.776611    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-72a6d5-openshift-default-77c75bd5d7-mfzf9"]
Jul 15 22:54:55.755606 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:55.755568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" event={"ID":"6b1a451b-8b2c-4960-b158-4759012af183","Type":"ContainerStarted","Data":"21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3"}
Jul 15 22:54:55.756078 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:55.755644    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:54:55.774360 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:55.774318    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" podStartSLOduration=3.377562781 podStartE2EDuration="3.774303476s" totalImagesPullingTime="396.740695ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:54:55.773896211 +0000 UTC m=+2352.298919432" watchObservedRunningTime="2026-07-15 22:54:55.774303476 +0000 UTC m=+2352.299326695"
Jul 15 22:54:56.010650 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:56.010563    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" path="/var/lib/kubelet/pods/18c22e58-09ff-4686-ae4e-870f963a404e/volumes"
Jul 15 22:54:57.786139 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.786108    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"]
Jul 15 22:54:57.786615 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.786567    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy"
Jul 15 22:54:57.786615 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.786580    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy"
Jul 15 22:54:57.786615 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.786590    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy"
Jul 15 22:54:57.786615 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.786595    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy"
Jul 15 22:54:57.786823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.786670    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy"
Jul 15 22:54:57.786823 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.786680    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="18c22e58-09ff-4686-ae4e-870f963a404e" containerName="istio-proxy"
Jul 15 22:54:57.790042 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.790024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.793913 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.793897    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1e65bd-openshift-default-dockercfg-vsn2x\""
Jul 15 22:54:57.830377 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.830354    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"]
Jul 15 22:54:57.874933 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.874905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-credential-socket\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.874953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-token\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875099 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.874981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzmgx\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-kube-api-access-tzmgx\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875206 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.875111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-certs\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875278 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.875231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-data\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875335 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.875310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-envoy\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875380 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.875358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-podinfo\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875424 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.875388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-socket\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.875473 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.875425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735d91d-0563-4d4d-b69d-9cc0103e282c-istiod-ca-cert\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.976588 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-data\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.976792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-envoy\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.976792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-podinfo\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.976792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-socket\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.976792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735d91d-0563-4d4d-b69d-9cc0103e282c-istiod-ca-cert\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.976792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-credential-socket\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.976792 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-token\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.977089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmgx\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-kube-api-access-tzmgx\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.977089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.976916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-certs\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.977089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.977040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-socket\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.977089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.977053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-data\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.977378 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.977358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-certs\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.977552 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.977527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735d91d-0563-4d4d-b69d-9cc0103e282c-istiod-ca-cert\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.977648 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.977623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-credential-socket\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.979299 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.979271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-envoy\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.979393 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.979335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-podinfo\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.991714 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.991689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-token\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:57.991872 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:57.991853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzmgx\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-kube-api-access-tzmgx\") pod \"e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") " pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:58.100496 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.100397    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:58.242071 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.242047    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"]
Jul 15 22:54:58.244383 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:54:58.244356    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd735d91d_0563_4d4d_b69d_9cc0103e282c.slice/crio-0fecd8327474f122f73be718ef64d3d90d3929a9b4a842e27a3f25960ff8e59b WatchSource:0}: Error finding container 0fecd8327474f122f73be718ef64d3d90d3929a9b4a842e27a3f25960ff8e59b: Status 404 returned error can't find the container with id 0fecd8327474f122f73be718ef64d3d90d3929a9b4a842e27a3f25960ff8e59b
Jul 15 22:54:58.246581 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.246547    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:58.246678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.246609    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:58.246678 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.246648    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:54:58.779935 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.779898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" event={"ID":"d735d91d-0563-4d4d-b69d-9cc0103e282c","Type":"ContainerStarted","Data":"3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9"}
Jul 15 22:54:58.780111 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.779973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" event={"ID":"d735d91d-0563-4d4d-b69d-9cc0103e282c","Type":"ContainerStarted","Data":"0fecd8327474f122f73be718ef64d3d90d3929a9b4a842e27a3f25960ff8e59b"}
Jul 15 22:54:58.801419 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:58.801368    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podStartSLOduration=1.80134832 podStartE2EDuration="1.80134832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:54:58.800282248 +0000 UTC m=+2355.325305469" watchObservedRunningTime="2026-07-15 22:54:58.80134832 +0000 UTC m=+2355.326371541"
Jul 15 22:54:59.101357 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:59.101274    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:59.106493 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:59.106466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:59.785381 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:59.785350    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:54:59.786283 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:54:59.786234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:55:00.806124 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:00.806091    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"]
Jul 15 22:55:00.809623 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:00.809604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:00.812307 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:00.812282    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1e65bd-serving-cert\""
Jul 15 22:55:00.820655 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:00.820629    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"]
Jul 15 22:55:00.905282 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:00.905224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b26b3e88-14f2-4c5d-b599-9020243b51d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:00.905503 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:00.905303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvvhg\" (UniqueName: \"kubernetes.io/projected/b26b3e88-14f2-4c5d-b599-9020243b51d9-kube-api-access-fvvhg\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:00.905503 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:00.905354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b26b3e88-14f2-4c5d-b599-9020243b51d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.006379 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.006337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b26b3e88-14f2-4c5d-b599-9020243b51d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.006600 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.006388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvvhg\" (UniqueName: \"kubernetes.io/projected/b26b3e88-14f2-4c5d-b599-9020243b51d9-kube-api-access-fvvhg\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.006600 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.006418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b26b3e88-14f2-4c5d-b599-9020243b51d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.007136 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.007111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b26b3e88-14f2-4c5d-b599-9020243b51d9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.008869 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.008851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b26b3e88-14f2-4c5d-b599-9020243b51d9-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.017083 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.017053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvvhg\" (UniqueName: \"kubernetes.io/projected/b26b3e88-14f2-4c5d-b599-9020243b51d9-kube-api-access-fvvhg\") pod \"maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.123112 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.123018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:01.317981 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.317939    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"]
Jul 15 22:55:01.320864 ip-10-0-136-3 kubenswrapper[2580]: W0715 22:55:01.320834    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26b3e88_14f2_4c5d_b599_9020243b51d9.slice/crio-3344735c47761f06f740bc707888dd386e3bbc901cb2c5462371436f06ca1645 WatchSource:0}: Error finding container 3344735c47761f06f740bc707888dd386e3bbc901cb2c5462371436f06ca1645: Status 404 returned error can't find the container with id 3344735c47761f06f740bc707888dd386e3bbc901cb2c5462371436f06ca1645
Jul 15 22:55:01.766717 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.766679    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 22:55:01.795732 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:01.795692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2" event={"ID":"b26b3e88-14f2-4c5d-b599-9020243b51d9","Type":"ContainerStarted","Data":"3344735c47761f06f740bc707888dd386e3bbc901cb2c5462371436f06ca1645"}
Jul 15 22:55:02.804914 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:02.804872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2" event={"ID":"b26b3e88-14f2-4c5d-b599-9020243b51d9","Type":"ContainerStarted","Data":"7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd"}
Jul 15 22:55:02.805397 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:02.804991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:02.826332 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:02.826269    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2" podStartSLOduration=2.26411554 podStartE2EDuration="2.826237535s" totalImagesPullingTime="562.121995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:55:02.823271668 +0000 UTC m=+2359.348294888" watchObservedRunningTime="2026-07-15 22:55:02.826237535 +0000 UTC m=+2359.351260754"
Jul 15 22:55:06.728818 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.728777    2580 patch_prober.go:28] interesting pod/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 15 22:55:06.729292 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.728854    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 15 22:55:06.827013 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.826978    2580 generic.go:356] "Generic (PLEG): container finished" podID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerID="ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c" exitCode=0
Jul 15 22:55:06.827191 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.827046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" event={"ID":"2803bb7a-ce0a-4ba5-9623-0ceeb3620068","Type":"ContainerDied","Data":"ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c"}
Jul 15 22:55:06.827492 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.827476    2580 scope.go:117] "RemoveContainer" containerID="ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c"
Jul 15 22:55:06.828638 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.828610    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:55:06.828701 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.828688    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:55:06.828738 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:06.828721    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:55:07.835605 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:07.834578    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" event={"ID":"2803bb7a-ce0a-4ba5-9623-0ceeb3620068","Type":"ContainerStarted","Data":"d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4"}
Jul 15 22:55:08.267301 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:08.267166    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:55:08.267301 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:08.267289    2580 patch_prober.go:28] interesting pod/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 15 22:55:08.267593 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:08.267349    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 15 22:55:08.817637 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:08.817603    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 22:55:09.267702 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:09.267657    2580 patch_prober.go:28] interesting pod/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 15 22:55:09.268373 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:09.268336    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 15 22:55:10.267704 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:10.267657    2580 patch_prober.go:28] interesting pod/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 15 22:55:10.268364 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:10.268326    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 15 22:55:11.267231 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:11.267172    2580 patch_prober.go:28] interesting pod/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 15 22:55:11.267491 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:11.267291    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 15 22:55:12.271396 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:12.271360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:55:12.271861 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:12.271655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:55:12.272344 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:12.272329    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 22:55:14.787756 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.787667    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 15 22:55:14.787756 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.787743    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 15 22:55:14.891674 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.891573    2580 generic.go:356] "Generic (PLEG): container finished" podID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerID="3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9" exitCode=0
Jul 15 22:55:14.891674 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.891655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" event={"ID":"d735d91d-0563-4d4d-b69d-9cc0103e282c","Type":"ContainerDied","Data":"3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9"}
Jul 15 22:55:14.892213 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.892194    2580 scope.go:117] "RemoveContainer" containerID="3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9"
Jul 15 22:55:14.893294 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.893265    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:55:14.893361 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.893339    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:55:14.893397 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:14.893376    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 22:55:15.899057 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:15.899022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" event={"ID":"d735d91d-0563-4d4d-b69d-9cc0103e282c","Type":"ContainerStarted","Data":"a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a"}
Jul 15 22:55:16.100797 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:16.100755    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:55:16.101040 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:16.101012    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 15 22:55:16.101089 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:16.101061    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 15 22:55:17.101124 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:17.101085    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 15 22:55:17.101563 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:17.101144    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 15 22:55:18.101495 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:18.101449    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 15 22:55:18.101914 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:18.101513    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 15 22:55:19.101459 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:19.101424    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 15 22:55:19.101665 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:19.101493    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 15 22:55:20.107590 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:20.107553    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:55:20.108149 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:20.108131    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:55:20.109039 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:20.109017    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 22:55:44.153666 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:44.153633    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:55:44.156064 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:44.156043    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 22:55:44.159782 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:44.159763    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 22:55:44.162314 ip-10-0-136-3 kubenswrapper[2580]: I0715 22:55:44.162280    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 23:00:35.769516 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:35.769477    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"]
Jul 15 23:00:35.772135 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:35.769718    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" podUID="6b1a451b-8b2c-4960-b158-4759012af183" containerName="maas-api" containerID="cri-o://21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3" gracePeriod=30
Jul 15 23:00:36.036219 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.036193    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 23:00:36.163648 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.163562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a451b-8b2c-4960-b158-4759012af183-openshift-service-ca\") pod \"6b1a451b-8b2c-4960-b158-4759012af183\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") "
Jul 15 23:00:36.163838 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.163681    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-888vj\" (UniqueName: \"kubernetes.io/projected/6b1a451b-8b2c-4960-b158-4759012af183-kube-api-access-888vj\") pod \"6b1a451b-8b2c-4960-b158-4759012af183\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") "
Jul 15 23:00:36.163838 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.163797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls\") pod \"6b1a451b-8b2c-4960-b158-4759012af183\" (UID: \"6b1a451b-8b2c-4960-b158-4759012af183\") "
Jul 15 23:00:36.164023 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.164002    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1a451b-8b2c-4960-b158-4759012af183-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b1a451b-8b2c-4960-b158-4759012af183" (UID: "6b1a451b-8b2c-4960-b158-4759012af183"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:00:36.164230 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.164215    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a451b-8b2c-4960-b158-4759012af183-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:36.165740 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.165710    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b1a451b-8b2c-4960-b158-4759012af183" (UID: "6b1a451b-8b2c-4960-b158-4759012af183"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:00:36.165740 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.165722    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1a451b-8b2c-4960-b158-4759012af183-kube-api-access-888vj" (OuterVolumeSpecName: "kube-api-access-888vj") pod "6b1a451b-8b2c-4960-b158-4759012af183" (UID: "6b1a451b-8b2c-4960-b158-4759012af183"). InnerVolumeSpecName "kube-api-access-888vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:36.265188 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.265151    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-888vj\" (UniqueName: \"kubernetes.io/projected/6b1a451b-8b2c-4960-b158-4759012af183-kube-api-access-888vj\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:36.265188 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.265181    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a451b-8b2c-4960-b158-4759012af183-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:36.537930 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.537892    2580 generic.go:356] "Generic (PLEG): container finished" podID="6b1a451b-8b2c-4960-b158-4759012af183" containerID="21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3" exitCode=0
Jul 15 23:00:36.538106 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.537937    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"
Jul 15 23:00:36.538106 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.537963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" event={"ID":"6b1a451b-8b2c-4960-b158-4759012af183","Type":"ContainerDied","Data":"21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3"}
Jul 15 23:00:36.538106 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.538006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z" event={"ID":"6b1a451b-8b2c-4960-b158-4759012af183","Type":"ContainerDied","Data":"396d8e745169b2ce3bf484174e40ab3e159555223bf993fba7852575235e0b12"}
Jul 15 23:00:36.538106 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.538027    2580 scope.go:117] "RemoveContainer" containerID="21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3"
Jul 15 23:00:36.547556 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.547536    2580 scope.go:117] "RemoveContainer" containerID="21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3"
Jul 15 23:00:36.547812 ip-10-0-136-3 kubenswrapper[2580]: E0715 23:00:36.547793    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3\": container with ID starting with 21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3 not found: ID does not exist" containerID="21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3"
Jul 15 23:00:36.547861 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.547820    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3"} err="failed to get container status \"21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3\": rpc error: code = NotFound desc = could not find container \"21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3\": container with ID starting with 21ef8c8f3ae461463ca2b6182b1513a11cf64949ba6b5993f9f331c33a4a25c3 not found: ID does not exist"
Jul 15 23:00:36.563713 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.563690    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"]
Jul 15 23:00:36.569017 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:36.568994    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d5b2a8-6596c55d78-dgq6z"]
Jul 15 23:00:38.010348 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:38.010312    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1a451b-8b2c-4960-b158-4759012af183" path="/var/lib/kubelet/pods/6b1a451b-8b2c-4960-b158-4759012af183/volumes"
Jul 15 23:00:44.185477 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:44.185446    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 23:00:44.189466 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:44.189439    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 23:00:44.192013 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:44.191989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 23:00:44.196407 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:44.196383    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wn4wl_a6713e93-db89-44aa-8b21-e073154e177f/ovn-acl-logging/0.log"
Jul 15 23:00:50.906959 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:50.906915    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"]
Jul 15 23:00:50.907453 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:50.907191    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy" containerID="cri-o://d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4" gracePeriod=30
Jul 15 23:00:56.174911 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.174887    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 23:00:56.250216 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250186    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-token\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250406 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zgs4\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-kube-api-access-2zgs4\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250406 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250309    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-podinfo\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250406 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-certs\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250406 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-envoy\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250406 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istiod-ca-cert\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250673 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-socket\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250673 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-credential-socket\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250673 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250560    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-data\") pod \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\" (UID: \"2803bb7a-ce0a-4ba5-9623-0ceeb3620068\") "
Jul 15 23:00:56.250847 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250681    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:56.250847 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:00:56.250954 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250830    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:56.251017 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.250989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:56.251077 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.251048    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.251077 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.251065    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.251191 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.251075    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.251683 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.251656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-data" (OuterVolumeSpecName: "istio-data") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:56.252699 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.252675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:56.252797 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.252746    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-kube-api-access-2zgs4" (OuterVolumeSpecName: "kube-api-access-2zgs4") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "kube-api-access-2zgs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:56.252885 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.252865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 23:00:56.252923 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.252882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-token" (OuterVolumeSpecName: "istio-token") pod "2803bb7a-ce0a-4ba5-9623-0ceeb3620068" (UID: "2803bb7a-ce0a-4ba5-9623-0ceeb3620068"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:56.352509 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.352473    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.352509 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.352505    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zgs4\" (UniqueName: \"kubernetes.io/projected/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-kube-api-access-2zgs4\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.352509 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.352515    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.352734 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.352526    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.352734 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.352534    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.352734 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.352542    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2803bb7a-ce0a-4ba5-9623-0ceeb3620068-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:00:56.640207 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.640111    2580 generic.go:356] "Generic (PLEG): container finished" podID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerID="d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4" exitCode=0
Jul 15 23:00:56.640207 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.640165    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"
Jul 15 23:00:56.640478 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.640200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" event={"ID":"2803bb7a-ce0a-4ba5-9623-0ceeb3620068","Type":"ContainerDied","Data":"d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4"}
Jul 15 23:00:56.640478 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.640295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg" event={"ID":"2803bb7a-ce0a-4ba5-9623-0ceeb3620068","Type":"ContainerDied","Data":"54feeaf5efa161a0eb1c7ec3d2f0f53bfe712ea2c61326cb97f82e6c7d6b97a0"}
Jul 15 23:00:56.640478 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.640327    2580 scope.go:117] "RemoveContainer" containerID="d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4"
Jul 15 23:00:56.649717 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.649697    2580 scope.go:117] "RemoveContainer" containerID="ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c"
Jul 15 23:00:56.658062 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.658043    2580 scope.go:117] "RemoveContainer" containerID="d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4"
Jul 15 23:00:56.658332 ip-10-0-136-3 kubenswrapper[2580]: E0715 23:00:56.658312    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4\": container with ID starting with d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4 not found: ID does not exist" containerID="d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4"
Jul 15 23:00:56.658424 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.658345    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4"} err="failed to get container status \"d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4\": rpc error: code = NotFound desc = could not find container \"d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4\": container with ID starting with d95ad1ca36b788718a4754c3e596a6e3d126e0057830f6c6b7f5799a6dfbcbd4 not found: ID does not exist"
Jul 15 23:00:56.658424 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.658370    2580 scope.go:117] "RemoveContainer" containerID="ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c"
Jul 15 23:00:56.658617 ip-10-0-136-3 kubenswrapper[2580]: E0715 23:00:56.658599    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c\": container with ID starting with ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c not found: ID does not exist" containerID="ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c"
Jul 15 23:00:56.658657 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.658623    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c"} err="failed to get container status \"ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c\": rpc error: code = NotFound desc = could not find container \"ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c\": container with ID starting with ede199191f4a2a57d564ec7fe898dd902ee86571d6ead478f2cc8a181407413c not found: ID does not exist"
Jul 15 23:00:56.663390 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.663366    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"]
Jul 15 23:00:56.667987 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:56.667966    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d5b2a8-openshift-default-69658db5ff-78hdg"]
Jul 15 23:00:58.010932 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:00:58.010895    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" path="/var/lib/kubelet/pods/2803bb7a-ce0a-4ba5-9623-0ceeb3620068/volumes"
Jul 15 23:01:01.755079 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:01.755045    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"]
Jul 15 23:01:01.755593 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:01.755281    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2" podUID="b26b3e88-14f2-4c5d-b599-9020243b51d9" containerName="maas-api" containerID="cri-o://7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd" gracePeriod=30
Jul 15 23:01:02.021101 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.021038    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 23:01:02.106064 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.106027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b26b3e88-14f2-4c5d-b599-9020243b51d9-openshift-service-ca\") pod \"b26b3e88-14f2-4c5d-b599-9020243b51d9\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") "
Jul 15 23:01:02.106212 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.106092    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvvhg\" (UniqueName: \"kubernetes.io/projected/b26b3e88-14f2-4c5d-b599-9020243b51d9-kube-api-access-fvvhg\") pod \"b26b3e88-14f2-4c5d-b599-9020243b51d9\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") "
Jul 15 23:01:02.106212 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.106127    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b26b3e88-14f2-4c5d-b599-9020243b51d9-maas-api-tls\") pod \"b26b3e88-14f2-4c5d-b599-9020243b51d9\" (UID: \"b26b3e88-14f2-4c5d-b599-9020243b51d9\") "
Jul 15 23:01:02.106434 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.106411    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26b3e88-14f2-4c5d-b599-9020243b51d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b26b3e88-14f2-4c5d-b599-9020243b51d9" (UID: "b26b3e88-14f2-4c5d-b599-9020243b51d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:01:02.108234 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.108212    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b26b3e88-14f2-4c5d-b599-9020243b51d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b26b3e88-14f2-4c5d-b599-9020243b51d9" (UID: "b26b3e88-14f2-4c5d-b599-9020243b51d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:01:02.108357 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.108332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26b3e88-14f2-4c5d-b599-9020243b51d9-kube-api-access-fvvhg" (OuterVolumeSpecName: "kube-api-access-fvvhg") pod "b26b3e88-14f2-4c5d-b599-9020243b51d9" (UID: "b26b3e88-14f2-4c5d-b599-9020243b51d9"). InnerVolumeSpecName "kube-api-access-fvvhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:01:02.207209 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.207175    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b26b3e88-14f2-4c5d-b599-9020243b51d9-openshift-service-ca\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:02.207209 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.207202    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvvhg\" (UniqueName: \"kubernetes.io/projected/b26b3e88-14f2-4c5d-b599-9020243b51d9-kube-api-access-fvvhg\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:02.207209 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.207213    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b26b3e88-14f2-4c5d-b599-9020243b51d9-maas-api-tls\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:02.677775 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.677734    2580 generic.go:356] "Generic (PLEG): container finished" podID="b26b3e88-14f2-4c5d-b599-9020243b51d9" containerID="7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd" exitCode=0
Jul 15 23:01:02.677957 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.677784    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"
Jul 15 23:01:02.677957 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.677811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2" event={"ID":"b26b3e88-14f2-4c5d-b599-9020243b51d9","Type":"ContainerDied","Data":"7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd"}
Jul 15 23:01:02.677957 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.677869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2" event={"ID":"b26b3e88-14f2-4c5d-b599-9020243b51d9","Type":"ContainerDied","Data":"3344735c47761f06f740bc707888dd386e3bbc901cb2c5462371436f06ca1645"}
Jul 15 23:01:02.677957 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.677896    2580 scope.go:117] "RemoveContainer" containerID="7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd"
Jul 15 23:01:02.687608 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.687592    2580 scope.go:117] "RemoveContainer" containerID="7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd"
Jul 15 23:01:02.687871 ip-10-0-136-3 kubenswrapper[2580]: E0715 23:01:02.687853    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd\": container with ID starting with 7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd not found: ID does not exist" containerID="7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd"
Jul 15 23:01:02.687954 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.687878    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd"} err="failed to get container status \"7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd\": rpc error: code = NotFound desc = could not find container \"7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd\": container with ID starting with 7e2e67194f3ce9755e69bc78009e8aaa1d7b21361e426f54652695d2582295fd not found: ID does not exist"
Jul 15 23:01:02.702057 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.702030    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"]
Jul 15 23:01:02.708015 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:02.707992    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e65bd-7445c548db-wmxt2"]
Jul 15 23:01:04.010570 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:04.010535    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26b3e88-14f2-4c5d-b599-9020243b51d9" path="/var/lib/kubelet/pods/b26b3e88-14f2-4c5d-b599-9020243b51d9/volumes"
Jul 15 23:01:17.071257 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:17.071201    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"]
Jul 15 23:01:17.071805 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:17.071524    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy" containerID="cri-o://a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a" gracePeriod=30
Jul 15 23:01:20.109821 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:20.109773    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 23:01:20.110207 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:20.109854    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 23:01:22.335112 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.335049    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 23:01:22.499758 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.499722    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-socket\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.499943 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.499763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-token\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.499943 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.499790    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-credential-socket\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.499943 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.499820    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735d91d-0563-4d4d-b69d-9cc0103e282c-istiod-ca-cert\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.499943 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.499859    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzmgx\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-kube-api-access-tzmgx\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.499943 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.499939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-podinfo\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.500285 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-certs\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.500285 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500011    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:01:22.500285 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500054    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-data\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.500285 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-envoy\") pod \"d735d91d-0563-4d4d-b69d-9cc0103e282c\" (UID: \"d735d91d-0563-4d4d-b69d-9cc0103e282c\") "
Jul 15 23:01:22.500285 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500195    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:01:22.500574 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:01:22.500574 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500334    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d735d91d-0563-4d4d-b69d-9cc0103e282c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:01:22.500574 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500537    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-certs\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.500574 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500557    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-workload-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.500574 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500571    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-credential-socket\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.500843 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.500583    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d735d91d-0563-4d4d-b69d-9cc0103e282c-istiod-ca-cert\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.501911 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.501881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-data" (OuterVolumeSpecName: "istio-data") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:01:22.502064 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.502043    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-token" (OuterVolumeSpecName: "istio-token") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:01:22.502255 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.502225    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-kube-api-access-tzmgx" (OuterVolumeSpecName: "kube-api-access-tzmgx") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "kube-api-access-tzmgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:01:22.502343 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.502328    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:01:22.502564 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.502549    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d735d91d-0563-4d4d-b69d-9cc0103e282c" (UID: "d735d91d-0563-4d4d-b69d-9cc0103e282c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 23:01:22.601901 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.601807    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-podinfo\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.601901 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.601840    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-data\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.601901 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.601849    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-envoy\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.601901 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.601857    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-istio-token\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.601901 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.601878    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzmgx\" (UniqueName: \"kubernetes.io/projected/d735d91d-0563-4d4d-b69d-9cc0103e282c-kube-api-access-tzmgx\") on node \"ip-10-0-136-3.ec2.internal\" DevicePath \"\""
Jul 15 23:01:22.778044 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.778005    2580 generic.go:356] "Generic (PLEG): container finished" podID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerID="a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a" exitCode=0
Jul 15 23:01:22.778254 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.778064    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"
Jul 15 23:01:22.778254 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.778101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" event={"ID":"d735d91d-0563-4d4d-b69d-9cc0103e282c","Type":"ContainerDied","Data":"a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a"}
Jul 15 23:01:22.778254 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.778158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg" event={"ID":"d735d91d-0563-4d4d-b69d-9cc0103e282c","Type":"ContainerDied","Data":"0fecd8327474f122f73be718ef64d3d90d3929a9b4a842e27a3f25960ff8e59b"}
Jul 15 23:01:22.778254 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.778184    2580 scope.go:117] "RemoveContainer" containerID="a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a"
Jul 15 23:01:22.787325 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.787306    2580 scope.go:117] "RemoveContainer" containerID="3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9"
Jul 15 23:01:22.795348 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.795312    2580 scope.go:117] "RemoveContainer" containerID="a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a"
Jul 15 23:01:22.795595 ip-10-0-136-3 kubenswrapper[2580]: E0715 23:01:22.795575    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a\": container with ID starting with a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a not found: ID does not exist" containerID="a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a"
Jul 15 23:01:22.795641 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.795604    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a"} err="failed to get container status \"a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a\": rpc error: code = NotFound desc = could not find container \"a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a\": container with ID starting with a0ede6f54e5518d0ce2126844a1658353d5a9a501fe1e91fe1c9f2814fb3164a not found: ID does not exist"
Jul 15 23:01:22.795641 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.795624    2580 scope.go:117] "RemoveContainer" containerID="3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9"
Jul 15 23:01:22.795837 ip-10-0-136-3 kubenswrapper[2580]: E0715 23:01:22.795821    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9\": container with ID starting with 3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9 not found: ID does not exist" containerID="3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9"
Jul 15 23:01:22.795886 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.795842    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9"} err="failed to get container status \"3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9\": rpc error: code = NotFound desc = could not find container \"3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9\": container with ID starting with 3edf08c8c686c61706d286b0df9ea82b6e7497b8a399984071d4f216708330c9 not found: ID does not exist"
Jul 15 23:01:22.803855 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.803834    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"]
Jul 15 23:01:22.811306 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:22.811286    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1e65bd-openshift-default-5bcb49655f-cmbzg"]
Jul 15 23:01:23.642946 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:23.642911    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55b9df4c4b-mw5pm_8a81c330-0873-40ce-b9d3-46bdff42b751/manager/0.log"
Jul 15 23:01:24.012089 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:24.012059    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" path="/var/lib/kubelet/pods/d735d91d-0563-4d4d-b69d-9cc0103e282c/volumes"
Jul 15 23:01:24.349056 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:24.348974    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-th7tx_ee92d8b5-1402-4c55-8375-84c08b802694/copy-manifests/0.log"
Jul 15 23:01:24.362252 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:24.362227    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-th7tx_ee92d8b5-1402-4c55-8375-84c08b802694/manager/0.log"
Jul 15 23:01:24.734602 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:24.734574    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c6768fb-7bqgg_8b72af96-c097-44bf-9a22-142396a25de6/maas-api/0.log"
Jul 15 23:01:24.850682 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:24.850654    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735910-wtknq_ae3c7fa0-a464-4428-9bd3-ef41dd2f103c/cleanup/0.log"
Jul 15 23:01:26.583875 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:26.583846    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-2mcjq_87f50a9a-30cb-4b23-9365-5511971fa5e6/postgres/0.log"
Jul 15 23:01:28.124443 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:28.124411    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5h2t6_eff03430-f9ce-41df-9771-b152f30b251a/manager/0.log"
Jul 15 23:01:29.090906 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:29.090671    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gp5hk_47744ca9-46ac-4736-be26-2ebca465df04/istio-proxy/0.log"
Jul 15 23:01:29.555203 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:29.555163    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tqcpv_f8f720c7-b611-4728-aec5-3b32a875566a/istio-proxy/1.log"
Jul 15 23:01:29.678392 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:29.678356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-wwtp5_a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4/payload-pre-processing/0.log"
Jul 15 23:01:29.799951 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:29.799920    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lxw99_231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0/payload-processing/0.log"
Jul 15 23:01:29.916318 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:29.916210    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64bf7f4c68-xhtmq_967cd527-fd78-4e56-b9bc-7d388f7f0413/router/0.log"
Jul 15 23:01:30.277916 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:30.277884    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hwfjs_16729844-14a6-484d-a463-7ec7ec7d40dd/main/0.log"
Jul 15 23:01:30.394151 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:30.394121    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jnctm_0f8eb05b-2bc5-48b7-a9f4-3039034c7de2/main/0.log"
Jul 15 23:01:39.256669 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:39.256638    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gsl96_eecc91ea-9fc4-4acf-8470-6e01e8d07bf5/global-pull-secret-syncer/0.log"
Jul 15 23:01:39.481160 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:39.481124    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mz9jz_89e4af4d-f5a4-41c2-9f94-d529139156cf/konnectivity-agent/0.log"
Jul 15 23:01:39.503231 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:39.503205    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-3.ec2.internal_14184da6420b1883b0b0003e3d2f4bed/haproxy/0.log"
Jul 15 23:01:44.957218 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:44.957185    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5h2t6_eff03430-f9ce-41df-9771-b152f30b251a/manager/0.log"
Jul 15 23:01:47.167343 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:47.167311    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-zk859_15fddc58-25b8-4d02-9c2d-eda67232c113/cluster-monitoring-operator/0.log"
Jul 15 23:01:47.740978 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:47.740948    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kd7sz_f57258c2-0f8a-4525-aee9-8f9263ed20e9/node-exporter/0.log"
Jul 15 23:01:47.765117 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:47.765088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kd7sz_f57258c2-0f8a-4525-aee9-8f9263ed20e9/kube-rbac-proxy/0.log"
Jul 15 23:01:47.789302 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:47.789279    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kd7sz_f57258c2-0f8a-4525-aee9-8f9263ed20e9/init-textfile/0.log"
Jul 15 23:01:49.476955 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.476907    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-dncgs_e8178934-eaa0-4ad0-b05b-811c4143cf4e/networking-console-plugin/0.log"
Jul 15 23:01:49.484080 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484044    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"]
Jul 15 23:01:49.484450 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484436    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy"
Jul 15 23:01:49.484450 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484450    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484460    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484466    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484477    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484483    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484495    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484500    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484508    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26b3e88-14f2-4c5d-b599-9020243b51d9" containerName="maas-api"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484516    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26b3e88-14f2-4c5d-b599-9020243b51d9" containerName="maas-api"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484528    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1a451b-8b2c-4960-b158-4759012af183" containerName="maas-api"
Jul 15 23:01:49.484577 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484534    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1a451b-8b2c-4960-b158-4759012af183" containerName="maas-api"
Jul 15 23:01:49.484935 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484598    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy"
Jul 15 23:01:49.484935 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484607    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b26b3e88-14f2-4c5d-b599-9020243b51d9" containerName="maas-api"
Jul 15 23:01:49.484935 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484614    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy"
Jul 15 23:01:49.484935 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484621    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2803bb7a-ce0a-4ba5-9623-0ceeb3620068" containerName="istio-proxy"
Jul 15 23:01:49.484935 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484627    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1a451b-8b2c-4960-b158-4759012af183" containerName="maas-api"
Jul 15 23:01:49.484935 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.484632    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d735d91d-0563-4d4d-b69d-9cc0103e282c" containerName="istio-proxy"
Jul 15 23:01:49.489047 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.489029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.491702 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.491681    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rxsw4\"/\"default-dockercfg-7dk94\""
Jul 15 23:01:49.492673 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.492650    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxsw4\"/\"kube-root-ca.crt\""
Jul 15 23:01:49.492788 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.492697    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxsw4\"/\"openshift-service-ca.crt\""
Jul 15 23:01:49.498588 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.498568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"]
Jul 15 23:01:49.543991 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.543964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-lib-modules\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.544126 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.543995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-proc\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.544126 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.544012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-sys\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.544126 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.544056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbcg\" (UniqueName: \"kubernetes.io/projected/cd8cb260-2341-43ed-a053-e1c69d8dea30-kube-api-access-5pbcg\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.544311 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.544143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-podres\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.644771 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-lib-modules\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.644916 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-proc\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.644916 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-sys\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.644916 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbcg\" (UniqueName: \"kubernetes.io/projected/cd8cb260-2341-43ed-a053-e1c69d8dea30-kube-api-access-5pbcg\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.644916 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-proc\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.644916 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-lib-modules\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.645158 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-podres\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.645158 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.644947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-sys\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.645158 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.645055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd8cb260-2341-43ed-a053-e1c69d8dea30-podres\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.654355 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.654328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbcg\" (UniqueName: \"kubernetes.io/projected/cd8cb260-2341-43ed-a053-e1c69d8dea30-kube-api-access-5pbcg\") pod \"perf-node-gather-daemonset-454xz\" (UID: \"cd8cb260-2341-43ed-a053-e1c69d8dea30\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.799284 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.799167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:49.940057 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:49.936936    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"]
Jul 15 23:01:49.941434 ip-10-0-136-3 kubenswrapper[2580]: W0715 23:01:49.941403    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcd8cb260_2341_43ed_a053_e1c69d8dea30.slice/crio-cee7d17ce6487d76ee450f726ecfbe90d7fd7ed8ea333ea924653a822b5c99da WatchSource:0}: Error finding container cee7d17ce6487d76ee450f726ecfbe90d7fd7ed8ea333ea924653a822b5c99da: Status 404 returned error can't find the container with id cee7d17ce6487d76ee450f726ecfbe90d7fd7ed8ea333ea924653a822b5c99da
Jul 15 23:01:50.067644 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.067589    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/1.log"
Jul 15 23:01:50.072792 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.072774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p9bt7_36c9ef27-d29b-4ddc-8f2f-b09e3788f05b/console-operator/2.log"
Jul 15 23:01:50.521640 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.521608    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c48796c77-4b8wk_0f5192c2-a5ae-4e9d-9f0c-46ac5b63ad70/console/0.log"
Jul 15 23:01:50.555855 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.555822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-w44sz_a352e3fc-f590-47f8-a5b4-ac81917a67ed/download-server/0.log"
Jul 15 23:01:50.922803 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.922770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz" event={"ID":"cd8cb260-2341-43ed-a053-e1c69d8dea30","Type":"ContainerStarted","Data":"b3e29d9c5133f99be7753179e91be51caceefeceac0df0d1e4cbace4119b470a"}
Jul 15 23:01:50.922996 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.922823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz" event={"ID":"cd8cb260-2341-43ed-a053-e1c69d8dea30","Type":"ContainerStarted","Data":"cee7d17ce6487d76ee450f726ecfbe90d7fd7ed8ea333ea924653a822b5c99da"}
Jul 15 23:01:50.922996 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.922895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:50.939819 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:50.939774    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz" podStartSLOduration=1.939758874 podStartE2EDuration="1.939758874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:01:50.938099513 +0000 UTC m=+2767.463122733" watchObservedRunningTime="2026-07-15 23:01:50.939758874 +0000 UTC m=+2767.464782094"
Jul 15 23:01:51.134307 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:51.134279    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-2vxhl_a47121b8-3b53-444d-b155-bfa763997934/volume-data-source-validator/0.log"
Jul 15 23:01:52.274122 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:52.274091    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ffv6m_3cf39fe5-cec6-4347-8095-b6f07d5a8efc/dns/0.log"
Jul 15 23:01:52.297545 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:52.297520    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ffv6m_3cf39fe5-cec6-4347-8095-b6f07d5a8efc/kube-rbac-proxy/0.log"
Jul 15 23:01:52.389784 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:52.389757    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzqkp_a74c030e-d29d-46da-8305-d14bde4d3d9d/dns-node-resolver/0.log"
Jul 15 23:01:52.996400 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:52.996369    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xwv8k_5d167f8d-ca9d-42e6-9a4c-2175797892ac/node-ca/0.log"
Jul 15 23:01:53.898323 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:53.898290    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gp5hk_47744ca9-46ac-4736-be26-2ebca465df04/istio-proxy/0.log"
Jul 15 23:01:54.084484 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:54.084452    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tqcpv_f8f720c7-b611-4728-aec5-3b32a875566a/istio-proxy/0.log"
Jul 15 23:01:54.112596 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:54.112567    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tqcpv_f8f720c7-b611-4728-aec5-3b32a875566a/istio-proxy/1.log"
Jul 15 23:01:54.142234 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:54.142209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-wwtp5_a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4/payload-pre-processing/0.log"
Jul 15 23:01:54.170567 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:54.170551    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lxw99_231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0/payload-processing/0.log"
Jul 15 23:01:54.196319 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:54.196303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64bf7f4c68-xhtmq_967cd527-fd78-4e56-b9bc-7d388f7f0413/router/0.log"
Jul 15 23:01:54.877028 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:54.876999    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b5qsg_fdb15212-d5fb-48cf-b590-baef7da8dabc/serve-healthcheck-canary/0.log"
Jul 15 23:01:55.389566 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:55.389499    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jmq88_5b8bd896-286c-4473-a150-63ad81c8a097/insights-operator/0.log"
Jul 15 23:01:55.390225 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:55.390209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jmq88_5b8bd896-286c-4473-a150-63ad81c8a097/insights-operator/1.log"
Jul 15 23:01:55.481968 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:55.481940    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gstz_07967bd4-a9ed-4a20-9408-4ea88fa1f124/kube-rbac-proxy/0.log"
Jul 15 23:01:55.502509 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:55.502485    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gstz_07967bd4-a9ed-4a20-9408-4ea88fa1f124/exporter/0.log"
Jul 15 23:01:55.523801 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:55.523774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gstz_07967bd4-a9ed-4a20-9408-4ea88fa1f124/extractor/0.log"
Jul 15 23:01:56.937857 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:56.937828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-454xz"
Jul 15 23:01:57.892378 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:57.892345    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55b9df4c4b-mw5pm_8a81c330-0873-40ce-b9d3-46bdff42b751/manager/0.log"
Jul 15 23:01:58.300933 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:58.300907    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-th7tx_ee92d8b5-1402-4c55-8375-84c08b802694/manager/0.log"
Jul 15 23:01:58.322155 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:58.322131    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-th7tx_ee92d8b5-1402-4c55-8375-84c08b802694/copy-manifests/0.log"
Jul 15 23:01:59.808672 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:01:59.808635    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79bbf4474c-qhpcz_2b2fc501-24e0-4e1b-be4e-1c38510ad00c/manager/0.log"
Jul 15 23:02:00.190142 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:00.190108    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gp5hk_47744ca9-46ac-4736-be26-2ebca465df04/istio-proxy/0.log"
Jul 15 23:02:00.343143 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:00.343116    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tqcpv_f8f720c7-b611-4728-aec5-3b32a875566a/istio-proxy/0.log"
Jul 15 23:02:00.371508 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:00.371482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tqcpv_f8f720c7-b611-4728-aec5-3b32a875566a/istio-proxy/1.log"
Jul 15 23:02:00.394860 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:00.394833    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-wwtp5_a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4/payload-pre-processing/0.log"
Jul 15 23:02:00.413190 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:00.413167    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lxw99_231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0/payload-processing/0.log"
Jul 15 23:02:00.425436 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:00.425415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64bf7f4c68-xhtmq_967cd527-fd78-4e56-b9bc-7d388f7f0413/router/0.log"
Jul 15 23:02:01.645272 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:01.645169    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gp5hk_47744ca9-46ac-4736-be26-2ebca465df04/istio-proxy/0.log"
Jul 15 23:02:01.798000 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:01.797972    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tqcpv_f8f720c7-b611-4728-aec5-3b32a875566a/istio-proxy/0.log"
Jul 15 23:02:01.826703 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:01.826675    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tqcpv_f8f720c7-b611-4728-aec5-3b32a875566a/istio-proxy/1.log"
Jul 15 23:02:01.848609 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:01.848580    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-wwtp5_a1bd6f98-d94a-47f9-b573-7e2cdfccc2c4/payload-pre-processing/0.log"
Jul 15 23:02:01.868085 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:01.868063    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lxw99_231bffdb-3e48-4f1b-9cad-b5cd7bbf1de0/payload-processing/0.log"
Jul 15 23:02:01.883674 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:01.883655    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64bf7f4c68-xhtmq_967cd527-fd78-4e56-b9bc-7d388f7f0413/router/0.log"
Jul 15 23:02:04.799656 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:04.799630    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hfqbg_1a5a2565-33a0-4223-8a33-94b011e3254f/migrator/0.log"
Jul 15 23:02:04.819914 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:04.819884    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hfqbg_1a5a2565-33a0-4223-8a33-94b011e3254f/graceful-termination/0.log"
Jul 15 23:02:05.157936 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:05.157859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-d8nsp_5daaeacb-b48c-4719-869a-50ab1d541658/kube-storage-version-migrator-operator/1.log"
Jul 15 23:02:05.158636 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:05.158618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-d8nsp_5daaeacb-b48c-4719-869a-50ab1d541658/kube-storage-version-migrator-operator/0.log"
Jul 15 23:02:06.253518 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.253439    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnz7z_e8fe13d4-2dc1-45fc-be52-222402d3a623/kube-multus-additional-cni-plugins/0.log"
Jul 15 23:02:06.275966 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.275940    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnz7z_e8fe13d4-2dc1-45fc-be52-222402d3a623/egress-router-binary-copy/0.log"
Jul 15 23:02:06.296634 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.296613    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnz7z_e8fe13d4-2dc1-45fc-be52-222402d3a623/cni-plugins/0.log"
Jul 15 23:02:06.316678 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.316660    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnz7z_e8fe13d4-2dc1-45fc-be52-222402d3a623/bond-cni-plugin/0.log"
Jul 15 23:02:06.336772 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.336750    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnz7z_e8fe13d4-2dc1-45fc-be52-222402d3a623/routeoverride-cni/0.log"
Jul 15 23:02:06.356665 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.356648    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnz7z_e8fe13d4-2dc1-45fc-be52-222402d3a623/whereabouts-cni-bincopy/0.log"
Jul 15 23:02:06.377918 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.377900    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnz7z_e8fe13d4-2dc1-45fc-be52-222402d3a623/whereabouts-cni/0.log"
Jul 15 23:02:06.650023 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.649946    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rxrp4_0f8d7457-3d36-4c83-8b2e-00f5c8a6fc98/kube-multus/0.log"
Jul 15 23:02:06.758256 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.758221    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xq5ww_84693dac-8a3e-4731-8778-2a99c37b0e32/network-metrics-daemon/0.log"
Jul 15 23:02:06.777431 ip-10-0-136-3 kubenswrapper[2580]: I0715 23:02:06.777412    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xq5ww_84693dac-8a3e-4731-8778-2a99c37b0e32/kube-rbac-proxy/0.log"