Jul 17 05:31:19.112758 ip-10-0-128-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 05:31:19.112770 ip-10-0-128-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 05:31:19.112776 ip-10-0-128-37 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 05:31:19.112990 ip-10-0-128-37 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 05:31:28.448059 ip-10-0-128-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 05:31:28.448073 ip-10-0-128-37 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 90219d9d03ef4aef95f362c1cd70f8bf --
Jul 17 05:32:56.681160 ip-10-0-128-37 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.131362    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138393    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138406    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138409    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138413    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138415    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138418    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138422    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:32:57.149604 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138424    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138427    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138430    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138434    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138438    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138441    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138444    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138447    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138449    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138452    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138455    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138458    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138460    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138463    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138466    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138469    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138472    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138475    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138485    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:32:57.152220 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138488    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138491    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138494    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138496    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138500    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138502    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138505    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138507    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138512    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138515    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138518    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138521    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138523    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138526    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138529    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138532    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138535    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138537    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138540    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:32:57.283852 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138542    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:32:57.208579 ip-10-0-128-37 systemd[1]: Started Kubernetes Kubelet.
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138545    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138548    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138551    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138554    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138556    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138560    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138563    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138565    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138568    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138570    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138573    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138576    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138578    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138581    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138584    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138586    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138589    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138591    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138594    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:32:57.310777 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138596    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138599    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138601    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138604    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138606    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138610    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138613    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138615    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138618    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138621    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138625    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138628    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138630    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138632    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138636    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138639    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138641    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138644    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138647    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:32:57.474692 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138649    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138652    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138654    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138657    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138659    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138663    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138665    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138668    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138671    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138673    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138676    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138678    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138681    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138683    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.138686    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139420    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139427    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139430    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139433    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139436    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:32:57.475401 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139439    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139442    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139444    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139447    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139450    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139453    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139456    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139459    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139461    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139466    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139468    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139472    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139474    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139477    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139480    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139483    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139485    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139488    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139492    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:32:57.475997 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139496    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139498    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139501    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139504    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139508    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139510    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139513    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139516    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139519    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139522    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139525    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139527    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139530    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139532    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139536    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139539    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139541    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139544    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139547    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139550    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:32:57.476603 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139552    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139556    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139561    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139564    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139567    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139570    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139573    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139575    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139578    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139580    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139583    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139586    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139590    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139593    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139596    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139598    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139601    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139604    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139606    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139609    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:32:57.478423 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139611    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139614    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139616    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139619    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139622    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139626    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139628    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139631    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139633    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139636    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139638    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139641    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139643    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139646    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139651    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139655    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139658    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139661    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139664    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:32:57.479864 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139667    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139670    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139672    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139675    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139678    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139681    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139684    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139686    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139689    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139691    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139694    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139696    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139699    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139701    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139704    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.139706    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140093    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140098    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140101    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140104    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:32:57.482193 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140107    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140110    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140112    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140115    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140118    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140121    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140123    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140128    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140131    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140134    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140137    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140140    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140143    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140145    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140148    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140151    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140154    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140158    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140160    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140163    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:32:57.484171 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140165    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140168    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140170    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140173    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140177    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140181    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140186    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140189    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140191    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140194    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140197    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140200    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140203    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140205    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140208    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140211    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140213    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140216    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140218    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:32:57.493233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140222    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140225    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140227    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140231    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140233    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140236    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140238    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140241    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140244    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140247    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140251    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140254    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140258    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140261    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140263    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140266    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140268    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140271    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140273    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:32:57.493845 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140276    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140278    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140281    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140283    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140286    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140289    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140291    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140293    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140296    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140298    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140301    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140304    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140306    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140310    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140313    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140315    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140318    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140321    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140324    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140326    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:32:57.495465 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140329    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140331    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140334    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140338    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140340    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140343    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140345    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140348    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140350    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140353    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140356    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140358    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140360    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140363    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140365    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140368    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.140371    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140441    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140449    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140455    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140459    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 05:32:57.496727 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140463    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140466    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140471    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140475    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140479    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140482    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140486    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140489    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140492    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140497    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140499    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140503    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140505    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140508    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140514    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140516    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140520    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140523    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140526    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140530    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140533    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140536    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140540    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140543    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 05:32:57.497425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140546    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140549    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140552    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140555    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140559    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140562    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140565    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140568    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140571    2559 flags.go:64] FLAG: --enable-server="true"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140573    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140578    2559 flags.go:64] FLAG: --event-burst="100"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140581    2559 flags.go:64] FLAG: --event-qps="50"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140585    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140588    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140591    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140595    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140598    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140601    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140605    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140608    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140611    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140614    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140618    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140621    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140624    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 05:32:57.498134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140627    2559 flags.go:64] FLAG: --feature-gates=""
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140630    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140633    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140636    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140639    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140642    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140645    2559 flags.go:64] FLAG: --help="false"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140648    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140651    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140654    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140657    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140660    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140663    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140666    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140669    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140672    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140675    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140678    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140681    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140686    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140689    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140691    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140694    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140697    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 05:32:57.498816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140700    2559 flags.go:64] FLAG: --lock-file=""
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140703    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140706    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140709    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140715    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140719    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140722    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140725    2559 flags.go:64] FLAG: --logging-format="text"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140728    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140732    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140734    2559 flags.go:64] FLAG: --manifest-url=""
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140737    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140742    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140753    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140765    2559 flags.go:64] FLAG: --max-pods="110"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140768    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140771    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140774    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140777    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140780    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140783    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140786    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140793    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140796    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140799    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 05:32:57.499515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140802    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140805    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140811    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140815    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140818    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140821    2559 flags.go:64] FLAG: --port="10250"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140824    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140827    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08af8cc077f18f185"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140830    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140833    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140837    2559 flags.go:64] FLAG: --register-node="true"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140840    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140844    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140847    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140850    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140853    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140856    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140859    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140862    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140883    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140887    2559 flags.go:64] FLAG: --runonce="false"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140890    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140893    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140896    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140899    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 05:32:57.500164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140902    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140905    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140909    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140913    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140916    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140919    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140922    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140924    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140927    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140930    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140935    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140940    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140943    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140946    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140950    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140953    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140955    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140958    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140962    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140966    2559 flags.go:64] FLAG: --v="2"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140970    2559 flags.go:64] FLAG: --version="false"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140974    2559 flags.go:64] FLAG: --vmodule=""
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140977    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.140981    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141114    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:32:57.501233 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141118    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141121    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141124    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141127    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141129    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141132    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141135    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141139    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141143    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141146    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141149    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141152    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141155    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141157    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141160    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141162    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141165    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141170    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141174    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:32:57.502110 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141177    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141179    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141182    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141184    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141187    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141189    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141192    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141197    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141201    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141203    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141206    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141209    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141211    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141214    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141216    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141219    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141221    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141224    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141227    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141231    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:32:57.502750 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141234    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141237    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141240    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141243    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141245    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141248    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141251    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141253    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141256    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141258    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141262    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141265    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141267    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141270    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141272    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141275    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141277    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141280    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141283    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:32:57.505661 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141286    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141289    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141292    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141294    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141297    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141299    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141302    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141304    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141307    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141309    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141312    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141314    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141317    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141320    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141322    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141324    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141327    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141329    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141332    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141335    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:32:57.506275 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141337    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141339    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141342    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141346    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141348    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141351    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141354    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141357    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141359    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141362    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141364    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141367    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141372    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141375    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141378    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141381    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141383    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141386    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141388    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:32:57.593472 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.141391    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.141399    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.148367    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.148383    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.148402    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.148408    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148464    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148469    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148472    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148475    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148478    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148482    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148484    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148487    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:32:57.594081 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148490    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148493    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148496    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148499    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148502    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148505    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148508    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148511    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148513    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148515    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148520    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148522    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148526    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148531    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148534    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148536    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148539    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148541    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148544    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:32:57.594478 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148546    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148549    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148552    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148555    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148558    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148560    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148562    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148565    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148567    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148570    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148573    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148576    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148579    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148582    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148586    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148589    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148592    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148597    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148600    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148603    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:32:57.595031 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148606    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148610    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148613    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148617    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148620    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148622    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148625    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148627    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148630    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148632    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148635    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148637    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148640    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148642    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148645    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148648    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148651    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148653    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148656    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148658    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:32:57.595597 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148661    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148663    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148666    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148668    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148671    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148673    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148676    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148678    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148681    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148684    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148686    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148688    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148691    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148695    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148698    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148702    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148705    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148708    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148711    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148713    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:32:57.596177 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148716    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148718    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148721    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148723    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148726    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148728    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148731    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148733    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148736    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148740    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148742    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.148782    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.148788    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149594    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149601    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 05:32:57.596700 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149604    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149607    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149609    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149613    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149615    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149618    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149621    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149623    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149627    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149630    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149632    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149638    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149643    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149646    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149649    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149652    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149656    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149659    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149662    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 05:32:57.597169 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149665    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149668    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149671    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149673    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149676    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149678    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149681    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149684    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149687    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149689    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149692    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149694    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149697    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149700    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149702    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149705    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149707    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149710    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149713    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149716    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 05:32:57.597665 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149718    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149721    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149724    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149728    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149730    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149734    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149737    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149739    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149742    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149744    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149747    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149749    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149752    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149754    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149757    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149759    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149761    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149764    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149767    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149769    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 05:32:57.598219 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149772    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149775    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149777    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149780    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149782    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149785    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149789    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149793    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149796    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149799    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149802    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149805    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149808    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149811    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149814    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149817    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149819    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149824    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149826    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 05:32:57.598725 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149829    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149832    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149834    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149837    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149839    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149841    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149844    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149847    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149849    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149852    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149855    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149857    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149860    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149862    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149877    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149882    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149884    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149887    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 05:32:57.599302 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:57.149890    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.149896    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.149995    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.152064    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.153387    2559 server.go:1019] "Starting client certificate rotation"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.153485    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.153525    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.156423    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.159310    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.174880    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.177721    2559 log.go:25] "Validated CRI v1 image API"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.178558    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 05:32:57.599765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.179858    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 05:32:57.600156 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.181024    2559 fs.go:135] Filesystem UUIDs: map[6313dcc1-dcde-4586-9f51-b1dba6f4dee7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8570e5d5-d623-4953-9d33-33cf5d270ce2:/dev/nvme0n1p4]
Jul 17 05:32:57.600156 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.181041    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.186832    2559 manager.go:216] Machine: {Timestamp:2026-07-17 05:32:57.184635164 +0000 UTC m=+0.360036543 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099748 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec219252d95c610abfa393cf22134725 SystemUUID:ec219252-d95c-610a-bfa3-93cf22134725 BootID:90219d9d-03ef-4aef-95f3-62c1cd70f8bf Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:82:2a:d2:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:82:2a:d2:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:4a:93:62:c2:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.186958    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.187059    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.190271    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.190296    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.191000    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.191010    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.191018    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.191031    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.192307    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195330    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195443    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195471    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195484    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195516    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195529    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195550    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 05:32:57.600321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195951    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.195968    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.198238    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.200288    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.200316    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201608    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201621    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201627    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201633    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201643    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201648    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201656    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201661    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201669    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201675    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201694    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.201699    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.202632    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.202643    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.204171    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zqmrd"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.206833    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.206843    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.207649    2559 server.go:1268] "Started kubelet"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.207716    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.207773    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.207838    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.208955    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.209142    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.209554    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.210968    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zqmrd"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.212051    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.212251    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-37.ec2.internal.18c2fcd10e22096f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-37.ec2.internal,UID:ip-10-0-128-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-37.ec2.internal,},FirstTimestamp:2026-07-17 05:32:57.207613807 +0000 UTC m=+0.383015186,LastTimestamp:2026-07-17 05:32:57.207613807 +0000 UTC m=+0.383015186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-37.ec2.internal,}"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.216963    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.216996    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.217114    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.217655    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.217660    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.217677    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.217755    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.217765    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 05:32:57.601225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.218140    2559 factory.go:55] Registering systemd factory
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.218176    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.219345    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.220271    2559 factory.go:153] Registering CRI-O factory
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.220288    2559 factory.go:223] Registration of the crio container factory successfully
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.220334    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.220356    2559 factory.go:103] Registering Raw factory
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.220366    2559 manager.go:1196] Started watching for new ooms in manager
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.220729    2559 manager.go:349] Starting recovery of all containers
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.223144    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-37.ec2.internal\" not found" node="ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.232344    2559 manager.go:354] Recovery completed
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.239175    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.240909    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.240940    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.240952    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.241425    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.241436    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.241441    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.241456    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.242092    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.242120    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.242130    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.242907    2559 policy_none.go:49] "None policy: Start"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.242920    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.242930    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.244037    2559 policy_none.go:47] "Start"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.316212    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.317394    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.317501    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.317532    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.317551    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.317582    2559 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.320401    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.322528    2559 manager.go:337] "Starting Device Plugin manager"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.322561    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.322574    2559 server.go:87] "Starting device plugin registration server"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.322850    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.322883    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.323040    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.323118    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.323126    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.323416    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.323462    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.418151    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"]
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.418261    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.420557    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.420585    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.420595    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:32:57.602292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.421917    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422066    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422639    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422641    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422681    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422692    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422663    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422737    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.422969    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.423676    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.423702    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.423716    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.423741    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.423925    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.423947    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.424491    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.424522    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.424536    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeHasSufficientPID"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.431557    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.431573    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-37.ec2.internal\": node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.444521    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.450646    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-37.ec2.internal\" not found" node="ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.453933    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-37.ec2.internal\" not found" node="ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.603565 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.545450    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.702607 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.618605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/763b731e29229934b3681c46d6d1ddd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"763b731e29229934b3681c46d6d1ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.702607 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.618637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98d72d9d45ac482575befdda6714665b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-37.ec2.internal\" (UID: \"98d72d9d45ac482575befdda6714665b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.702607 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.618659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/763b731e29229934b3681c46d6d1ddd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"763b731e29229934b3681c46d6d1ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.702607 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.646312    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.725916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/763b731e29229934b3681c46d6d1ddd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"763b731e29229934b3681c46d6d1ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.725959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/763b731e29229934b3681c46d6d1ddd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"763b731e29229934b3681c46d6d1ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.725994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98d72d9d45ac482575befdda6714665b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-37.ec2.internal\" (UID: \"98d72d9d45ac482575befdda6714665b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.725990    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/763b731e29229934b3681c46d6d1ddd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"763b731e29229934b3681c46d6d1ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.726013    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/763b731e29229934b3681c46d6d1ddd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal\" (UID: \"763b731e29229934b3681c46d6d1ddd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.726052    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98d72d9d45ac482575befdda6714665b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-37.ec2.internal\" (UID: \"98d72d9d45ac482575befdda6714665b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.747024    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.754177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.807414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:57.756590    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:57.909041 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.847913    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:58.010586 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:57.948683    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:58.126009 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:58.049373    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:58.246341 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:58.149730    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:58.246341 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.153139    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 05:32:58.246341 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.153302    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 05:32:58.246341 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.153332    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 05:32:58.246341 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.216331    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 05:27:58 +0000 UTC" deadline="2027-12-15 21:24:10.705581733 +0000 UTC"
Jul 17 05:32:58.246341 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.216378    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12399h51m12.489208942s"
Jul 17 05:32:58.362234 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:58.250248    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:58.362234 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:58.351154    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:58.478813 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:58.423082    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763b731e29229934b3681c46d6d1ddd0.slice/crio-2352eb02ecb5cb11f515f3f9ea0215b829902efdc993fe9c60a49bfa2e02a1a2 WatchSource:0}: Error finding container 2352eb02ecb5cb11f515f3f9ea0215b829902efdc993fe9c60a49bfa2e02a1a2: Status 404 returned error can't find the container with id 2352eb02ecb5cb11f515f3f9ea0215b829902efdc993fe9c60a49bfa2e02a1a2
Jul 17 05:32:58.478813 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:58.423615    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d72d9d45ac482575befdda6714665b.slice/crio-8617b8e23374c6085d269395b04c1c950ed4577993729204fb62a5bacd82efec WatchSource:0}: Error finding container 8617b8e23374c6085d269395b04c1c950ed4577993729204fb62a5bacd82efec: Status 404 returned error can't find the container with id 8617b8e23374c6085d269395b04c1c950ed4577993729204fb62a5bacd82efec
Jul 17 05:32:58.478813 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.429241    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:32:58.478813 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:58.451646    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-37.ec2.internal\" not found"
Jul 17 05:32:58.484917 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.484731    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:32:58.593682 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.518098    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:58.593682 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.529517    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 05:32:58.593682 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.531292    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal"
Jul 17 05:32:58.593682 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.541422    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 05:32:58.869565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:58.824317    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.180808    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.197240    2559 apiserver.go:52] "Watching apiserver"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.204170    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.204667    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8","openshift-cluster-node-tuning-operator/tuned-nmzvm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal","openshift-multus/multus-additional-cni-plugins-sxkd2","openshift-multus/network-metrics-daemon-rzfdl","openshift-network-operator/iptables-alerter-v66nh","openshift-ovn-kubernetes/ovnkube-node-fkn9n","kube-system/konnectivity-agent-zt787","kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal","openshift-dns/node-resolver-cjr76","openshift-image-registry/node-ca-ggq6n","openshift-multus/multus-mhjxz","openshift-network-diagnostics/network-check-target-cfqnr","kube-system/global-pull-secret-syncer-hhp4p"]
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.207075    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.209941    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.210332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.210411    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.210493    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.210720    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.210722    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.210723    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.210914    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.212295    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nhf84\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.212599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.212663    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.214477    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.216254    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.216341    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.217446    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.218028    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7kv7b\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.218298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.218718    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.218749    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.218928    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.219353    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.219477    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.220521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.221421    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4rb8z\""
Jul 17 05:32:59.286885 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.221466    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.221598    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.221724    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.223028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.223116    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.223632    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.223761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5bmz\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.224304    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.225569    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.226164    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dl297\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.226554    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.279306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.279754    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.280412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.280856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-systemd\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.280895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-node-log\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.280929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-cni-netd\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.280973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovnkube-config\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-slash\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-etc-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjcw\" (UniqueName: \"kubernetes.io/projected/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-kube-api-access-fnjcw\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-system-cni-dir\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2f05b64-72be-45d5-be32-1e7134069982-agent-certs\") pod \"konnectivity-agent-zt787\" (UID: \"d2f05b64-72be-45d5-be32-1e7134069982\") " pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:32:59.289419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-var-lib-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-cni-bin\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281410    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-env-overrides\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx6lj\" (UniqueName: \"kubernetes.io/projected/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-kube-api-access-sx6lj\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2f05b64-72be-45d5-be32-1e7134069982-konnectivity-ca\") pod \"konnectivity-agent-zt787\" (UID: \"d2f05b64-72be-45d5-be32-1e7134069982\") " pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-log-socket\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovnkube-script-lib\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5636f4e9-41d6-4928-ba17-7f03be40ea17-host-slash\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-ovn\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ee7f2dc-b515-4443-923d-edb1d64e60a9-kubelet-config\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.281978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ee7f2dc-b515-4443-923d-edb1d64e60a9-dbus\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.292033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5636f4e9-41d6-4928-ba17-7f03be40ea17-iptables-alerter-script\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvp4w\" (UniqueName: \"kubernetes.io/projected/5636f4e9-41d6-4928-ba17-7f03be40ea17-kube-api-access-zvp4w\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-kubelet\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-systemd-units\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovn-node-metrics-cert\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cnibin\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.282979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4f9\" (UniqueName: \"kubernetes.io/projected/718090ad-0b69-4d76-bcf4-4697ef0f81f7-kube-api-access-fc4f9\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.283016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.283090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-run-netns\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.283778    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n2c5v\""
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.284030    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.284246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.284285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-os-release\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.284317    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.284320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.284683    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.284697    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.285429    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.285482    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-prbkg\""
Jul 17 05:32:59.293108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.285434    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 05:32:59.295498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.285614    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 05:32:59.295498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.285568    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vthv2\""
Jul 17 05:32:59.295498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.285618    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 05:32:59.295498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.286490    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pmlv8\""
Jul 17 05:32:59.295498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.289578    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 05:32:59.295498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.289687    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2kzv"
Jul 17 05:32:59.318827 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.318796    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 05:32:59.322918 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.322826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" event={"ID":"98d72d9d45ac482575befdda6714665b","Type":"ContainerStarted","Data":"8617b8e23374c6085d269395b04c1c950ed4577993729204fb62a5bacd82efec"}
Jul 17 05:32:59.328749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.328692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" event={"ID":"763b731e29229934b3681c46d6d1ddd0","Type":"ContainerStarted","Data":"2352eb02ecb5cb11f515f3f9ea0215b829902efdc993fe9c60a49bfa2e02a1a2"}
Jul 17 05:32:59.385091 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-kubernetes\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.385091 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-systemd\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-node-log\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-cni-bin\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44hg9\" (UniqueName: \"kubernetes.io/projected/830b2a68-e730-4501-b6c0-a5ea98803792-kube-api-access-44hg9\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-slash\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-etc-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f444dc08-a6cc-404b-95c1-cfaab0130659-tmp-dir\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-multus-certs\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.385323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-modprobe-d\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysconfig\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjcw\" (UniqueName: \"kubernetes.io/projected/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-kube-api-access-fnjcw\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2f05b64-72be-45d5-be32-1e7134069982-agent-certs\") pod \"konnectivity-agent-zt787\" (UID: \"d2f05b64-72be-45d5-be32-1e7134069982\") " pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-host\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-var-lib-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-env-overrides\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f444dc08-a6cc-404b-95c1-cfaab0130659-hosts-file\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385545    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/830b2a68-e730-4501-b6c0-a5ea98803792-tmp\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-log-socket\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovnkube-script-lib\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-run\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-socket-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.385749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-ovn\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5636f4e9-41d6-4928-ba17-7f03be40ea17-iptables-alerter-script\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvp4w\" (UniqueName: \"kubernetes.io/projected/5636f4e9-41d6-4928-ba17-7f03be40ea17-kube-api-access-zvp4w\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-kubelet\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-systemd-units\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovn-node-metrics-cert\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cnibin\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4f9\" (UniqueName: \"kubernetes.io/projected/718090ad-0b69-4d76-bcf4-4697ef0f81f7-kube-api-access-fc4f9\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.385995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-sys\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-os-release\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-kubelet\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gkr\" (UniqueName: \"kubernetes.io/projected/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-kube-api-access-c9gkr\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-cni-netd\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovnkube-config\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.386596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d98vq\" (UniqueName: \"kubernetes.io/projected/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-kube-api-access-d98vq\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-sys-fs\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft4wd\" (UniqueName: \"kubernetes.io/projected/f444dc08-a6cc-404b-95c1-cfaab0130659-kube-api-access-ft4wd\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-env-overrides\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-cni-binary-copy\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-netns\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-system-cni-dir\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386478    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-systemd\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-node-log\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-socket-dir-parent\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-slash\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-etc-kubernetes\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-etc-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysctl-d\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386621    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-serviceca\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.387460 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv8fs\" (UniqueName: \"kubernetes.io/projected/a8a49232-0ee3-4d9d-9848-fc24533e742b-kube-api-access-hv8fs\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-cni-bin\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx6lj\" (UniqueName: \"kubernetes.io/projected/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-kube-api-access-sx6lj\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2f05b64-72be-45d5-be32-1e7134069982-konnectivity-ca\") pod \"konnectivity-agent-zt787\" (UID: \"d2f05b64-72be-45d5-be32-1e7134069982\") " pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-cnibin\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-k8s-cni-cncf-io\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-var-lib-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-cni-multus\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386863    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-device-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386885    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-log-socket\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386893    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5636f4e9-41d6-4928-ba17-7f03be40ea17-host-slash\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.386998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-cni-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-os-release\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-hostroot\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-conf-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.388310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-lib-modules\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ee7f2dc-b515-4443-923d-edb1d64e60a9-kubelet-config\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ee7f2dc-b515-4443-923d-edb1d64e60a9-dbus\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-daemon-config\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysctl-conf\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-systemd\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-var-lib-kubelet\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387331    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-host\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-openvswitch\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-run-ovn\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-system-cni-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/830b2a68-e730-4501-b6c0-a5ea98803792-etc-tuned\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-registration-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-run-netns\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.389160 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-run-netns\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.387622    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-cni-netd\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.388180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovnkube-config\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.388696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.388764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-system-cni-dir\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.389115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-cni-bin\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.389438    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5636f4e9-41d6-4928-ba17-7f03be40ea17-iptables-alerter-script\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.389632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-kubelet\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.389667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-systemd-units\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.390014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.389909    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 05:32:59.390443 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-cnibin\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.390443 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.389934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2f05b64-72be-45d5-be32-1e7134069982-konnectivity-ca\") pod \"konnectivity-agent-zt787\" (UID: \"d2f05b64-72be-45d5-be32-1e7134069982\") " pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.390443 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.390443 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-os-release\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.390647 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ee7f2dc-b515-4443-923d-edb1d64e60a9-kubelet-config\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.390718 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.390658    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:32:59.390718 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5636f4e9-41d6-4928-ba17-7f03be40ea17-host-slash\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.390788 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.390746    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret podName:5ee7f2dc-b515-4443-923d-edb1d64e60a9 nodeName:}" failed. No retries permitted until 2026-07-17 05:32:59.890706014 +0000 UTC m=+3.066107395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret") pod "global-pull-secret-syncer-hhp4p" (UID: "5ee7f2dc-b515-4443-923d-edb1d64e60a9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:32:59.390831 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.391253 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.391253 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.390981    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ee7f2dc-b515-4443-923d-edb1d64e60a9-dbus\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.391253 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.391075    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:32:59.391253 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.391123    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs podName:718090ad-0b69-4d76-bcf4-4697ef0f81f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:32:59.891105676 +0000 UTC m=+3.066507056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs") pod "network-metrics-daemon-rzfdl" (UID: "718090ad-0b69-4d76-bcf4-4697ef0f81f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:32:59.391253 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.391170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.391253 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.391223    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovnkube-script-lib\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.395086 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.394654    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:32:59.395086 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.394678    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:32:59.395086 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.394690    2559 projected.go:196] Error preparing data for projected volume kube-api-access-227zt for pod openshift-network-diagnostics/network-check-target-cfqnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:32:59.395086 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.394751    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt podName:8b6e36d2-ad19-47b0-8d1d-45af127659ec nodeName:}" failed. No retries permitted until 2026-07-17 05:32:59.894736786 +0000 UTC m=+3.070138171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-227zt" (UniqueName: "kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt") pod "network-check-target-cfqnr" (UID: "8b6e36d2-ad19-47b0-8d1d-45af127659ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:32:59.396275 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.396250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjcw\" (UniqueName: \"kubernetes.io/projected/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-kube-api-access-fnjcw\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.397787 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.397761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvp4w\" (UniqueName: \"kubernetes.io/projected/5636f4e9-41d6-4928-ba17-7f03be40ea17-kube-api-access-zvp4w\") pod \"iptables-alerter-v66nh\" (UID: \"5636f4e9-41d6-4928-ba17-7f03be40ea17\") " pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.399147 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.398135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx6lj\" (UniqueName: \"kubernetes.io/projected/8d92e4ea-3d22-4a60-ac6d-1bcf46784842-kube-api-access-sx6lj\") pod \"multus-additional-cni-plugins-sxkd2\" (UID: \"8d92e4ea-3d22-4a60-ac6d-1bcf46784842\") " pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.403226 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.403170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4f9\" (UniqueName: \"kubernetes.io/projected/718090ad-0b69-4d76-bcf4-4697ef0f81f7-kube-api-access-fc4f9\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:32:59.424243 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.424021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v66nh"
Jul 17 05:32:59.425006 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.424923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/058e5b3f-02a2-4af0-b5ea-66bc043c4c9d-ovn-node-metrics-cert\") pod \"ovnkube-node-fkn9n\" (UID: \"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.426743 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.426723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2f05b64-72be-45d5-be32-1e7134069982-agent-certs\") pod \"konnectivity-agent-zt787\" (UID: \"d2f05b64-72be-45d5-be32-1e7134069982\") " pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.433500 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:59.433463    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5636f4e9_41d6_4928_ba17_7f03be40ea17.slice/crio-75908c1e9140c3a724d340cb063cec63bc1106646afe6831a21a8a37391f38e4 WatchSource:0}: Error finding container 75908c1e9140c3a724d340cb063cec63bc1106646afe6831a21a8a37391f38e4: Status 404 returned error can't find the container with id 75908c1e9140c3a724d340cb063cec63bc1106646afe6831a21a8a37391f38e4
Jul 17 05:32:59.447771 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.447748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:32:59.460102 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:59.460074    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f05b64_72be_45d5_be32_1e7134069982.slice/crio-b253399fedd5a9753d24104d1ae77ae3a54f6854db0c4059507c447061992f32 WatchSource:0}: Error finding container b253399fedd5a9753d24104d1ae77ae3a54f6854db0c4059507c447061992f32: Status 404 returned error can't find the container with id b253399fedd5a9753d24104d1ae77ae3a54f6854db0c4059507c447061992f32
Jul 17 05:32:59.488031 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.487976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-k8s-cni-cncf-io\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488031 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-cni-multus\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-device-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.488200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-cni-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-os-release\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488138    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-hostroot\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-conf-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-lib-modules\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-daemon-config\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-device-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysctl-conf\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-systemd\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-k8s-cni-cncf-io\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-var-lib-kubelet\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-host\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-cni-multus\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-system-cni-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/830b2a68-e730-4501-b6c0-a5ea98803792-etc-tuned\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-registration-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-hostroot\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-kubernetes\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-cni-bin\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hg9\" (UniqueName: \"kubernetes.io/projected/830b2a68-e730-4501-b6c0-a5ea98803792-kube-api-access-44hg9\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.488501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-os-release\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f444dc08-a6cc-404b-95c1-cfaab0130659-tmp-dir\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488539    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-multus-certs\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-modprobe-d\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-lib-modules\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysconfig\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysctl-conf\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488634    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-var-lib-kubelet\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488638    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-systemd\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488337    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-conf-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-host\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-cni-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-system-cni-dir\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-registration-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.488851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-modprobe-d\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysconfig\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-host\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489097    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-kubernetes\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.489292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-cni-bin\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-host\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f444dc08-a6cc-404b-95c1-cfaab0130659-hosts-file\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f444dc08-a6cc-404b-95c1-cfaab0130659-hosts-file\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-multus-certs\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/830b2a68-e730-4501-b6c0-a5ea98803792-tmp\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-daemon-config\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-run\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-socket-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489528    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-sys\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-socket-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-kubelet\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-run\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gkr\" (UniqueName: \"kubernetes.io/projected/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-kube-api-access-c9gkr\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489657    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-var-lib-kubelet\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-sys\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d98vq\" (UniqueName: \"kubernetes.io/projected/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-kube-api-access-d98vq\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.490244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f444dc08-a6cc-404b-95c1-cfaab0130659-tmp-dir\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-sys-fs\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft4wd\" (UniqueName: \"kubernetes.io/projected/f444dc08-a6cc-404b-95c1-cfaab0130659-kube-api-access-ft4wd\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.489927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-cni-binary-copy\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-netns\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-socket-dir-parent\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-etc-kubernetes\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysctl-d\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-serviceca\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv8fs\" (UniqueName: \"kubernetes.io/projected/a8a49232-0ee3-4d9d-9848-fc24533e742b-kube-api-access-hv8fs\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490260    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8a49232-0ee3-4d9d-9848-fc24533e742b-sys-fs\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-cnibin\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490309    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-multus-socket-dir-parent\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-host-run-netns\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-etc-kubernetes\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.491164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/830b2a68-e730-4501-b6c0-a5ea98803792-etc-sysctl-d\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.492122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-cni-binary-copy\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.492122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-cnibin\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.492122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.490901    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-serviceca\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.492122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.491955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/830b2a68-e730-4501-b6c0-a5ea98803792-tmp\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.493811 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.493742    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/830b2a68-e730-4501-b6c0-a5ea98803792-etc-tuned\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.498182 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.498148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hg9\" (UniqueName: \"kubernetes.io/projected/830b2a68-e730-4501-b6c0-a5ea98803792-kube-api-access-44hg9\") pod \"tuned-nmzvm\" (UID: \"830b2a68-e730-4501-b6c0-a5ea98803792\") " pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.499699 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.499639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d98vq\" (UniqueName: \"kubernetes.io/projected/ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe-kube-api-access-d98vq\") pod \"node-ca-ggq6n\" (UID: \"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe\") " pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.500154 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.500133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gkr\" (UniqueName: \"kubernetes.io/projected/c72a1140-528a-48eb-b3c6-5e4eac4c5a9d-kube-api-access-c9gkr\") pod \"multus-mhjxz\" (UID: \"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d\") " pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.500258 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.500172    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft4wd\" (UniqueName: \"kubernetes.io/projected/f444dc08-a6cc-404b-95c1-cfaab0130659-kube-api-access-ft4wd\") pod \"node-resolver-cjr76\" (UID: \"f444dc08-a6cc-404b-95c1-cfaab0130659\") " pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.502251 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.502228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv8fs\" (UniqueName: \"kubernetes.io/projected/a8a49232-0ee3-4d9d-9848-fc24533e742b-kube-api-access-hv8fs\") pod \"aws-ebs-csi-driver-node-4c7f8\" (UID: \"a8a49232-0ee3-4d9d-9848-fc24533e742b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.509975 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.509955    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 05:32:59.522517 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.522474    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:32:59.533927 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:32:59.533896    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058e5b3f_02a2_4af0_b5ea_66bc043c4c9d.slice/crio-fc5c062030c811f0d1d7853d232bf720bf11e7edb7b15f93b53bfe13fa84d131 WatchSource:0}: Error finding container fc5c062030c811f0d1d7853d232bf720bf11e7edb7b15f93b53bfe13fa84d131: Status 404 returned error can't find the container with id fc5c062030c811f0d1d7853d232bf720bf11e7edb7b15f93b53bfe13fa84d131
Jul 17 05:32:59.588103 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.588073    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sxkd2"
Jul 17 05:32:59.757366 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.757272    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8"
Jul 17 05:32:59.769913 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.769867    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmzvm"
Jul 17 05:32:59.778932 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.778905    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ggq6n"
Jul 17 05:32:59.789085 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.789059    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjr76"
Jul 17 05:32:59.798161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.798134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhjxz"
Jul 17 05:32:59.893468 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.893428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:32:59.893663 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.893623    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:32:59.893663 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.893644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:32:59.893790 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.893703    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs podName:718090ad-0b69-4d76-bcf4-4697ef0f81f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:00.893681598 +0000 UTC m=+4.069082979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs") pod "network-metrics-daemon-rzfdl" (UID: "718090ad-0b69-4d76-bcf4-4697ef0f81f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:32:59.893790 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.893767    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:32:59.893944 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.893823    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret podName:5ee7f2dc-b515-4443-923d-edb1d64e60a9 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:00.893804797 +0000 UTC m=+4.069206167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret") pod "global-pull-secret-syncer-hhp4p" (UID: "5ee7f2dc-b515-4443-923d-edb1d64e60a9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:32:59.994591 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:32:59.994541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:32:59.994770 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.994728    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:32:59.994770 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.994751    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:32:59.994770 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.994765    2559 projected.go:196] Error preparing data for projected volume kube-api-access-227zt for pod openshift-network-diagnostics/network-check-target-cfqnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:32:59.994882 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:32:59.994832    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt podName:8b6e36d2-ad19-47b0-8d1d-45af127659ec nodeName:}" failed. No retries permitted until 2026-07-17 05:33:00.994811445 +0000 UTC m=+4.170212828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-227zt" (UniqueName: "kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt") pod "network-check-target-cfqnr" (UID: "8b6e36d2-ad19-47b0-8d1d-45af127659ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:00.296494 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:00.296445    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 05:28:00 +0000 UTC" deadline="2027-12-25 22:51:00.278248014 +0000 UTC"
Jul 17 05:33:00.296494 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:00.296483    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12641h17m59.981768986s"
Jul 17 05:33:00.331728 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:00.331684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zt787" event={"ID":"d2f05b64-72be-45d5-be32-1e7134069982","Type":"ContainerStarted","Data":"b253399fedd5a9753d24104d1ae77ae3a54f6854db0c4059507c447061992f32"}
Jul 17 05:33:00.332944 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:00.332914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v66nh" event={"ID":"5636f4e9-41d6-4928-ba17-7f03be40ea17","Type":"ContainerStarted","Data":"75908c1e9140c3a724d340cb063cec63bc1106646afe6831a21a8a37391f38e4"}
Jul 17 05:33:00.334250 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:00.334219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"fc5c062030c811f0d1d7853d232bf720bf11e7edb7b15f93b53bfe13fa84d131"}
Jul 17 05:33:00.641869 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:00.641844    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee44366a_3dc2_42a0_81b8_7a8b0dbac2fe.slice/crio-06ebece5ae3497e0755e406d9819f41b5a40136f7469e14d1f074b7bffc249a3 WatchSource:0}: Error finding container 06ebece5ae3497e0755e406d9819f41b5a40136f7469e14d1f074b7bffc249a3: Status 404 returned error can't find the container with id 06ebece5ae3497e0755e406d9819f41b5a40136f7469e14d1f074b7bffc249a3
Jul 17 05:33:00.644048 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:00.643940    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830b2a68_e730_4501_b6c0_a5ea98803792.slice/crio-09a924f693fc3bdef1930220d9d6bbd727dd5a72bc75273e355a8716ae0bd8d0 WatchSource:0}: Error finding container 09a924f693fc3bdef1930220d9d6bbd727dd5a72bc75273e355a8716ae0bd8d0: Status 404 returned error can't find the container with id 09a924f693fc3bdef1930220d9d6bbd727dd5a72bc75273e355a8716ae0bd8d0
Jul 17 05:33:00.646917 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:00.646003    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72a1140_528a_48eb_b3c6_5e4eac4c5a9d.slice/crio-f501dd27ef7fe1ce1783d4c53ae4afdb1e7e2864893905dab84fbea06075efdc WatchSource:0}: Error finding container f501dd27ef7fe1ce1783d4c53ae4afdb1e7e2864893905dab84fbea06075efdc: Status 404 returned error can't find the container with id f501dd27ef7fe1ce1783d4c53ae4afdb1e7e2864893905dab84fbea06075efdc
Jul 17 05:33:00.647014 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:00.646877    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d92e4ea_3d22_4a60_ac6d_1bcf46784842.slice/crio-58a5605c1cabbea4c3529abf122ba595598138a3af2b44ce56c492dc8d9dfd20 WatchSource:0}: Error finding container 58a5605c1cabbea4c3529abf122ba595598138a3af2b44ce56c492dc8d9dfd20: Status 404 returned error can't find the container with id 58a5605c1cabbea4c3529abf122ba595598138a3af2b44ce56c492dc8d9dfd20
Jul 17 05:33:00.649285 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:00.649266    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf444dc08_a6cc_404b_95c1_cfaab0130659.slice/crio-a0e2ed844b1d93673da2390f4898b0d310c228237981f08300d7cbd801288bd6 WatchSource:0}: Error finding container a0e2ed844b1d93673da2390f4898b0d310c228237981f08300d7cbd801288bd6: Status 404 returned error can't find the container with id a0e2ed844b1d93673da2390f4898b0d310c228237981f08300d7cbd801288bd6
Jul 17 05:33:00.650693 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:00.650672    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a49232_0ee3_4d9d_9848_fc24533e742b.slice/crio-b54eb4bf9cb937b016b00ab3ba43eb4649b874c7392e7d921c07866528dd5780 WatchSource:0}: Error finding container b54eb4bf9cb937b016b00ab3ba43eb4649b874c7392e7d921c07866528dd5780: Status 404 returned error can't find the container with id b54eb4bf9cb937b016b00ab3ba43eb4649b874c7392e7d921c07866528dd5780
Jul 17 05:33:00.902548 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:00.902218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:00.902548 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:00.902541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:00.902854 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:00.902440    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:00.902854 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:00.902680    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret podName:5ee7f2dc-b515-4443-923d-edb1d64e60a9 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:02.902655647 +0000 UTC m=+6.078057031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret") pod "global-pull-secret-syncer-hhp4p" (UID: "5ee7f2dc-b515-4443-923d-edb1d64e60a9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:00.902854 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:00.902712    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:00.902854 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:00.902792    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs podName:718090ad-0b69-4d76-bcf4-4697ef0f81f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:02.902775077 +0000 UTC m=+6.078176449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs") pod "network-metrics-daemon-rzfdl" (UID: "718090ad-0b69-4d76-bcf4-4697ef0f81f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:01.003730 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.003210    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:01.004206 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:01.004164    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:01.004206 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:01.004204    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:01.004378 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:01.004219    2559 projected.go:196] Error preparing data for projected volume kube-api-access-227zt for pod openshift-network-diagnostics/network-check-target-cfqnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:01.004378 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:01.004290    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt podName:8b6e36d2-ad19-47b0-8d1d-45af127659ec nodeName:}" failed. No retries permitted until 2026-07-17 05:33:03.004270086 +0000 UTC m=+6.179671461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-227zt" (UniqueName: "kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt") pod "network-check-target-cfqnr" (UID: "8b6e36d2-ad19-47b0-8d1d-45af127659ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:01.297602 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.297455    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 05:28:00 +0000 UTC" deadline="2028-04-02 06:27:18.562435524 +0000 UTC"
Jul 17 05:33:01.297602 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.297529    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15000h54m17.264911818s"
Jul 17 05:33:01.319541 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.319512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:01.319696 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:01.319660    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:01.320136 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.320113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:01.320241 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:01.320218    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:01.322149 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.321931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:01.322149 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:01.322049    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:01.346221 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.345508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" event={"ID":"98d72d9d45ac482575befdda6714665b","Type":"ContainerStarted","Data":"6dcae30d4b68268d7101252aa379f68030fc55b461312b141d77b0ca1eb742cc"}
Jul 17 05:33:01.352995 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.352892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjr76" event={"ID":"f444dc08-a6cc-404b-95c1-cfaab0130659","Type":"ContainerStarted","Data":"a0e2ed844b1d93673da2390f4898b0d310c228237981f08300d7cbd801288bd6"}
Jul 17 05:33:01.365140 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.365106    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhjxz" event={"ID":"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d","Type":"ContainerStarted","Data":"f501dd27ef7fe1ce1783d4c53ae4afdb1e7e2864893905dab84fbea06075efdc"}
Jul 17 05:33:01.383204 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.383105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerStarted","Data":"58a5605c1cabbea4c3529abf122ba595598138a3af2b44ce56c492dc8d9dfd20"}
Jul 17 05:33:01.387468 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.387358    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmzvm" event={"ID":"830b2a68-e730-4501-b6c0-a5ea98803792","Type":"ContainerStarted","Data":"09a924f693fc3bdef1930220d9d6bbd727dd5a72bc75273e355a8716ae0bd8d0"}
Jul 17 05:33:01.393748 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.393633    2559 generic.go:356] "Generic (PLEG): container finished" podID="763b731e29229934b3681c46d6d1ddd0" containerID="87ae735f3e24bdb3fd9d08ef1a73c32fa1b906d244661102b262f1c3dab5e2f2" exitCode=0
Jul 17 05:33:01.393748 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.393710    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" event={"ID":"763b731e29229934b3681c46d6d1ddd0","Type":"ContainerDied","Data":"87ae735f3e24bdb3fd9d08ef1a73c32fa1b906d244661102b262f1c3dab5e2f2"}
Jul 17 05:33:01.402835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.402791    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8" event={"ID":"a8a49232-0ee3-4d9d-9848-fc24533e742b","Type":"ContainerStarted","Data":"b54eb4bf9cb937b016b00ab3ba43eb4649b874c7392e7d921c07866528dd5780"}
Jul 17 05:33:01.413737 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.413674    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-37.ec2.internal" podStartSLOduration=2.413648779 podStartE2EDuration="2.413648779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:01.366750044 +0000 UTC m=+4.542151427" watchObservedRunningTime="2026-07-17 05:33:01.413648779 +0000 UTC m=+4.589050173"
Jul 17 05:33:01.418412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:01.418380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ggq6n" event={"ID":"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe","Type":"ContainerStarted","Data":"06ebece5ae3497e0755e406d9819f41b5a40136f7469e14d1f074b7bffc249a3"}
Jul 17 05:33:02.436144 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:02.436006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" event={"ID":"763b731e29229934b3681c46d6d1ddd0","Type":"ContainerStarted","Data":"094ae6d3ab472103325a4d4809f3db9afa7338fa60f2d86625d5dbb2425268d2"}
Jul 17 05:33:02.454170 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:02.453536    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-37.ec2.internal" podStartSLOduration=3.453511855 podStartE2EDuration="3.453511855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:02.452692302 +0000 UTC m=+5.628093696" watchObservedRunningTime="2026-07-17 05:33:02.453511855 +0000 UTC m=+5.628913251"
Jul 17 05:33:02.926530 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:02.926432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:02.926530 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:02.926494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:02.926748 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:02.926645    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:02.926748 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:02.926711    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs podName:718090ad-0b69-4d76-bcf4-4697ef0f81f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:06.926690126 +0000 UTC m=+10.102091498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs") pod "network-metrics-daemon-rzfdl" (UID: "718090ad-0b69-4d76-bcf4-4697ef0f81f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:02.927176 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:02.927156    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:02.927287 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:02.927215    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret podName:5ee7f2dc-b515-4443-923d-edb1d64e60a9 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:06.927198556 +0000 UTC m=+10.102599928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret") pod "global-pull-secret-syncer-hhp4p" (UID: "5ee7f2dc-b515-4443-923d-edb1d64e60a9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:03.027266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:03.027223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:03.027515 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:03.027495    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:03.027584 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:03.027523    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:03.027584 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:03.027538    2559 projected.go:196] Error preparing data for projected volume kube-api-access-227zt for pod openshift-network-diagnostics/network-check-target-cfqnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:03.027693 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:03.027599    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt podName:8b6e36d2-ad19-47b0-8d1d-45af127659ec nodeName:}" failed. No retries permitted until 2026-07-17 05:33:07.027579257 +0000 UTC m=+10.202980628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-227zt" (UniqueName: "kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt") pod "network-check-target-cfqnr" (UID: "8b6e36d2-ad19-47b0-8d1d-45af127659ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:03.321394 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:03.321308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:03.321531 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:03.321452    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:03.321868 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:03.321840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:03.322007 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:03.321983    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:03.322083 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:03.322039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:03.322138 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:03.322125    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:05.318568 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:05.318533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:05.319077 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:05.318666    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:05.319077 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:05.318997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:05.319207 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:05.319093    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:05.319207 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:05.319169    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:05.319318 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:05.319258    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:06.964168 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:06.964128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:06.964664 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:06.964189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:06.964664 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:06.964274    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:06.964664 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:06.964308    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:06.964664 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:06.964342    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret podName:5ee7f2dc-b515-4443-923d-edb1d64e60a9 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:14.964321784 +0000 UTC m=+18.139723160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret") pod "global-pull-secret-syncer-hhp4p" (UID: "5ee7f2dc-b515-4443-923d-edb1d64e60a9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:06.964664 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:06.964362    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs podName:718090ad-0b69-4d76-bcf4-4697ef0f81f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:14.964351896 +0000 UTC m=+18.139753282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs") pod "network-metrics-daemon-rzfdl" (UID: "718090ad-0b69-4d76-bcf4-4697ef0f81f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:07.065573 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:07.065533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:07.065774 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:07.065684    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:07.065774 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:07.065710    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:07.065774 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:07.065720    2559 projected.go:196] Error preparing data for projected volume kube-api-access-227zt for pod openshift-network-diagnostics/network-check-target-cfqnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:07.065976 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:07.065793    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt podName:8b6e36d2-ad19-47b0-8d1d-45af127659ec nodeName:}" failed. No retries permitted until 2026-07-17 05:33:15.065772018 +0000 UTC m=+18.241173389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-227zt" (UniqueName: "kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt") pod "network-check-target-cfqnr" (UID: "8b6e36d2-ad19-47b0-8d1d-45af127659ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:07.320059 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:07.319194    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:07.320059 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:07.319324    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:07.320059 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:07.319738    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:07.320059 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:07.319845    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:07.320059 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:07.319905    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:07.320059 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:07.320020    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:09.318329 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:09.318287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:09.318790 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:09.318298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:09.318790 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:09.318411    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:09.318790 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:09.318447    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:09.318790 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:09.318552    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:09.318790 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:09.318657    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:11.318360 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:11.318051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:11.318903 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:11.318309    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:11.318903 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:11.318540    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:11.318903 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:11.318636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:11.318903 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:11.318642    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:11.318903 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:11.318754    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:13.318710 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:13.318675    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:13.319199 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:13.318675    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:13.319199 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:13.318811    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:13.319199 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:13.318675    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:13.319199 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:13.318860    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:13.319199 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:13.318995    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:15.023930 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:15.023887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:15.024328 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:15.023949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:15.024328 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.023976    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:15.024328 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.024046    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:15.024328 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.024059    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret podName:5ee7f2dc-b515-4443-923d-edb1d64e60a9 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:31.024037572 +0000 UTC m=+34.199438951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret") pod "global-pull-secret-syncer-hhp4p" (UID: "5ee7f2dc-b515-4443-923d-edb1d64e60a9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:15.024328 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.024088    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs podName:718090ad-0b69-4d76-bcf4-4697ef0f81f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:31.024075813 +0000 UTC m=+34.199477180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs") pod "network-metrics-daemon-rzfdl" (UID: "718090ad-0b69-4d76-bcf4-4697ef0f81f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:15.124593 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:15.124560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:15.124710 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.124697    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:15.124749 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.124715    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:15.124749 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.124724    2559 projected.go:196] Error preparing data for projected volume kube-api-access-227zt for pod openshift-network-diagnostics/network-check-target-cfqnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:15.124804 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.124768    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt podName:8b6e36d2-ad19-47b0-8d1d-45af127659ec nodeName:}" failed. No retries permitted until 2026-07-17 05:33:31.124756031 +0000 UTC m=+34.300157397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-227zt" (UniqueName: "kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt") pod "network-check-target-cfqnr" (UID: "8b6e36d2-ad19-47b0-8d1d-45af127659ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:15.318400 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:15.318367    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:15.318583 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:15.318370    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:15.318583 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.318511    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:15.318583 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:15.318377    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:15.318583 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.318574    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:15.318747 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:15.318648    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:17.319236 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:17.319162    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:17.319685 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:17.319260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:17.319685 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:17.319273    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:17.319685 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:17.319374    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:17.319685 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:17.319404    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:17.319685 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:17.319517    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:19.318750 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:19.318720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:19.319161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:19.318756    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:19.319161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:19.318720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:19.319161 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:19.318850    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:19.319161 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:19.318931    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:19.319161 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:19.319011    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:20.483450 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.483412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmzvm" event={"ID":"830b2a68-e730-4501-b6c0-a5ea98803792","Type":"ContainerStarted","Data":"d6ee46cadf7ec0c37be260f8f15add9da3fe04d48686f4ef6e2ed69a2d5fe48c"}
Jul 17 05:33:20.486469 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.486443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"3769159e2c2a2f91e06641d4ecdb696e528412ad000bf7879de5dcf2abdab31d"}
Jul 17 05:33:20.486590 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.486515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"a2cd5c49a1426a5c3f8fc0a45e84182750c1d55cc6b47aaaf272b90b587874a9"}
Jul 17 05:33:20.486590 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.486560    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"25755a94f91a29954bf93688f8875bf1aa2d03f95345e4d0a71ff403b28aea8c"}
Jul 17 05:33:20.486700 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.486595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"7d8f2a186f14ebd22e62890b8074d276311d07bc28c74d1cdb2f67023ceaf722"}
Jul 17 05:33:20.486700 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.486641    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"11ca18afc20499a52e5cfec27002d632fea700d35bedc44c1a32b0ab3496d7ef"}
Jul 17 05:33:20.486783 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.486702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"f89788d523c59ff403261d76a8339f5ada6fc6f190097de8fa7938b628b03b54"}
Jul 17 05:33:20.487740 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.487721    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zt787" event={"ID":"d2f05b64-72be-45d5-be32-1e7134069982","Type":"ContainerStarted","Data":"cfd1d0b73214d5397b0be2d92d8e9cd5ef7140368720f95635798e5f57e8a7e2"}
Jul 17 05:33:20.489008 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.488987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8" event={"ID":"a8a49232-0ee3-4d9d-9848-fc24533e742b","Type":"ContainerStarted","Data":"204073c31d4045716d9628bae3603eb03484da9f3195fa0c8795cb2644b9f5ee"}
Jul 17 05:33:20.490265 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.490245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ggq6n" event={"ID":"ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe","Type":"ContainerStarted","Data":"c38542d6c242229958cccf7d7cb5ea6356ca9dce6479a5b809bd2d350b804222"}
Jul 17 05:33:20.491722 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.491699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjr76" event={"ID":"f444dc08-a6cc-404b-95c1-cfaab0130659","Type":"ContainerStarted","Data":"2e49ab9f7129136a317144cd84de673d31c6a7bce1cf1fb381322935605ed46a"}
Jul 17 05:33:20.494168 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.494146    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhjxz" event={"ID":"c72a1140-528a-48eb-b3c6-5e4eac4c5a9d","Type":"ContainerStarted","Data":"5e7e5d74230e2782407de50c6fb1582cc90c7fada813bcd0bc44e11cd4b0d0fb"}
Jul 17 05:33:20.495337 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.495318    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d92e4ea-3d22-4a60-ac6d-1bcf46784842" containerID="871fcd217a9069ee95cfe2fbe74a36cc2085a396d3b91ba599bc1fc019c80f8a" exitCode=0
Jul 17 05:33:20.495428 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.495344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerDied","Data":"871fcd217a9069ee95cfe2fbe74a36cc2085a396d3b91ba599bc1fc019c80f8a"}
Jul 17 05:33:20.500292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.500254    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nmzvm" podStartSLOduration=3.70612088 podStartE2EDuration="22.500243249s" totalImagesPullingTime="18.794122369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:20.499635441 +0000 UTC m=+23.675036829" watchObservedRunningTime="2026-07-17 05:33:20.500243249 +0000 UTC m=+23.675644634"
Jul 17 05:33:20.517812 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.517766    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zt787" podStartSLOduration=6.895534659 podStartE2EDuration="22.517751749s" totalImagesPullingTime="15.62221709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:20.517259217 +0000 UTC m=+23.692660604" watchObservedRunningTime="2026-07-17 05:33:20.517751749 +0000 UTC m=+23.693153137"
Jul 17 05:33:20.548537 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.548494    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ggq6n" podStartSLOduration=3.77145435 podStartE2EDuration="22.548479926s" totalImagesPullingTime="18.777025576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:20.548140283 +0000 UTC m=+23.723541683" watchObservedRunningTime="2026-07-17 05:33:20.548479926 +0000 UTC m=+23.723881314"
Jul 17 05:33:20.561641 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.561598    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cjr76" podStartSLOduration=3.7894052030000003 podStartE2EDuration="22.561583593s" totalImagesPullingTime="18.77217839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:20.561050894 +0000 UTC m=+23.736452283" watchObservedRunningTime="2026-07-17 05:33:20.561583593 +0000 UTC m=+23.736984982"
Jul 17 05:33:20.579444 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.579402    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mhjxz" podStartSLOduration=3.729055221 podStartE2EDuration="22.579388502s" totalImagesPullingTime="18.850333281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:20.579242826 +0000 UTC m=+23.754644214" watchObservedRunningTime="2026-07-17 05:33:20.579388502 +0000 UTC m=+23.754789889"
Jul 17 05:33:20.909669 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:20.909646    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 05:33:21.318367 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.318334    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:21.318654 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:21.318462    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:21.318828 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.318807    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:21.318984 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:21.318933    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:21.319049 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.318994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:21.319099 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:21.319088    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:21.335770 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.335661    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T05:33:20.909665159Z","UUID":"6e60eb18-d95e-40d6-a7b6-fc8d2543fa1c","Handler":null,"Name":"","Endpoint":""}
Jul 17 05:33:21.337432 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.337412    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 05:33:21.337552 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.337452    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 05:33:21.499889 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.499844    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8" event={"ID":"a8a49232-0ee3-4d9d-9848-fc24533e742b","Type":"ContainerStarted","Data":"cfdb1e4faffe31877ca51b4b60e637ec2a1f28f4423d07e8ea1bfe68b6b41fe3"}
Jul 17 05:33:21.501452 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.501414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v66nh" event={"ID":"5636f4e9-41d6-4928-ba17-7f03be40ea17","Type":"ContainerStarted","Data":"922d9347fc94fe5ff5a7e83d3ec4f4e3778d4c02a742ec373d16f76d622bb0d8"}
Jul 17 05:33:21.515484 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:21.515419    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v66nh" podStartSLOduration=3.5244095829999997 podStartE2EDuration="23.515399136s" totalImagesPullingTime="19.990989553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:21.514714449 +0000 UTC m=+24.690115828" watchObservedRunningTime="2026-07-17 05:33:21.515399136 +0000 UTC m=+24.690800526"
Jul 17 05:33:22.508082 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:22.508045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"eaf3134568ac905705427dd08a912c8e3981ceaa6c8daeeb1fbd0f250f969517"}
Jul 17 05:33:22.510247 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:22.510211    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8" event={"ID":"a8a49232-0ee3-4d9d-9848-fc24533e742b","Type":"ContainerStarted","Data":"8f22ac4aa353cd90c31c96b139abdef9c8c11c5d04f3aa4b8122cfae63a8499e"}
Jul 17 05:33:22.527739 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:22.527694    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4c7f8" podStartSLOduration=3.485223595 podStartE2EDuration="24.527679871s" totalImagesPullingTime="21.042456276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:22.52758333 +0000 UTC m=+25.702984721" watchObservedRunningTime="2026-07-17 05:33:22.527679871 +0000 UTC m=+25.703081258"
Jul 17 05:33:23.318580 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:23.318377    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:23.318766 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:23.318377    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:23.318766 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:23.318671    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:23.318904 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:23.318766    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:23.318904 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:23.318390    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:23.319010 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:23.318899    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:24.519552 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:24.519489    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" event={"ID":"058e5b3f-02a2-4af0-b5ea-66bc043c4c9d","Type":"ContainerStarted","Data":"41cec2380ff0e0d8b415e0337b2fab5a2024dde2f4c24bdda91a5e1f5b6d9165"}
Jul 17 05:33:24.520954 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:24.519754    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:33:24.535793 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:24.535693    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:33:24.545422 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:24.545383    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n" podStartSLOduration=6.58506389 podStartE2EDuration="26.545370305s" totalImagesPullingTime="19.960306415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:24.543698163 +0000 UTC m=+27.719099564" watchObservedRunningTime="2026-07-17 05:33:24.545370305 +0000 UTC m=+27.720771724"
Jul 17 05:33:25.238890 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.238686    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:33:25.239329 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.239304    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:33:25.318504 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.318476    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:25.318665 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.318476    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:25.318665 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:25.318568    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:25.318665 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.318590    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:25.318665 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:25.318656    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:25.318829 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:25.318722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:25.523694 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.523615    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d92e4ea-3d22-4a60-ac6d-1bcf46784842" containerID="c612f4a3d798695fbc9e3b6f25f155c033103ba0c8247ff9517139247afc67d5" exitCode=0
Jul 17 05:33:25.524315 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.523701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerDied","Data":"c612f4a3d798695fbc9e3b6f25f155c033103ba0c8247ff9517139247afc67d5"}
Jul 17 05:33:25.524835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.524548    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:33:25.524835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.524627    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:33:25.524835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.524690    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:33:25.524835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.524746    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zt787"
Jul 17 05:33:25.540129 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:25.540107    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:33:26.630381 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:26.630352    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cfqnr"]
Jul 17 05:33:26.630778 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:26.630479    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:26.630778 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:26.630564    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:26.630923 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:26.630901    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hhp4p"]
Jul 17 05:33:26.631018 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:26.631005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:26.631112 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:26.631093    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:26.631914 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:26.631889    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rzfdl"]
Jul 17 05:33:26.632027 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:26.631987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:26.632107 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:26.632088    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:27.530457 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:27.530419    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d92e4ea-3d22-4a60-ac6d-1bcf46784842" containerID="cb8912b57e70a01537e3cb1e555a824f8a716a1d02df86c18da437a575e82859" exitCode=0
Jul 17 05:33:27.530623 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:27.530511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerDied","Data":"cb8912b57e70a01537e3cb1e555a824f8a716a1d02df86c18da437a575e82859"}
Jul 17 05:33:28.318615 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:28.318584    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:28.319037 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:28.318584    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:28.319037 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:28.318681    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:28.319037 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:28.318584    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:28.319037 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:28.318764    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:28.319037 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:28.318887    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:29.538110 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:29.538078    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d92e4ea-3d22-4a60-ac6d-1bcf46784842" containerID="168f30a11daec2eeb409108207a2abf7bfe21244c9b5e37b5d0a3d388f2b7a5d" exitCode=0
Jul 17 05:33:29.538658 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:29.538117    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerDied","Data":"168f30a11daec2eeb409108207a2abf7bfe21244c9b5e37b5d0a3d388f2b7a5d"}
Jul 17 05:33:30.318419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:30.318381    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:30.318419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:30.318418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:30.318640 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:30.318378    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:30.318640 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:30.318525    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzfdl" podUID="718090ad-0b69-4d76-bcf4-4697ef0f81f7"
Jul 17 05:33:30.318748 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:30.318664    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhp4p" podUID="5ee7f2dc-b515-4443-923d-edb1d64e60a9"
Jul 17 05:33:30.318809 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:30.318743    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfqnr" podUID="8b6e36d2-ad19-47b0-8d1d-45af127659ec"
Jul 17 05:33:31.041594 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:31.041557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:31.041594 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:31.041600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:31.042190 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.041726    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:31.042190 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.041727    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:31.042190 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.041821    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs podName:718090ad-0b69-4d76-bcf4-4697ef0f81f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:03.041801803 +0000 UTC m=+66.217203172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs") pod "network-metrics-daemon-rzfdl" (UID: "718090ad-0b69-4d76-bcf4-4697ef0f81f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 05:33:31.042190 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.041889    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret podName:5ee7f2dc-b515-4443-923d-edb1d64e60a9 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:03.041853116 +0000 UTC m=+66.217254684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret") pod "global-pull-secret-syncer-hhp4p" (UID: "5ee7f2dc-b515-4443-923d-edb1d64e60a9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 05:33:31.142242 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:31.142206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:31.142438 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.142420    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 05:33:31.142481 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.142447    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 05:33:31.142481 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.142461    2559 projected.go:196] Error preparing data for projected volume kube-api-access-227zt for pod openshift-network-diagnostics/network-check-target-cfqnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:31.142577 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:31.142543    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt podName:8b6e36d2-ad19-47b0-8d1d-45af127659ec nodeName:}" failed. No retries permitted until 2026-07-17 05:34:03.142522212 +0000 UTC m=+66.317923584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-227zt" (UniqueName: "kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt") pod "network-check-target-cfqnr" (UID: "8b6e36d2-ad19-47b0-8d1d-45af127659ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 05:33:32.162491 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.162464    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-37.ec2.internal" event="NodeReady"
Jul 17 05:33:32.163026 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.162618    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 05:33:32.210018 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.209939    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5zkxm"]
Jul 17 05:33:32.231662 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.231633    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8gjlv"]
Jul 17 05:33:32.231819 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.231724    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.234516 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.234396    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 05:33:32.234516 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.234411    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 05:33:32.234945 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.234924    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qq4z7\""
Jul 17 05:33:32.245485 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.245464    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zkxm"]
Jul 17 05:33:32.245591 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.245503    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gjlv"]
Jul 17 05:33:32.245631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.245593    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.248468 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.248448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 05:33:32.248850 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.248824    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 05:33:32.248986 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.248905    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7j7x7\""
Jul 17 05:33:32.248986 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.248947    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 05:33:32.318334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.318305    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:33:32.318334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.318332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:33:32.318561 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.318412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:33:32.321390 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.321364    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 05:33:32.321526 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.321433    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8c5l\""
Jul 17 05:33:32.321526 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.321486    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 05:33:32.321751 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.321734    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-44td2\""
Jul 17 05:33:32.321943 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.321920    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 05:33:32.322067 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.321989    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 05:33:32.350006 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.349980    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/858ebc79-e49c-48c2-9987-d078ad1cc57c-cert\") pod \"ingress-canary-8gjlv\" (UID: \"858ebc79-e49c-48c2-9987-d078ad1cc57c\") " pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.350124 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.350047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0b8d226-7352-4df1-a5f3-715ee151d5f7-config-volume\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.350184 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.350132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b8d226-7352-4df1-a5f3-715ee151d5f7-tmp-dir\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.350250 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.350232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.350296 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.350265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5pv4\" (UniqueName: \"kubernetes.io/projected/b0b8d226-7352-4df1-a5f3-715ee151d5f7-kube-api-access-g5pv4\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.350338 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.350300    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jh2g\" (UniqueName: \"kubernetes.io/projected/858ebc79-e49c-48c2-9987-d078ad1cc57c-kube-api-access-7jh2g\") pod \"ingress-canary-8gjlv\" (UID: \"858ebc79-e49c-48c2-9987-d078ad1cc57c\") " pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.451517 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.451472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b8d226-7352-4df1-a5f3-715ee151d5f7-tmp-dir\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.451701 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.451642    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.451701 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.451673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5pv4\" (UniqueName: \"kubernetes.io/projected/b0b8d226-7352-4df1-a5f3-715ee151d5f7-kube-api-access-g5pv4\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.451816 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.451707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jh2g\" (UniqueName: \"kubernetes.io/projected/858ebc79-e49c-48c2-9987-d078ad1cc57c-kube-api-access-7jh2g\") pod \"ingress-canary-8gjlv\" (UID: \"858ebc79-e49c-48c2-9987-d078ad1cc57c\") " pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.451816 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:32.451746    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:32.451953 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:32.451834    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls podName:b0b8d226-7352-4df1-a5f3-715ee151d5f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:32.951811663 +0000 UTC m=+36.127213046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls") pod "dns-default-5zkxm" (UID: "b0b8d226-7352-4df1-a5f3-715ee151d5f7") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:32.451953 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.451895    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b8d226-7352-4df1-a5f3-715ee151d5f7-tmp-dir\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.451953 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.451752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/858ebc79-e49c-48c2-9987-d078ad1cc57c-cert\") pod \"ingress-canary-8gjlv\" (UID: \"858ebc79-e49c-48c2-9987-d078ad1cc57c\") " pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.452094 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.451980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0b8d226-7352-4df1-a5f3-715ee151d5f7-config-volume\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.452492 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.452468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0b8d226-7352-4df1-a5f3-715ee151d5f7-config-volume\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.457114 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.457090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/858ebc79-e49c-48c2-9987-d078ad1cc57c-cert\") pod \"ingress-canary-8gjlv\" (UID: \"858ebc79-e49c-48c2-9987-d078ad1cc57c\") " pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.464811 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.464749    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5pv4\" (UniqueName: \"kubernetes.io/projected/b0b8d226-7352-4df1-a5f3-715ee151d5f7-kube-api-access-g5pv4\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.464932 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.464851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jh2g\" (UniqueName: \"kubernetes.io/projected/858ebc79-e49c-48c2-9987-d078ad1cc57c-kube-api-access-7jh2g\") pod \"ingress-canary-8gjlv\" (UID: \"858ebc79-e49c-48c2-9987-d078ad1cc57c\") " pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.554970 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.554936    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gjlv"
Jul 17 05:33:32.956068 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:32.956029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:32.956242 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:32.956221    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:32.956313 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:32.956303    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls podName:b0b8d226-7352-4df1-a5f3-715ee151d5f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:33.956278963 +0000 UTC m=+37.131680334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls") pod "dns-default-5zkxm" (UID: "b0b8d226-7352-4df1-a5f3-715ee151d5f7") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:33.682503 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:33.682251    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gjlv"]
Jul 17 05:33:33.770225 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:33.770132    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858ebc79_e49c_48c2_9987_d078ad1cc57c.slice/crio-802c489f4505b5d33c3e53285ff8922819dc3592a41beb6cc87ceb16851ada02 WatchSource:0}: Error finding container 802c489f4505b5d33c3e53285ff8922819dc3592a41beb6cc87ceb16851ada02: Status 404 returned error can't find the container with id 802c489f4505b5d33c3e53285ff8922819dc3592a41beb6cc87ceb16851ada02
Jul 17 05:33:33.963860 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:33.963831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:33.963990 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:33.963974    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:33.964041 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:33.964032    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls podName:b0b8d226-7352-4df1-a5f3-715ee151d5f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:35.964015244 +0000 UTC m=+39.139416617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls") pod "dns-default-5zkxm" (UID: "b0b8d226-7352-4df1-a5f3-715ee151d5f7") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:34.552782 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:34.552736    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d92e4ea-3d22-4a60-ac6d-1bcf46784842" containerID="eb6bbe9b75984108de069a898ff86b3d3e9486ac9fc9611b4e1fca0fbd086aa3" exitCode=0
Jul 17 05:33:34.552953 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:34.552815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerDied","Data":"eb6bbe9b75984108de069a898ff86b3d3e9486ac9fc9611b4e1fca0fbd086aa3"}
Jul 17 05:33:34.554404 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:34.554375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gjlv" event={"ID":"858ebc79-e49c-48c2-9987-d078ad1cc57c","Type":"ContainerStarted","Data":"802c489f4505b5d33c3e53285ff8922819dc3592a41beb6cc87ceb16851ada02"}
Jul 17 05:33:35.561161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:35.561123    2559 generic.go:356] "Generic (PLEG): container finished" podID="8d92e4ea-3d22-4a60-ac6d-1bcf46784842" containerID="a0fc7b4b58270274449dae43bf43b32bced9dd8aad97857e4115eb13beee2ad1" exitCode=0
Jul 17 05:33:35.561536 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:35.561198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerDied","Data":"a0fc7b4b58270274449dae43bf43b32bced9dd8aad97857e4115eb13beee2ad1"}
Jul 17 05:33:35.978842 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:35.978794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:35.979037 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:35.978991    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:35.979099 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:35.979077    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls podName:b0b8d226-7352-4df1-a5f3-715ee151d5f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:39.979054227 +0000 UTC m=+43.154455611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls") pod "dns-default-5zkxm" (UID: "b0b8d226-7352-4df1-a5f3-715ee151d5f7") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:36.566251 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:36.566221    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" event={"ID":"8d92e4ea-3d22-4a60-ac6d-1bcf46784842","Type":"ContainerStarted","Data":"cc87c49a4fefe48d9e0ebea204fb2c86bc2f524cdba3226c2a7145e77b59d217"}
Jul 17 05:33:36.567594 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:36.567577    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gjlv" event={"ID":"858ebc79-e49c-48c2-9987-d078ad1cc57c","Type":"ContainerStarted","Data":"9a730b3c05d24e4242554b7a3da9876a54f5894103a770873c5776bbc9b4518c"}
Jul 17 05:33:36.590614 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:36.590566    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sxkd2" podStartSLOduration=9.571759621 podStartE2EDuration="38.590553735s" totalImagesPullingTime="29.018794114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:36.588905288 +0000 UTC m=+39.764306676" watchObservedRunningTime="2026-07-17 05:33:36.590553735 +0000 UTC m=+39.765955123"
Jul 17 05:33:36.605765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:36.605718    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8gjlv" podStartSLOduration=2.614326367 podStartE2EDuration="4.605703734s" totalImagesPullingTime="1.991377367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:36.605594562 +0000 UTC m=+39.780995949" watchObservedRunningTime="2026-07-17 05:33:36.605703734 +0000 UTC m=+39.781105122"
Jul 17 05:33:40.009435 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:40.009393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:40.009890 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:40.009510    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:40.009890 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:40.009575    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls podName:b0b8d226-7352-4df1-a5f3-715ee151d5f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:48.00955956 +0000 UTC m=+51.184960927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls") pod "dns-default-5zkxm" (UID: "b0b8d226-7352-4df1-a5f3-715ee151d5f7") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:41.649468 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.649438    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"]
Jul 17 05:33:41.683391 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.683366    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"]
Jul 17 05:33:41.683543 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.683457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.686157 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.686124    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 05:33:41.686295 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.686279    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 05:33:41.687306 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.687287    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j7rqv\""
Jul 17 05:33:41.687433 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.687319    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:33:41.687433 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.687330    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 05:33:41.762475 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.762437    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-999d548-ds5gd"]
Jul 17 05:33:41.783396 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.783357    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xkx2c"]
Jul 17 05:33:41.783558 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.783495    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:41.786361 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.786334    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 05:33:41.786606 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.786427    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 05:33:41.786733 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.786685    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 05:33:41.786842 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.786825    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 05:33:41.786972 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.786842    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-w8srn\""
Jul 17 05:33:41.786972 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.786915    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 05:33:41.787110 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.787096    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 05:33:41.795366 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.795348    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xkx2c"]
Jul 17 05:33:41.795449 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.795374    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-999d548-ds5gd"]
Jul 17 05:33:41.795449 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.795438    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:41.797915 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.797897    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4fjwg\""
Jul 17 05:33:41.798052 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.797916    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 17 05:33:41.798052 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.797901    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 17 05:33:41.798169 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.798102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 17 05:33:41.798351 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.798335    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 17 05:33:41.803446 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.803426    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 17 05:33:41.820224 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.820193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.820319 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.820231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.820319 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.820257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hnrl\" (UniqueName: \"kubernetes.io/projected/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-kube-api-access-2hnrl\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.921373 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.921373 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hnrl\" (UniqueName: \"kubernetes.io/projected/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-kube-api-access-2hnrl\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.921373 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-stats-auth\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:41.921686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-default-certificate\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:41.921686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:41.921686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsbkf\" (UniqueName: \"kubernetes.io/projected/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-kube-api-access-lsbkf\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:41.921686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:41.921686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f7a8c66-33dc-43b1-ac92-a195b436d925-trusted-ca\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:41.921686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f7a8c66-33dc-43b1-ac92-a195b436d925-config\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:41.921686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f7a8c66-33dc-43b1-ac92-a195b436d925-serving-cert\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:41.922033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921695    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.922033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7z2\" (UniqueName: \"kubernetes.io/projected/6f7a8c66-33dc-43b1-ac92-a195b436d925-kube-api-access-sg7z2\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:41.922033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.921965    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.925629 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.925604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.931845 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.931823    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hnrl\" (UniqueName: \"kubernetes.io/projected/970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc-kube-api-access-2hnrl\") pod \"kube-storage-version-migrator-operator-7658d9b749-9x7k9\" (UID: \"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:41.993186 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:41.993152    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"
Jul 17 05:33:42.023134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f7a8c66-33dc-43b1-ac92-a195b436d925-trusted-ca\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.023266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f7a8c66-33dc-43b1-ac92-a195b436d925-config\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.023266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f7a8c66-33dc-43b1-ac92-a195b436d925-serving-cert\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.023391 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7z2\" (UniqueName: \"kubernetes.io/projected/6f7a8c66-33dc-43b1-ac92-a195b436d925-kube-api-access-sg7z2\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.023391 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-stats-auth\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.023491 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-default-certificate\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.023491 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.023491 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsbkf\" (UniqueName: \"kubernetes.io/projected/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-kube-api-access-lsbkf\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.023635 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.023635 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:42.023616    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:42.523588712 +0000 UTC m=+45.698990097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : configmap references non-existent config key: service-ca.crt
Jul 17 05:33:42.023735 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:42.023634    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 05:33:42.023735 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:42.023703    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:42.523684102 +0000 UTC m=+45.699085471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : secret "router-metrics-certs-default" not found
Jul 17 05:33:42.023921 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.023858    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f7a8c66-33dc-43b1-ac92-a195b436d925-config\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.024220 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.024192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f7a8c66-33dc-43b1-ac92-a195b436d925-trusted-ca\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.025917 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.025842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f7a8c66-33dc-43b1-ac92-a195b436d925-serving-cert\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.026399 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.026376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-stats-auth\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.026531 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.026507    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-default-certificate\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.034719 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.034695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsbkf\" (UniqueName: \"kubernetes.io/projected/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-kube-api-access-lsbkf\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.036309 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.036281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7z2\" (UniqueName: \"kubernetes.io/projected/6f7a8c66-33dc-43b1-ac92-a195b436d925-kube-api-access-sg7z2\") pod \"console-operator-565b7b569d-xkx2c\" (UID: \"6f7a8c66-33dc-43b1-ac92-a195b436d925\") " pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.104943 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.104912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:42.137179 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.137154    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9"]
Jul 17 05:33:42.140470 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:42.140442    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970ad0c6_b7a0_4adb_ba9d_4593a5eb81cc.slice/crio-26eddfe3c9c25aebc511100a27cfd12f1e0c1bd0b8b5b9330136efc08a0fe823 WatchSource:0}: Error finding container 26eddfe3c9c25aebc511100a27cfd12f1e0c1bd0b8b5b9330136efc08a0fe823: Status 404 returned error can't find the container with id 26eddfe3c9c25aebc511100a27cfd12f1e0c1bd0b8b5b9330136efc08a0fe823
Jul 17 05:33:42.250412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.250382    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xkx2c"]
Jul 17 05:33:42.252959 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:42.252933    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7a8c66_33dc_43b1_ac92_a195b436d925.slice/crio-a003019574a42132b6863119c572fdb52d510da50558ca88b86b8952a032a2ba WatchSource:0}: Error finding container a003019574a42132b6863119c572fdb52d510da50558ca88b86b8952a032a2ba: Status 404 returned error can't find the container with id a003019574a42132b6863119c572fdb52d510da50558ca88b86b8952a032a2ba
Jul 17 05:33:42.527668 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.527590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.527668 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.527628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:42.527844 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:42.527771    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 05:33:42.527844 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:42.527782    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:43.527761889 +0000 UTC m=+46.703163255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : configmap references non-existent config key: service-ca.crt
Jul 17 05:33:42.527844 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:42.527813    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:43.527799765 +0000 UTC m=+46.703201131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : secret "router-metrics-certs-default" not found
Jul 17 05:33:42.581970 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.581934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9" event={"ID":"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc","Type":"ContainerStarted","Data":"26eddfe3c9c25aebc511100a27cfd12f1e0c1bd0b8b5b9330136efc08a0fe823"}
Jul 17 05:33:42.583086 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:42.583062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" event={"ID":"6f7a8c66-33dc-43b1-ac92-a195b436d925","Type":"ContainerStarted","Data":"a003019574a42132b6863119c572fdb52d510da50558ca88b86b8952a032a2ba"}
Jul 17 05:33:43.536650 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:43.536615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:43.537091 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:43.536717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:43.537091 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:43.536786    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 05:33:43.537091 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:43.536819    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:45.536803593 +0000 UTC m=+48.712204962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : configmap references non-existent config key: service-ca.crt
Jul 17 05:33:43.537091 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:43.536849    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:45.536832378 +0000 UTC m=+48.712233745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : secret "router-metrics-certs-default" not found
Jul 17 05:33:45.554705 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.554675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:45.555144 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.554713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:45.555144 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:45.554846    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 05:33:45.555144 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:45.554892    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:49.554847759 +0000 UTC m=+52.730249137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : configmap references non-existent config key: service-ca.crt
Jul 17 05:33:45.555144 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:45.554935    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:49.554921154 +0000 UTC m=+52.730322521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : secret "router-metrics-certs-default" not found
Jul 17 05:33:45.593186 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.593151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9" event={"ID":"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc","Type":"ContainerStarted","Data":"2c821a61ae923a3c839087a1d0e6a0be368eb343bc2963c10fff307ca359126c"}
Jul 17 05:33:45.594712 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.594694    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/0.log"
Jul 17 05:33:45.594802 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.594729    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f7a8c66-33dc-43b1-ac92-a195b436d925" containerID="94e1dbbb6c8f7bfe2894c37df848c5043e0afa2a42594cb92adb5839d0b38939" exitCode=255
Jul 17 05:33:45.594802 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.594765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" event={"ID":"6f7a8c66-33dc-43b1-ac92-a195b436d925","Type":"ContainerDied","Data":"94e1dbbb6c8f7bfe2894c37df848c5043e0afa2a42594cb92adb5839d0b38939"}
Jul 17 05:33:45.594991 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.594975    2559 scope.go:117] "RemoveContainer" containerID="94e1dbbb6c8f7bfe2894c37df848c5043e0afa2a42594cb92adb5839d0b38939"
Jul 17 05:33:45.610004 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:45.609962    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9" podStartSLOduration=1.632585459 podStartE2EDuration="4.609945311s" totalImagesPullingTime="2.977359852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:45.60946888 +0000 UTC m=+48.784870268" watchObservedRunningTime="2026-07-17 05:33:45.609945311 +0000 UTC m=+48.785346700"
Jul 17 05:33:46.478771 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.478734    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hfz44"]
Jul 17 05:33:46.506985 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.506946    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hfz44"]
Jul 17 05:33:46.507122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.507068    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.509671 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.509640    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 05:33:46.509776 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.509704    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 05:33:46.510822 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.510802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 05:33:46.510930 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.510822    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 05:33:46.510930 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.510811    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tk2pd\""
Jul 17 05:33:46.598545 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.598516    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/1.log"
Jul 17 05:33:46.598972 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.598939    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/0.log"
Jul 17 05:33:46.599023 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.598974    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f7a8c66-33dc-43b1-ac92-a195b436d925" containerID="7bdf794434c49eb5853a07a20168a7f47adbcdcdd845b5e5786b9209a8a6f465" exitCode=255
Jul 17 05:33:46.599062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.599011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" event={"ID":"6f7a8c66-33dc-43b1-ac92-a195b436d925","Type":"ContainerDied","Data":"7bdf794434c49eb5853a07a20168a7f47adbcdcdd845b5e5786b9209a8a6f465"}
Jul 17 05:33:46.599101 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.599089    2559 scope.go:117] "RemoveContainer" containerID="94e1dbbb6c8f7bfe2894c37df848c5043e0afa2a42594cb92adb5839d0b38939"
Jul 17 05:33:46.599283 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.599265    2559 scope.go:117] "RemoveContainer" containerID="7bdf794434c49eb5853a07a20168a7f47adbcdcdd845b5e5786b9209a8a6f465"
Jul 17 05:33:46.599482 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:46.599461    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xkx2c_openshift-console-operator(6f7a8c66-33dc-43b1-ac92-a195b436d925)\"" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" podUID="6f7a8c66-33dc-43b1-ac92-a195b436d925"
Jul 17 05:33:46.665490 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.665450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.665642 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.665542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c32e9683-e7dd-4dbc-9376-23730806bffe-crio-socket\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.665642 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.665613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32e9683-e7dd-4dbc-9376-23730806bffe-data-volume\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.665730 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.665642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.665730 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.665688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlh8k\" (UniqueName: \"kubernetes.io/projected/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-api-access-jlh8k\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766398 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.766313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766398 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.766384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c32e9683-e7dd-4dbc-9376-23730806bffe-crio-socket\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766618 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.766442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32e9683-e7dd-4dbc-9376-23730806bffe-data-volume\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766618 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.766464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766618 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:46.766531    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:46.766618 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.766605    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlh8k\" (UniqueName: \"kubernetes.io/projected/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-api-access-jlh8k\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766804 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.766650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c32e9683-e7dd-4dbc-9376-23730806bffe-crio-socket\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766804 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:46.766679    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:47.266657739 +0000 UTC m=+50.442059116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:46.766804 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:46.766728    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:46.766804 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.766763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32e9683-e7dd-4dbc-9376-23730806bffe-data-volume\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:46.766804 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:46.766774    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:47.26675702 +0000 UTC m=+50.442158398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:46.774925 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:46.774897    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlh8k\" (UniqueName: \"kubernetes.io/projected/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-api-access-jlh8k\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:47.270352 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:47.270315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:47.270522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:47.270370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:47.270522 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:47.270432    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:47.270522 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:47.270489    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:48.270473138 +0000 UTC m=+51.445874505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:47.270627 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:47.270544    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:47.270627 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:47.270596    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:48.270582858 +0000 UTC m=+51.445984227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:47.602928 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:47.602899    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/1.log"
Jul 17 05:33:47.603276 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:47.603189    2559 scope.go:117] "RemoveContainer" containerID="7bdf794434c49eb5853a07a20168a7f47adbcdcdd845b5e5786b9209a8a6f465"
Jul 17 05:33:47.603345 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:47.603326    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xkx2c_openshift-console-operator(6f7a8c66-33dc-43b1-ac92-a195b436d925)\"" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" podUID="6f7a8c66-33dc-43b1-ac92-a195b436d925"
Jul 17 05:33:48.006183 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.006097    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9kvs2"]
Jul 17 05:33:48.018750 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.018714    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9kvs2"]
Jul 17 05:33:48.018941 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.018805    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.021452 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.021425    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 17 05:33:48.021677 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.021655    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 17 05:33:48.021773 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.021681    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zk9fm\""
Jul 17 05:33:48.021773 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.021729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 17 05:33:48.021773 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.021657    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 17 05:33:48.077452 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.077427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:33:48.077567 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:48.077546    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 05:33:48.077614 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:48.077596    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls podName:b0b8d226-7352-4df1-a5f3-715ee151d5f7 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:04.077582819 +0000 UTC m=+67.252984188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls") pod "dns-default-5zkxm" (UID: "b0b8d226-7352-4df1-a5f3-715ee151d5f7") : secret "dns-default-metrics-tls" not found
Jul 17 05:33:48.178496 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.178463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51b427ac-47e2-4863-b3da-2da9248c2a50-signing-cabundle\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.178686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.178531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51b427ac-47e2-4863-b3da-2da9248c2a50-signing-key\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.178686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.178549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldzq\" (UniqueName: \"kubernetes.io/projected/51b427ac-47e2-4863-b3da-2da9248c2a50-kube-api-access-5ldzq\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.279285 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.279198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51b427ac-47e2-4863-b3da-2da9248c2a50-signing-cabundle\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.279285 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.279242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:48.279500 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.279380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:48.279500 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.279432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51b427ac-47e2-4863-b3da-2da9248c2a50-signing-key\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.279500 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.279458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldzq\" (UniqueName: \"kubernetes.io/projected/51b427ac-47e2-4863-b3da-2da9248c2a50-kube-api-access-5ldzq\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.279500 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:48.279463    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:48.279674 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:48.279510    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:48.279674 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:48.279524    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:50.279504447 +0000 UTC m=+53.454905816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:48.279674 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:48.279564    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:50.279552709 +0000 UTC m=+53.454954103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:48.279987 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.279965    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/51b427ac-47e2-4863-b3da-2da9248c2a50-signing-cabundle\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.281805 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.281777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/51b427ac-47e2-4863-b3da-2da9248c2a50-signing-key\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.288122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.288098    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldzq\" (UniqueName: \"kubernetes.io/projected/51b427ac-47e2-4863-b3da-2da9248c2a50-kube-api-access-5ldzq\") pod \"service-ca-58598695f7-9kvs2\" (UID: \"51b427ac-47e2-4863-b3da-2da9248c2a50\") " pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.331347 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.331321    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9kvs2"
Jul 17 05:33:48.458835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.458809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjr76_f444dc08-a6cc-404b-95c1-cfaab0130659/dns-node-resolver/0.log"
Jul 17 05:33:48.478936 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.478907    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9kvs2"]
Jul 17 05:33:48.482606 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:33:48.482580    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b427ac_47e2_4863_b3da_2da9248c2a50.slice/crio-18a37da2163043bef94b499e60bc1b7bf991396f166cf0daa1442c86d8048de7 WatchSource:0}: Error finding container 18a37da2163043bef94b499e60bc1b7bf991396f166cf0daa1442c86d8048de7: Status 404 returned error can't find the container with id 18a37da2163043bef94b499e60bc1b7bf991396f166cf0daa1442c86d8048de7
Jul 17 05:33:48.606440 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:48.606401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9kvs2" event={"ID":"51b427ac-47e2-4863-b3da-2da9248c2a50","Type":"ContainerStarted","Data":"18a37da2163043bef94b499e60bc1b7bf991396f166cf0daa1442c86d8048de7"}
Jul 17 05:33:49.458770 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:49.458738    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ggq6n_ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe/node-ca/0.log"
Jul 17 05:33:49.591508 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:49.591474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:49.591674 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:49.591516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:49.591674 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:49.591639    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 05:33:49.591674 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:49.591644    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:57.591626317 +0000 UTC m=+60.767027683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : configmap references non-existent config key: service-ca.crt
Jul 17 05:33:49.591827 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:49.591679    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:33:57.59166754 +0000 UTC m=+60.767068906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : secret "router-metrics-certs-default" not found
Jul 17 05:33:50.060710 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:50.060676    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gjlv_858ebc79-e49c-48c2-9987-d078ad1cc57c/serve-healthcheck-canary/0.log"
Jul 17 05:33:50.297158 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:50.297120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:50.297369 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:50.297191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:50.297369 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:50.297223    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:50.297369 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:50.297294    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:54.297274406 +0000 UTC m=+57.472675781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:50.297369 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:50.297340    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:50.297562 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:50.297387    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:33:54.297374449 +0000 UTC m=+57.472775826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:51.615389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:51.615353    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9kvs2" event={"ID":"51b427ac-47e2-4863-b3da-2da9248c2a50","Type":"ContainerStarted","Data":"15235e7411e5ca86ca2a8f2756aec44fe65a9662180513bc76226565dbaa34b7"}
Jul 17 05:33:51.635583 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:51.635534    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-9kvs2" podStartSLOduration=2.2864494029999998 podStartE2EDuration="4.635519022s" totalImagesPullingTime="2.349069619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:33:51.634093995 +0000 UTC m=+54.809495383" watchObservedRunningTime="2026-07-17 05:33:51.635519022 +0000 UTC m=+54.810920409"
Jul 17 05:33:52.105978 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:52.105935    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:52.106178 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:52.106011    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:33:52.106430 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:52.106412    2559 scope.go:117] "RemoveContainer" containerID="7bdf794434c49eb5853a07a20168a7f47adbcdcdd845b5e5786b9209a8a6f465"
Jul 17 05:33:52.106632 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:52.106608    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xkx2c_openshift-console-operator(6f7a8c66-33dc-43b1-ac92-a195b436d925)\"" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" podUID="6f7a8c66-33dc-43b1-ac92-a195b436d925"
Jul 17 05:33:54.326565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:54.326518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:54.327048 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:54.326583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:33:54.327048 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:54.326664    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 05:33:54.327048 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:54.326736    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:34:02.326720192 +0000 UTC m=+65.502121575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : configmap "kube-rbac-proxy" not found
Jul 17 05:33:54.327048 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:54.326747    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:54.327048 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:54.326800    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:34:02.3267862 +0000 UTC m=+65.502187567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:33:57.541399 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:57.541365    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fkn9n"
Jul 17 05:33:57.650302 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:57.650268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:57.650505 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:57.650312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:33:57.650505 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:33:57.650440    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle podName:8c95ac39-9776-4d2e-9fd6-f605c6968bf1 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:13.650417637 +0000 UTC m=+76.825819008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle") pod "router-default-999d548-ds5gd" (UID: "8c95ac39-9776-4d2e-9fd6-f605c6968bf1") : configmap references non-existent config key: service-ca.crt
Jul 17 05:33:57.652698 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:33:57.652674    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-metrics-certs\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:02.387840 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:02.387795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:34:02.388287 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:02.387862    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:34:02.388287 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:34:02.388010    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 05:34:02.388287 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:34:02.388101    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls podName:c32e9683-e7dd-4dbc-9376-23730806bffe nodeName:}" failed. No retries permitted until 2026-07-17 05:34:18.388080736 +0000 UTC m=+81.563482102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hfz44" (UID: "c32e9683-e7dd-4dbc-9376-23730806bffe") : secret "insights-runtime-extractor-tls" not found
Jul 17 05:34:02.388473 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:02.388451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c32e9683-e7dd-4dbc-9376-23730806bffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:34:03.094521 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.094485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:34:03.094521 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.094522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:34:03.097045 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.097022    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 05:34:03.098117 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.098100    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 05:34:03.107458 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.107437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/718090ad-0b69-4d76-bcf4-4697ef0f81f7-metrics-certs\") pod \"network-metrics-daemon-rzfdl\" (UID: \"718090ad-0b69-4d76-bcf4-4697ef0f81f7\") " pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:34:03.107541 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.107492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ee7f2dc-b515-4443-923d-edb1d64e60a9-original-pull-secret\") pod \"global-pull-secret-syncer-hhp4p\" (UID: \"5ee7f2dc-b515-4443-923d-edb1d64e60a9\") " pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:34:03.194947 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.194909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:34:03.197656 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.197636    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 05:34:03.208008 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.207988    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 05:34:03.218358 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.218335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-227zt\" (UniqueName: \"kubernetes.io/projected/8b6e36d2-ad19-47b0-8d1d-45af127659ec-kube-api-access-227zt\") pod \"network-check-target-cfqnr\" (UID: \"8b6e36d2-ad19-47b0-8d1d-45af127659ec\") " pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:34:03.232524 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.232500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x8c5l\""
Jul 17 05:34:03.239581 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.239560    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-44td2\""
Jul 17 05:34:03.240535 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.240519    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:34:03.244369 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.244352    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhp4p"
Jul 17 05:34:03.248184 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.248163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzfdl"
Jul 17 05:34:03.324631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.323737    2559 scope.go:117] "RemoveContainer" containerID="7bdf794434c49eb5853a07a20168a7f47adbcdcdd845b5e5786b9209a8a6f465"
Jul 17 05:34:03.395679 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.395651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cfqnr"]
Jul 17 05:34:03.398967 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:03.398940    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6e36d2_ad19_47b0_8d1d_45af127659ec.slice/crio-ff39f6ae342320812487d2e9dc0a31e7fb0c7cc6a83db0f5c8dc9c0a1c9c69bb WatchSource:0}: Error finding container ff39f6ae342320812487d2e9dc0a31e7fb0c7cc6a83db0f5c8dc9c0a1c9c69bb: Status 404 returned error can't find the container with id ff39f6ae342320812487d2e9dc0a31e7fb0c7cc6a83db0f5c8dc9c0a1c9c69bb
Jul 17 05:34:03.408056 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.408030    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rzfdl"]
Jul 17 05:34:03.411019 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:03.410979    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718090ad_0b69_4d76_bcf4_4697ef0f81f7.slice/crio-fa6de8dbd1ae515a2fc9d87fb9b2613668e8fcc2fcdfa580fec4c4b1a6343291 WatchSource:0}: Error finding container fa6de8dbd1ae515a2fc9d87fb9b2613668e8fcc2fcdfa580fec4c4b1a6343291: Status 404 returned error can't find the container with id fa6de8dbd1ae515a2fc9d87fb9b2613668e8fcc2fcdfa580fec4c4b1a6343291
Jul 17 05:34:03.423365 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.423341    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hhp4p"]
Jul 17 05:34:03.646292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.646212    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:34:03.646627 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.646609    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/1.log"
Jul 17 05:34:03.646740 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.646648    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f7a8c66-33dc-43b1-ac92-a195b436d925" containerID="e6944bc6b4ae5e97198e71df7e6bd3f6a48614a700492a3ceccf8e87fc5b5df9" exitCode=255
Jul 17 05:34:03.646740 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.646715    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" event={"ID":"6f7a8c66-33dc-43b1-ac92-a195b436d925","Type":"ContainerDied","Data":"e6944bc6b4ae5e97198e71df7e6bd3f6a48614a700492a3ceccf8e87fc5b5df9"}
Jul 17 05:34:03.646838 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.646774    2559 scope.go:117] "RemoveContainer" containerID="7bdf794434c49eb5853a07a20168a7f47adbcdcdd845b5e5786b9209a8a6f465"
Jul 17 05:34:03.647136 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.647111    2559 scope.go:117] "RemoveContainer" containerID="e6944bc6b4ae5e97198e71df7e6bd3f6a48614a700492a3ceccf8e87fc5b5df9"
Jul 17 05:34:03.647332 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:34:03.647309    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-xkx2c_openshift-console-operator(6f7a8c66-33dc-43b1-ac92-a195b436d925)\"" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" podUID="6f7a8c66-33dc-43b1-ac92-a195b436d925"
Jul 17 05:34:03.647900 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.647862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rzfdl" event={"ID":"718090ad-0b69-4d76-bcf4-4697ef0f81f7","Type":"ContainerStarted","Data":"fa6de8dbd1ae515a2fc9d87fb9b2613668e8fcc2fcdfa580fec4c4b1a6343291"}
Jul 17 05:34:03.649003 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.648983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hhp4p" event={"ID":"5ee7f2dc-b515-4443-923d-edb1d64e60a9","Type":"ContainerStarted","Data":"bbcec0e4cf201d8b3c0830a00c7d2267f73c2406f4260bc0cb39c57f25e8be96"}
Jul 17 05:34:03.650025 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:03.650005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cfqnr" event={"ID":"8b6e36d2-ad19-47b0-8d1d-45af127659ec","Type":"ContainerStarted","Data":"ff39f6ae342320812487d2e9dc0a31e7fb0c7cc6a83db0f5c8dc9c0a1c9c69bb"}
Jul 17 05:34:04.104078 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.104044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:34:04.107206 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.107183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b8d226-7352-4df1-a5f3-715ee151d5f7-metrics-tls\") pod \"dns-default-5zkxm\" (UID: \"b0b8d226-7352-4df1-a5f3-715ee151d5f7\") " pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:34:04.345819 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.345790    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qq4z7\""
Jul 17 05:34:04.353969 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.353942    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:34:04.531754 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.531690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zkxm"]
Jul 17 05:34:04.541354 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:04.541322    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b8d226_7352_4df1_a5f3_715ee151d5f7.slice/crio-2c72eb25238eb827d1c6b1578c4f4eda8243c460d6128abe08f31650e0dce19a WatchSource:0}: Error finding container 2c72eb25238eb827d1c6b1578c4f4eda8243c460d6128abe08f31650e0dce19a: Status 404 returned error can't find the container with id 2c72eb25238eb827d1c6b1578c4f4eda8243c460d6128abe08f31650e0dce19a
Jul 17 05:34:04.658150 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.658036    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:34:04.661122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.660986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rzfdl" event={"ID":"718090ad-0b69-4d76-bcf4-4697ef0f81f7","Type":"ContainerStarted","Data":"ae90e1be29871a4551e5281cdf2f5781f8eb3ff253561434387b211b59347577"}
Jul 17 05:34:04.661122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.661047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rzfdl" event={"ID":"718090ad-0b69-4d76-bcf4-4697ef0f81f7","Type":"ContainerStarted","Data":"07121e8977ec231e95e1f25c038d6170c2bd692df26dcc5fc4e33d7f8645e578"}
Jul 17 05:34:04.663659 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.663576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zkxm" event={"ID":"b0b8d226-7352-4df1-a5f3-715ee151d5f7","Type":"ContainerStarted","Data":"2c72eb25238eb827d1c6b1578c4f4eda8243c460d6128abe08f31650e0dce19a"}
Jul 17 05:34:04.679381 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:04.679329    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rzfdl" podStartSLOduration=65.686065344 podStartE2EDuration="1m6.679313163s" totalImagesPullingTime="993.247819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:04.679057849 +0000 UTC m=+67.854459240" watchObservedRunningTime="2026-07-17 05:34:04.679313163 +0000 UTC m=+67.854714552"
Jul 17 05:34:08.246041 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.246001    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"]
Jul 17 05:34:08.283025 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.282992    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.288826 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.288380    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 05:34:08.288826 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.288666    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 05:34:08.289632 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.289606    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 05:34:08.290265 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.290192    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 05:34:08.290385 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.290278    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 05:34:08.293768 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.293718    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 05:34:08.293908 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.293733    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 05:34:08.295154 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.295130    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"]
Jul 17 05:34:08.335203 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.335170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/01946647-759b-4e32-9a45-5e1702fe01e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.335203 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.335208    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.335412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.335319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-hub\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.335412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.335351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5jfn\" (UniqueName: \"kubernetes.io/projected/01946647-759b-4e32-9a45-5e1702fe01e8-kube-api-access-k5jfn\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.335412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.335383    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-ca\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.335412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.335399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.436071 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.436031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5jfn\" (UniqueName: \"kubernetes.io/projected/01946647-759b-4e32-9a45-5e1702fe01e8-kube-api-access-k5jfn\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.436266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.436107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-ca\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.436266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.436137    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.436266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.436195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/01946647-759b-4e32-9a45-5e1702fe01e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.436266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.436217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.436493 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.436275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-hub\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.437166 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.437101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/01946647-759b-4e32-9a45-5e1702fe01e8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.439241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.439214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-ca\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.439359 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.439344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.439477 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.439456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.439834 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.439811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/01946647-759b-4e32-9a45-5e1702fe01e8-hub\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.448083 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.448055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5jfn\" (UniqueName: \"kubernetes.io/projected/01946647-759b-4e32-9a45-5e1702fe01e8-kube-api-access-k5jfn\") pod \"cluster-proxy-proxy-agent-6598957c55-kk5zw\" (UID: \"01946647-759b-4e32-9a45-5e1702fe01e8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:08.600178 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:08.600075    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"
Jul 17 05:34:09.235586 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.235557    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw"]
Jul 17 05:34:09.241123 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:09.241090    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01946647_759b_4e32_9a45_5e1702fe01e8.slice/crio-c5d16b24912e024a4fad0a17247d3c5153dd807e6dc854e3a4fc0e31c0228d23 WatchSource:0}: Error finding container c5d16b24912e024a4fad0a17247d3c5153dd807e6dc854e3a4fc0e31c0228d23: Status 404 returned error can't find the container with id c5d16b24912e024a4fad0a17247d3c5153dd807e6dc854e3a4fc0e31c0228d23
Jul 17 05:34:09.688249 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.688156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hhp4p" event={"ID":"5ee7f2dc-b515-4443-923d-edb1d64e60a9","Type":"ContainerStarted","Data":"0550d5e8e1f3e352a41dbb36f427227fe4219ac62674d63a1a0ec6173a1af5df"}
Jul 17 05:34:09.689793 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.689762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cfqnr" event={"ID":"8b6e36d2-ad19-47b0-8d1d-45af127659ec","Type":"ContainerStarted","Data":"c9ad7b29539f697c0b4ec68e7c3c9d85d5ba3ab9970fdce00100e5cd5ae0e585"}
Jul 17 05:34:09.689938 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.689826    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:34:09.691619 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.691597    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zkxm" event={"ID":"b0b8d226-7352-4df1-a5f3-715ee151d5f7","Type":"ContainerStarted","Data":"7a6e1a0fb9fc8f5ba441c96e4aca57fc48e5124998020a22fb95af78948078ad"}
Jul 17 05:34:09.691726 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.691636    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zkxm" event={"ID":"b0b8d226-7352-4df1-a5f3-715ee151d5f7","Type":"ContainerStarted","Data":"31be0bb618ba434444afa9f0b952af943675706674ba95fbb36761b208b6ca0f"}
Jul 17 05:34:09.691726 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.691679    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:34:09.692671 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.692652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw" event={"ID":"01946647-759b-4e32-9a45-5e1702fe01e8","Type":"ContainerStarted","Data":"c5d16b24912e024a4fad0a17247d3c5153dd807e6dc854e3a4fc0e31c0228d23"}
Jul 17 05:34:09.704306 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.704262    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hhp4p" podStartSLOduration=66.015383277 podStartE2EDuration="1m11.704247065s" totalImagesPullingTime="5.688863788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:09.703997869 +0000 UTC m=+72.879399258" watchObservedRunningTime="2026-07-17 05:34:09.704247065 +0000 UTC m=+72.879648453"
Jul 17 05:34:09.718644 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.718603    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cfqnr" podStartSLOduration=66.014177145 podStartE2EDuration="1m11.718591013s" totalImagesPullingTime="5.704413868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:09.717930144 +0000 UTC m=+72.893331533" watchObservedRunningTime="2026-07-17 05:34:09.718591013 +0000 UTC m=+72.893992379"
Jul 17 05:34:09.733750 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:09.733708    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5zkxm" podStartSLOduration=33.171483598 podStartE2EDuration="37.733698423s" totalImagesPullingTime="4.562214825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:09.733299878 +0000 UTC m=+72.908701266" watchObservedRunningTime="2026-07-17 05:34:09.733698423 +0000 UTC m=+72.909099811"
Jul 17 05:34:12.105344 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:12.105308    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:34:12.105741 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:12.105373    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:34:12.105741 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:12.105729    2559 scope.go:117] "RemoveContainer" containerID="e6944bc6b4ae5e97198e71df7e6bd3f6a48614a700492a3ceccf8e87fc5b5df9"
Jul 17 05:34:12.105946 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:34:12.105921    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-xkx2c_openshift-console-operator(6f7a8c66-33dc-43b1-ac92-a195b436d925)\"" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" podUID="6f7a8c66-33dc-43b1-ac92-a195b436d925"
Jul 17 05:34:12.707565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:12.707535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw" event={"ID":"01946647-759b-4e32-9a45-5e1702fe01e8","Type":"ContainerStarted","Data":"ae135ee441ea323524bbd46ddeabe069ff47f35027bf682583766bede973d133"}
Jul 17 05:34:12.707656 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:12.707580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw" event={"ID":"01946647-759b-4e32-9a45-5e1702fe01e8","Type":"ContainerStarted","Data":"98943c45a6d38d6647de2b95c67ee54d6cae49e0fb94fa7004eb518f22ca30e4"}
Jul 17 05:34:13.679453 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:13.679414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:13.680080 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:13.680060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c95ac39-9776-4d2e-9fd6-f605c6968bf1-service-ca-bundle\") pod \"router-default-999d548-ds5gd\" (UID: \"8c95ac39-9776-4d2e-9fd6-f605c6968bf1\") " pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:13.712679 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:13.712642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw" event={"ID":"01946647-759b-4e32-9a45-5e1702fe01e8","Type":"ContainerStarted","Data":"c2320e62d5d41956c2c99013aed39b1e138fee31dbb063b16b6714daf66bbb24"}
Jul 17 05:34:13.732263 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:13.732213    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6598957c55-kk5zw" podStartSLOduration=2.415329881 podStartE2EDuration="5.732197357s" totalImagesPullingTime="3.316867476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:13.730188892 +0000 UTC m=+76.905590281" watchObservedRunningTime="2026-07-17 05:34:13.732197357 +0000 UTC m=+76.907598792"
Jul 17 05:34:13.895179 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:13.895146    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-w8srn\""
Jul 17 05:34:13.903313 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:13.903285    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:14.034488 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:14.034464    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-999d548-ds5gd"]
Jul 17 05:34:14.036896 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:14.036849    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c95ac39_9776_4d2e_9fd6_f605c6968bf1.slice/crio-1a21d212bad9c00c65ec77ff06e17fe9c33bc3f7c580151bdd436bc626ed7323 WatchSource:0}: Error finding container 1a21d212bad9c00c65ec77ff06e17fe9c33bc3f7c580151bdd436bc626ed7323: Status 404 returned error can't find the container with id 1a21d212bad9c00c65ec77ff06e17fe9c33bc3f7c580151bdd436bc626ed7323
Jul 17 05:34:14.717119 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:14.717076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-999d548-ds5gd" event={"ID":"8c95ac39-9776-4d2e-9fd6-f605c6968bf1","Type":"ContainerStarted","Data":"c387c174e8ab3b6a3616bc57da226de83d93e2a07f8f4f914538c679fc4fb8ac"}
Jul 17 05:34:14.717504 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:14.717143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-999d548-ds5gd" event={"ID":"8c95ac39-9776-4d2e-9fd6-f605c6968bf1","Type":"ContainerStarted","Data":"1a21d212bad9c00c65ec77ff06e17fe9c33bc3f7c580151bdd436bc626ed7323"}
Jul 17 05:34:14.738186 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:14.738128    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-999d548-ds5gd" podStartSLOduration=33.738111536 podStartE2EDuration="33.738111536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:14.737394061 +0000 UTC m=+77.912795450" watchObservedRunningTime="2026-07-17 05:34:14.738111536 +0000 UTC m=+77.913512923"
Jul 17 05:34:14.904287 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:14.904246    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:14.906973 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:14.906951    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:15.720514 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:15.720482    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:15.721805 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:15.721790    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-999d548-ds5gd"
Jul 17 05:34:18.415258 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:18.415221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:34:18.417577 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:18.417539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c32e9683-e7dd-4dbc-9376-23730806bffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hfz44\" (UID: \"c32e9683-e7dd-4dbc-9376-23730806bffe\") " pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:34:18.618039 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:18.618000    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tk2pd\""
Jul 17 05:34:18.626225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:18.626194    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hfz44"
Jul 17 05:34:18.758294 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:18.758245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hfz44"]
Jul 17 05:34:18.761342 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:18.761308    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32e9683_e7dd_4dbc_9376_23730806bffe.slice/crio-c8914a24c2c57ae7a1080bd1dafef7499133977ac7c83e656c0be2dac96e21f2 WatchSource:0}: Error finding container c8914a24c2c57ae7a1080bd1dafef7499133977ac7c83e656c0be2dac96e21f2: Status 404 returned error can't find the container with id c8914a24c2c57ae7a1080bd1dafef7499133977ac7c83e656c0be2dac96e21f2
Jul 17 05:34:19.701828 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:19.701692    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5zkxm"
Jul 17 05:34:19.737403 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:19.737361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfz44" event={"ID":"c32e9683-e7dd-4dbc-9376-23730806bffe","Type":"ContainerStarted","Data":"c8914a24c2c57ae7a1080bd1dafef7499133977ac7c83e656c0be2dac96e21f2"}
Jul 17 05:34:23.755406 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:23.755368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfz44" event={"ID":"c32e9683-e7dd-4dbc-9376-23730806bffe","Type":"ContainerStarted","Data":"ffc6b821e1e9c65614eb177b97e946de91f56d4d71782a30a3eb84d432ab7be5"}
Jul 17 05:34:26.318270 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:26.318239    2559 scope.go:117] "RemoveContainer" containerID="e6944bc6b4ae5e97198e71df7e6bd3f6a48614a700492a3ceccf8e87fc5b5df9"
Jul 17 05:34:27.773864 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:27.773782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfz44" event={"ID":"c32e9683-e7dd-4dbc-9376-23730806bffe","Type":"ContainerStarted","Data":"f7cb7371431393f85a84af9f249186569ceefc02ef9e1cb73904fc55b3987fcc"}
Jul 17 05:34:27.775862 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:27.775839    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:34:27.775998 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:27.775919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" event={"ID":"6f7a8c66-33dc-43b1-ac92-a195b436d925","Type":"ContainerStarted","Data":"1281ff0f691c98c6dd4d3001b6a8cbb13917452ddaece3d5aab621e6ebe4a939"}
Jul 17 05:34:27.776300 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:27.776270    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:34:27.792928 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:27.792853    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c" podStartSLOduration=43.933296933 podStartE2EDuration="46.792833572s" totalImagesPullingTime="2.859536639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:27.792150509 +0000 UTC m=+90.967551898" watchObservedRunningTime="2026-07-17 05:34:27.792833572 +0000 UTC m=+90.968234960"
Jul 17 05:34:28.066650 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.066615    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-xkx2c"
Jul 17 05:34:28.665443 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.665412    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"]
Jul 17 05:34:28.671142 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.671046    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qtrfw"]
Jul 17 05:34:28.671424 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.671396    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.674964 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.674934    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 05:34:28.675563 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.675542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.676376 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.676353    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9hxpl\""
Jul 17 05:34:28.676462 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.676375    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 05:34:28.676554 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.676539    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 05:34:28.676593 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.676557    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 05:34:28.676927 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.676724    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 05:34:28.676927 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.676740    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 05:34:28.678725 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.678604    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 05:34:28.679150 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.679011    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 05:34:28.679150 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.679020    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 05:34:28.679316 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.679223    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vr8h8\""
Jul 17 05:34:28.689553 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.689116    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"]
Jul 17 05:34:28.804743 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.804694    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb67w\" (UniqueName: \"kubernetes.io/projected/94049aed-9ae3-4b0d-a0ec-51db3526fb51-kube-api-access-sb67w\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.804796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0734f07-d4a1-4b18-ad79-7095148f7d53-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.804836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94049aed-9ae3-4b0d-a0ec-51db3526fb51-metrics-client-ca\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.804888    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-tls\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.804917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.804956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.804992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-textfile\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rj2\" (UniqueName: \"kubernetes.io/projected/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-api-access-59rj2\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-root\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-wtmp\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.805241 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-sys\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.805844 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.805261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0734f07-d4a1-4b18-ad79-7095148f7d53-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-sys\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906296    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-sys\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0734f07-d4a1-4b18-ad79-7095148f7d53-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb67w\" (UniqueName: \"kubernetes.io/projected/94049aed-9ae3-4b0d-a0ec-51db3526fb51-kube-api-access-sb67w\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0734f07-d4a1-4b18-ad79-7095148f7d53-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94049aed-9ae3-4b0d-a0ec-51db3526fb51-metrics-client-ca\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-tls\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906567    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-textfile\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rj2\" (UniqueName: \"kubernetes.io/projected/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-api-access-59rj2\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-root\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-wtmp\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.906825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.907389 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:34:28.907023    2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:34:28.907113    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-tls podName:e0734f07-d4a1-4b18-ad79-7095148f7d53 nodeName:}" failed. No retries permitted until 2026-07-17 05:34:29.407090763 +0000 UTC m=+92.582492132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-8ph7z" (UID: "e0734f07-d4a1-4b18-ad79-7095148f7d53") : secret "kube-state-metrics-tls" not found
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.907240    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-textfile\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.907240    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0734f07-d4a1-4b18-ad79-7095148f7d53-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.907556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-wtmp\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.907914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94049aed-9ae3-4b0d-a0ec-51db3526fb51-metrics-client-ca\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.907978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94049aed-9ae3-4b0d-a0ec-51db3526fb51-root\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.908245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0734f07-d4a1-4b18-ad79-7095148f7d53-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.908395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.908371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.908728 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.908444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.910550 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.910518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.911233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.910836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.911233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.911180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94049aed-9ae3-4b0d-a0ec-51db3526fb51-node-exporter-tls\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.916646 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.916435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb67w\" (UniqueName: \"kubernetes.io/projected/94049aed-9ae3-4b0d-a0ec-51db3526fb51-kube-api-access-sb67w\") pod \"node-exporter-qtrfw\" (UID: \"94049aed-9ae3-4b0d-a0ec-51db3526fb51\") " pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:28.916646 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.916585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rj2\" (UniqueName: \"kubernetes.io/projected/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-api-access-59rj2\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:28.996008 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:28.995965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtrfw"
Jul 17 05:34:29.011409 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:29.011372    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94049aed_9ae3_4b0d_a0ec_51db3526fb51.slice/crio-f4fac715491298ec17db486a63c26a1a80765538177dd8d71718409c99e551af WatchSource:0}: Error finding container f4fac715491298ec17db486a63c26a1a80765538177dd8d71718409c99e551af: Status 404 returned error can't find the container with id f4fac715491298ec17db486a63c26a1a80765538177dd8d71718409c99e551af
Jul 17 05:34:29.412930 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:29.412895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:29.415891 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:29.415702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0734f07-d4a1-4b18-ad79-7095148f7d53-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8ph7z\" (UID: \"e0734f07-d4a1-4b18-ad79-7095148f7d53\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:29.587647 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:29.587612    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"
Jul 17 05:34:29.785166 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:29.785000    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtrfw" event={"ID":"94049aed-9ae3-4b0d-a0ec-51db3526fb51","Type":"ContainerStarted","Data":"f4fac715491298ec17db486a63c26a1a80765538177dd8d71718409c99e551af"}
Jul 17 05:34:31.097680 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:31.097643    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8ph7z"]
Jul 17 05:34:31.101561 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:31.101527    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0734f07_d4a1_4b18_ad79_7095148f7d53.slice/crio-f349e3339d59e6699568d046dcb83b61d9f82e880ec629627b51988cd792e212 WatchSource:0}: Error finding container f349e3339d59e6699568d046dcb83b61d9f82e880ec629627b51988cd792e212: Status 404 returned error can't find the container with id f349e3339d59e6699568d046dcb83b61d9f82e880ec629627b51988cd792e212
Jul 17 05:34:31.795389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:31.795352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z" event={"ID":"e0734f07-d4a1-4b18-ad79-7095148f7d53","Type":"ContainerStarted","Data":"f349e3339d59e6699568d046dcb83b61d9f82e880ec629627b51988cd792e212"}
Jul 17 05:34:31.797949 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:31.797844    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hfz44" event={"ID":"c32e9683-e7dd-4dbc-9376-23730806bffe","Type":"ContainerStarted","Data":"28156091f10295954d7b23b4a147af6b7997d655b1688dd8236ee6e35e7be696"}
Jul 17 05:34:31.800187 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:31.800161    2559 generic.go:356] "Generic (PLEG): container finished" podID="94049aed-9ae3-4b0d-a0ec-51db3526fb51" containerID="c28e5456a609b6b24aed0be9e6f0f72c16bf918e244c89bf803a5e3174293a33" exitCode=0
Jul 17 05:34:31.800291 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:31.800198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtrfw" event={"ID":"94049aed-9ae3-4b0d-a0ec-51db3526fb51","Type":"ContainerDied","Data":"c28e5456a609b6b24aed0be9e6f0f72c16bf918e244c89bf803a5e3174293a33"}
Jul 17 05:34:31.821481 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:31.821355    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hfz44" podStartSLOduration=33.706001101 podStartE2EDuration="45.821334689s" totalImagesPullingTime="12.115333588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:33:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:31.819952598 +0000 UTC m=+94.995353988" watchObservedRunningTime="2026-07-17 05:34:31.821334689 +0000 UTC m=+94.996736078"
Jul 17 05:34:32.805883 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:32.805841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtrfw" event={"ID":"94049aed-9ae3-4b0d-a0ec-51db3526fb51","Type":"ContainerStarted","Data":"78d3aaef2a0b7cbb78586a57f3009aacf8bfd40eabafaa63722c096823a371d9"}
Jul 17 05:34:32.806381 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:32.805916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtrfw" event={"ID":"94049aed-9ae3-4b0d-a0ec-51db3526fb51","Type":"ContainerStarted","Data":"d24e2a8a53f718757554f6cb9d4364b9b01937b7f76dab40505e2249605e479c"}
Jul 17 05:34:32.807989 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:32.807962    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z" event={"ID":"e0734f07-d4a1-4b18-ad79-7095148f7d53","Type":"ContainerStarted","Data":"1fb2bd883af801c7f69dd5a2500f99863dc86b4a662fb0dc5d583cb40a4cc5b3"}
Jul 17 05:34:32.808084 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:32.808013    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z" event={"ID":"e0734f07-d4a1-4b18-ad79-7095148f7d53","Type":"ContainerStarted","Data":"a0d771e1292a3b626c6931a383439b07abc2dbd5f2c2914c923ebd7912257df5"}
Jul 17 05:34:32.808084 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:32.808034    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z" event={"ID":"e0734f07-d4a1-4b18-ad79-7095148f7d53","Type":"ContainerStarted","Data":"40682b49ada1bcf7129be14ee9cda52cf0c2348a7d1ba65a8ed00c864ecdb810"}
Jul 17 05:34:32.830038 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:32.829966    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qtrfw" podStartSLOduration=2.224331105 podStartE2EDuration="4.82995025s" totalImagesPullingTime="2.522027957s" totalInitContainerRuntime="83.591188ms" isStatefulPod=true podCreationTimestamp="2026-07-17 05:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:32.829000671 +0000 UTC m=+96.004402059" watchObservedRunningTime="2026-07-17 05:34:32.82995025 +0000 UTC m=+96.005351637"
Jul 17 05:34:32.849998 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:32.849928    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-8ph7z" podStartSLOduration=3.558797307 podStartE2EDuration="4.849905885s" totalImagesPullingTime="1.291108578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:32.848889295 +0000 UTC m=+96.024290684" watchObservedRunningTime="2026-07-17 05:34:32.849905885 +0000 UTC m=+96.025307274"
Jul 17 05:34:40.701761 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:40.701720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cfqnr"
Jul 17 05:34:41.860902 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.860853    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d8fb5f69-qg8vd"]
Jul 17 05:34:41.902766 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.902732    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d8fb5f69-qg8vd"]
Jul 17 05:34:41.902952 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.902846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:41.905974 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.905951    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 05:34:41.906077 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.905951    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 05:34:41.907067 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.907045    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 05:34:41.907150 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.907127    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 05:34:41.907212 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.907175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 05:34:41.907212 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.907087    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 05:34:41.907356 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.907339    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 05:34:41.907498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:41.907483    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k5npd\""
Jul 17 05:34:42.015834 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.015793    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-config\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.016041 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.015846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-oauth-config\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.016041 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.015907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qpc2\" (UniqueName: \"kubernetes.io/projected/5dd9cba2-bcd9-4f55-910a-08db705c5522-kube-api-access-6qpc2\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.016041 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.015960    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-service-ca\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.016041 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.015998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-oauth-serving-cert\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.016191 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.016068    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-serving-cert\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.116922 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.116838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qpc2\" (UniqueName: \"kubernetes.io/projected/5dd9cba2-bcd9-4f55-910a-08db705c5522-kube-api-access-6qpc2\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.116922 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.116890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-service-ca\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.116922 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.116916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-oauth-serving-cert\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.117176 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.116977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-serving-cert\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.117176 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.117019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-config\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.117176 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.117054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-oauth-config\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.117666 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.117643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-oauth-serving-cert\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.117757 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.117653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-service-ca\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.117757 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.117735    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-config\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.119453 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.119432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-oauth-config\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.119512 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.119463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-serving-cert\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.127852 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.127826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qpc2\" (UniqueName: \"kubernetes.io/projected/5dd9cba2-bcd9-4f55-910a-08db705c5522-kube-api-access-6qpc2\") pod \"console-86d8fb5f69-qg8vd\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") " pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.212075 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.212039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:42.365926 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.365894    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d8fb5f69-qg8vd"]
Jul 17 05:34:42.369835 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:34:42.369806    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd9cba2_bcd9_4f55_910a_08db705c5522.slice/crio-b0d6788f58f861965507f42241ff43996a4ad1521d87e506e1cacc45efb058b2 WatchSource:0}: Error finding container b0d6788f58f861965507f42241ff43996a4ad1521d87e506e1cacc45efb058b2: Status 404 returned error can't find the container with id b0d6788f58f861965507f42241ff43996a4ad1521d87e506e1cacc45efb058b2
Jul 17 05:34:42.845039 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:42.844998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d8fb5f69-qg8vd" event={"ID":"5dd9cba2-bcd9-4f55-910a-08db705c5522","Type":"ContainerStarted","Data":"b0d6788f58f861965507f42241ff43996a4ad1521d87e506e1cacc45efb058b2"}
Jul 17 05:34:45.857123 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:45.857081    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d8fb5f69-qg8vd" event={"ID":"5dd9cba2-bcd9-4f55-910a-08db705c5522","Type":"ContainerStarted","Data":"0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac"}
Jul 17 05:34:45.873362 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:45.873306    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d8fb5f69-qg8vd" podStartSLOduration=1.9832528090000001 podStartE2EDuration="4.87329084s" totalImagesPullingTime="2.890038031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:45.872341796 +0000 UTC m=+109.047743196" watchObservedRunningTime="2026-07-17 05:34:45.87329084 +0000 UTC m=+109.048692229"
Jul 17 05:34:52.212547 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:52.212493    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:52.213059 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:52.212582    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:52.217450 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:52.217422    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:34:52.885606 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:34:52.885579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:35:01.730179 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:01.730148    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d8fb5f69-qg8vd"]
Jul 17 05:35:10.945645 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:10.945557    2559 generic.go:356] "Generic (PLEG): container finished" podID="970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc" containerID="2c821a61ae923a3c839087a1d0e6a0be368eb343bc2963c10fff307ca359126c" exitCode=0
Jul 17 05:35:10.945645 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:10.945633    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9" event={"ID":"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc","Type":"ContainerDied","Data":"2c821a61ae923a3c839087a1d0e6a0be368eb343bc2963c10fff307ca359126c"}
Jul 17 05:35:10.946047 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:10.945997    2559 scope.go:117] "RemoveContainer" containerID="2c821a61ae923a3c839087a1d0e6a0be368eb343bc2963c10fff307ca359126c"
Jul 17 05:35:11.953219 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:11.953181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9x7k9" event={"ID":"970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc","Type":"ContainerStarted","Data":"9c4e0bcf345736ed807d939e86354601fb27347f22671434c077dc7eaa532dfe"}
Jul 17 05:35:26.752574 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:26.752516    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d8fb5f69-qg8vd" podUID="5dd9cba2-bcd9-4f55-910a-08db705c5522" containerName="console" containerID="cri-o://0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac" gracePeriod=15
Jul 17 05:35:26.981486 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:26.981458    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:35:27.012186 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.012122    2559 generic.go:356] "Generic (PLEG): container finished" podID="5dd9cba2-bcd9-4f55-910a-08db705c5522" containerID="0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac" exitCode=0
Jul 17 05:35:27.012186 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.012174    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d8fb5f69-qg8vd"
Jul 17 05:35:27.012337 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.012204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d8fb5f69-qg8vd" event={"ID":"5dd9cba2-bcd9-4f55-910a-08db705c5522","Type":"ContainerDied","Data":"0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac"}
Jul 17 05:35:27.012337 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.012284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d8fb5f69-qg8vd" event={"ID":"5dd9cba2-bcd9-4f55-910a-08db705c5522","Type":"ContainerDied","Data":"b0d6788f58f861965507f42241ff43996a4ad1521d87e506e1cacc45efb058b2"}
Jul 17 05:35:27.012337 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.012314    2559 scope.go:117] "RemoveContainer" containerID="0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac"
Jul 17 05:35:27.020794 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.020777    2559 scope.go:117] "RemoveContainer" containerID="0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac"
Jul 17 05:35:27.021124 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:35:27.021098    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac\": container with ID starting with 0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac not found: ID does not exist" containerID="0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac"
Jul 17 05:35:27.021197 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.021142    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac"} err="failed to get container status \"0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac\": rpc error: code = NotFound desc = could not find container \"0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac\": container with ID starting with 0d4cbaced97a5b0346ad35d8a67ac3f2948dfe20c48af51002e0093be7d630ac not found: ID does not exist"
Jul 17 05:35:27.058264 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058237    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qpc2\" (UniqueName: \"kubernetes.io/projected/5dd9cba2-bcd9-4f55-910a-08db705c5522-kube-api-access-6qpc2\") pod \"5dd9cba2-bcd9-4f55-910a-08db705c5522\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") "
Jul 17 05:35:27.058416 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058286    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-service-ca\") pod \"5dd9cba2-bcd9-4f55-910a-08db705c5522\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") "
Jul 17 05:35:27.058416 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058316    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-serving-cert\") pod \"5dd9cba2-bcd9-4f55-910a-08db705c5522\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") "
Jul 17 05:35:27.058416 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-oauth-config\") pod \"5dd9cba2-bcd9-4f55-910a-08db705c5522\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") "
Jul 17 05:35:27.058570 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058468    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-config\") pod \"5dd9cba2-bcd9-4f55-910a-08db705c5522\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") "
Jul 17 05:35:27.058570 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058530    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-oauth-serving-cert\") pod \"5dd9cba2-bcd9-4f55-910a-08db705c5522\" (UID: \"5dd9cba2-bcd9-4f55-910a-08db705c5522\") "
Jul 17 05:35:27.058771 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058746    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-service-ca" (OuterVolumeSpecName: "service-ca") pod "5dd9cba2-bcd9-4f55-910a-08db705c5522" (UID: "5dd9cba2-bcd9-4f55-910a-08db705c5522"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:35:27.058975 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.058941    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-config" (OuterVolumeSpecName: "console-config") pod "5dd9cba2-bcd9-4f55-910a-08db705c5522" (UID: "5dd9cba2-bcd9-4f55-910a-08db705c5522"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:35:27.059062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.059007    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5dd9cba2-bcd9-4f55-910a-08db705c5522" (UID: "5dd9cba2-bcd9-4f55-910a-08db705c5522"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:35:27.060584 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.060553    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5dd9cba2-bcd9-4f55-910a-08db705c5522" (UID: "5dd9cba2-bcd9-4f55-910a-08db705c5522"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:27.060695 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.060622    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd9cba2-bcd9-4f55-910a-08db705c5522-kube-api-access-6qpc2" (OuterVolumeSpecName: "kube-api-access-6qpc2") pod "5dd9cba2-bcd9-4f55-910a-08db705c5522" (UID: "5dd9cba2-bcd9-4f55-910a-08db705c5522"). InnerVolumeSpecName "kube-api-access-6qpc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:35:27.060695 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.060626    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5dd9cba2-bcd9-4f55-910a-08db705c5522" (UID: "5dd9cba2-bcd9-4f55-910a-08db705c5522"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:35:27.159527 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.159494    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-config\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:35:27.159527 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.159521    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-oauth-serving-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:35:27.159527 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.159530    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qpc2\" (UniqueName: \"kubernetes.io/projected/5dd9cba2-bcd9-4f55-910a-08db705c5522-kube-api-access-6qpc2\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:35:27.159732 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.159540    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9cba2-bcd9-4f55-910a-08db705c5522-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:35:27.159732 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.159549    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-serving-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:35:27.159732 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.159557    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dd9cba2-bcd9-4f55-910a-08db705c5522-console-oauth-config\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:35:27.334089 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.334059    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d8fb5f69-qg8vd"]
Jul 17 05:35:27.337535 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:27.337512    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d8fb5f69-qg8vd"]
Jul 17 05:35:29.325018 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:35:29.324986    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd9cba2-bcd9-4f55-910a-08db705c5522" path="/var/lib/kubelet/pods/5dd9cba2-bcd9-4f55-910a-08db705c5522/volumes"
Jul 17 05:37:18.581510 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.581473    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2s4nq"]
Jul 17 05:37:18.582027 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.581711    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd9cba2-bcd9-4f55-910a-08db705c5522" containerName="console"
Jul 17 05:37:18.582027 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.581722    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd9cba2-bcd9-4f55-910a-08db705c5522" containerName="console"
Jul 17 05:37:18.582027 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.581777    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd9cba2-bcd9-4f55-910a-08db705c5522" containerName="console"
Jul 17 05:37:18.584501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.584484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:18.587134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.587117    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 05:37:18.587242 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.587117    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 05:37:18.588305 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.588287    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vgstm\""
Jul 17 05:37:18.592659 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.592625    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2s4nq"]
Jul 17 05:37:18.659307 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.659277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbspc\" (UniqueName: \"kubernetes.io/projected/fe033835-d299-4432-8927-ecaefe5aea9d-kube-api-access-vbspc\") pod \"cert-manager-webhook-6486ffd997-2s4nq\" (UID: \"fe033835-d299-4432-8927-ecaefe5aea9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:18.659452 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.659314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe033835-d299-4432-8927-ecaefe5aea9d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2s4nq\" (UID: \"fe033835-d299-4432-8927-ecaefe5aea9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:18.760017 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.759983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbspc\" (UniqueName: \"kubernetes.io/projected/fe033835-d299-4432-8927-ecaefe5aea9d-kube-api-access-vbspc\") pod \"cert-manager-webhook-6486ffd997-2s4nq\" (UID: \"fe033835-d299-4432-8927-ecaefe5aea9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:18.760175 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.760025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe033835-d299-4432-8927-ecaefe5aea9d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2s4nq\" (UID: \"fe033835-d299-4432-8927-ecaefe5aea9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:18.776992 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.776958    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbspc\" (UniqueName: \"kubernetes.io/projected/fe033835-d299-4432-8927-ecaefe5aea9d-kube-api-access-vbspc\") pod \"cert-manager-webhook-6486ffd997-2s4nq\" (UID: \"fe033835-d299-4432-8927-ecaefe5aea9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:18.777227 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.777207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe033835-d299-4432-8927-ecaefe5aea9d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2s4nq\" (UID: \"fe033835-d299-4432-8927-ecaefe5aea9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:18.894000 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:18.893900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:19.030111 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:19.030085    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2s4nq"]
Jul 17 05:37:19.032497 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:37:19.032465    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe033835_d299_4432_8927_ecaefe5aea9d.slice/crio-bca2ba48b5f9c67b9fd3cf1d7167a91bfdb9f827674665648183761a9a0b028d WatchSource:0}: Error finding container bca2ba48b5f9c67b9fd3cf1d7167a91bfdb9f827674665648183761a9a0b028d: Status 404 returned error can't find the container with id bca2ba48b5f9c67b9fd3cf1d7167a91bfdb9f827674665648183761a9a0b028d
Jul 17 05:37:19.392915 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:19.392858    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq" event={"ID":"fe033835-d299-4432-8927-ecaefe5aea9d","Type":"ContainerStarted","Data":"bca2ba48b5f9c67b9fd3cf1d7167a91bfdb9f827674665648183761a9a0b028d"}
Jul 17 05:37:22.407695 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:22.407656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq" event={"ID":"fe033835-d299-4432-8927-ecaefe5aea9d","Type":"ContainerStarted","Data":"9c121d72bfd47416658bf09ecda4025f1be707e4a4575c2dc97397d7f78212ef"}
Jul 17 05:37:22.408167 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:22.407788    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:22.423856 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:22.423814    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq" podStartSLOduration=1.474883815 podStartE2EDuration="4.423801654s" totalImagesPullingTime="2.948917839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:37:22.422673063 +0000 UTC m=+265.598074450" watchObservedRunningTime="2026-07-17 05:37:22.423801654 +0000 UTC m=+265.599203041"
Jul 17 05:37:28.413039 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:28.413005    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2s4nq"
Jul 17 05:37:51.033044 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.033013    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"]
Jul 17 05:37:51.036056 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.036038    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.038902 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.038857    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 05:37:51.039044 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.038946    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 05:37:51.039044 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.038859    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 05:37:51.039313 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.039297    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 05:37:51.039410 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.039391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jtkvf\""
Jul 17 05:37:51.054448 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.054424    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"]
Jul 17 05:37:51.100386 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.100360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97936e50-b1a3-49e6-a534-52a99c7cecfa-tmp\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.100522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.100397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghrm5\" (UniqueName: \"kubernetes.io/projected/97936e50-b1a3-49e6-a534-52a99c7cecfa-kube-api-access-ghrm5\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.100522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.100420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97936e50-b1a3-49e6-a534-52a99c7cecfa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.100522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.100452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97936e50-b1a3-49e6-a534-52a99c7cecfa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.100522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.100489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97936e50-b1a3-49e6-a534-52a99c7cecfa-manifests\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.201078 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.201046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97936e50-b1a3-49e6-a534-52a99c7cecfa-tmp\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.201226 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.201086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghrm5\" (UniqueName: \"kubernetes.io/projected/97936e50-b1a3-49e6-a534-52a99c7cecfa-kube-api-access-ghrm5\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.201226 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.201119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97936e50-b1a3-49e6-a534-52a99c7cecfa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.201226 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.201165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97936e50-b1a3-49e6-a534-52a99c7cecfa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.201226 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.201192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97936e50-b1a3-49e6-a534-52a99c7cecfa-manifests\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.201569 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.201546    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97936e50-b1a3-49e6-a534-52a99c7cecfa-manifests\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.203333 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.203302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97936e50-b1a3-49e6-a534-52a99c7cecfa-tmp\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.203694 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.203670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97936e50-b1a3-49e6-a534-52a99c7cecfa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.203759 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.203697    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97936e50-b1a3-49e6-a534-52a99c7cecfa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.209212 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.209190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghrm5\" (UniqueName: \"kubernetes.io/projected/97936e50-b1a3-49e6-a534-52a99c7cecfa-kube-api-access-ghrm5\") pod \"opendatahub-operator-controller-manager-6d4d7869b5-rn4bn\" (UID: \"97936e50-b1a3-49e6-a534-52a99c7cecfa\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.346288 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.346245    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:51.479010 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.478975    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"]
Jul 17 05:37:51.482836 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:37:51.482812    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97936e50_b1a3_49e6_a534_52a99c7cecfa.slice/crio-5173317ad3cc40736de39334662042537d2780460c094d2998b0f08637046c06 WatchSource:0}: Error finding container 5173317ad3cc40736de39334662042537d2780460c094d2998b0f08637046c06: Status 404 returned error can't find the container with id 5173317ad3cc40736de39334662042537d2780460c094d2998b0f08637046c06
Jul 17 05:37:51.504561 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:51.504533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn" event={"ID":"97936e50-b1a3-49e6-a534-52a99c7cecfa","Type":"ContainerStarted","Data":"5173317ad3cc40736de39334662042537d2780460c094d2998b0f08637046c06"}
Jul 17 05:37:55.521893 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:55.521835    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn" event={"ID":"97936e50-b1a3-49e6-a534-52a99c7cecfa","Type":"ContainerStarted","Data":"01588759cf623e381cf4a40c0da1a2551dc38efc66fa90dea0c175728cb69851"}
Jul 17 05:37:56.528055 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:56.528017    2559 generic.go:356] "Generic (PLEG): container finished" podID="97936e50-b1a3-49e6-a534-52a99c7cecfa" containerID="01588759cf623e381cf4a40c0da1a2551dc38efc66fa90dea0c175728cb69851" exitCode=0
Jul 17 05:37:56.528483 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:56.528069    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn" event={"ID":"97936e50-b1a3-49e6-a534-52a99c7cecfa","Type":"ContainerDied","Data":"01588759cf623e381cf4a40c0da1a2551dc38efc66fa90dea0c175728cb69851"}
Jul 17 05:37:57.225975 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:57.225954    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:37:57.230937 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:57.230916    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:37:57.238076 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:57.238005    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 05:37:57.533066 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:57.532981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn" event={"ID":"97936e50-b1a3-49e6-a534-52a99c7cecfa","Type":"ContainerStarted","Data":"0451730b84abf1a2ada939db3bf4e83ebe52fa3322fd0225ee5c9fd7ee75da44"}
Jul 17 05:37:57.535561 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:57.533107    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:37:57.558814 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:37:57.555784    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn" podStartSLOduration=1.783483913 podStartE2EDuration="6.555763524s" totalImagesPullingTime="3.682783995s" totalInitContainerRuntime="1.089495616s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:37:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:37:57.554487262 +0000 UTC m=+300.729888663" watchObservedRunningTime="2026-07-17 05:37:57.555763524 +0000 UTC m=+300.731164913"
Jul 17 05:38:08.539103 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:08.539072    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d7869b5-rn4bn"
Jul 17 05:38:10.900878 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:10.900827    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6m5pc"]
Jul 17 05:38:10.908813 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:10.908785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:10.911417 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:10.911394    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-x48bd\""
Jul 17 05:38:10.911545 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:10.911432    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 05:38:10.916260 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:10.916237    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6m5pc"]
Jul 17 05:38:11.063909 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.063848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83df0755-9289-48d7-9b50-ab2b63b6dc95-cert\") pod \"odh-model-controller-7998c67dc4-6m5pc\" (UID: \"83df0755-9289-48d7-9b50-ab2b63b6dc95\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:11.064101 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.064013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjhq\" (UniqueName: \"kubernetes.io/projected/83df0755-9289-48d7-9b50-ab2b63b6dc95-kube-api-access-hhjhq\") pod \"odh-model-controller-7998c67dc4-6m5pc\" (UID: \"83df0755-9289-48d7-9b50-ab2b63b6dc95\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:11.164898 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.164809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjhq\" (UniqueName: \"kubernetes.io/projected/83df0755-9289-48d7-9b50-ab2b63b6dc95-kube-api-access-hhjhq\") pod \"odh-model-controller-7998c67dc4-6m5pc\" (UID: \"83df0755-9289-48d7-9b50-ab2b63b6dc95\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:11.164898 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.164851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83df0755-9289-48d7-9b50-ab2b63b6dc95-cert\") pod \"odh-model-controller-7998c67dc4-6m5pc\" (UID: \"83df0755-9289-48d7-9b50-ab2b63b6dc95\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:11.167394 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.167366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83df0755-9289-48d7-9b50-ab2b63b6dc95-cert\") pod \"odh-model-controller-7998c67dc4-6m5pc\" (UID: \"83df0755-9289-48d7-9b50-ab2b63b6dc95\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:11.175991 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.175967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjhq\" (UniqueName: \"kubernetes.io/projected/83df0755-9289-48d7-9b50-ab2b63b6dc95-kube-api-access-hhjhq\") pod \"odh-model-controller-7998c67dc4-6m5pc\" (UID: \"83df0755-9289-48d7-9b50-ab2b63b6dc95\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:11.220068 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.220035    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:11.357155 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.357131    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6m5pc"]
Jul 17 05:38:11.359656 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:38:11.359626    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83df0755_9289_48d7_9b50_ab2b63b6dc95.slice/crio-d5562f1ed40ff186d2e176dc7ce6eed91586b4da06a40f3445c461cc4e83c09e WatchSource:0}: Error finding container d5562f1ed40ff186d2e176dc7ce6eed91586b4da06a40f3445c461cc4e83c09e: Status 404 returned error can't find the container with id d5562f1ed40ff186d2e176dc7ce6eed91586b4da06a40f3445c461cc4e83c09e
Jul 17 05:38:11.360924 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.360906    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:38:11.440594 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.440520    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4l7br"]
Jul 17 05:38:11.445133 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.445113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:11.447581 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.447562    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 05:38:11.447677 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.447637    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-66rkb\""
Jul 17 05:38:11.455656 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.455632    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4l7br"]
Jul 17 05:38:11.568474 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.568420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6sz4\" (UniqueName: \"kubernetes.io/projected/5958dbc5-f465-416c-b096-868621218b09-kube-api-access-n6sz4\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:11.568670 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.568612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:11.588183 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.588142    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc" event={"ID":"83df0755-9289-48d7-9b50-ab2b63b6dc95","Type":"ContainerStarted","Data":"d5562f1ed40ff186d2e176dc7ce6eed91586b4da06a40f3445c461cc4e83c09e"}
Jul 17 05:38:11.669828 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.669793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:11.670006 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.669840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6sz4\" (UniqueName: \"kubernetes.io/projected/5958dbc5-f465-416c-b096-868621218b09-kube-api-access-n6sz4\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:11.670006 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:11.669970    2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 05:38:11.670095 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:11.670047    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs podName:5958dbc5-f465-416c-b096-868621218b09 nodeName:}" failed. No retries permitted until 2026-07-17 05:38:12.170023824 +0000 UTC m=+315.345425193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs") pod "model-serving-api-54d89bd5fc-4l7br" (UID: "5958dbc5-f465-416c-b096-868621218b09") : secret "model-serving-api-tls" not found
Jul 17 05:38:11.680855 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.680832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6sz4\" (UniqueName: \"kubernetes.io/projected/5958dbc5-f465-416c-b096-868621218b09-kube-api-access-n6sz4\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:11.711171 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.711082    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86f645db4-6d879"]
Jul 17 05:38:11.714665 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.714644    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.721063 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.721032    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-48wpn\""
Jul 17 05:38:11.722217 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.722090    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 05:38:11.722217 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.722103    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 05:38:11.728008 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.727982    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86f645db4-6d879"]
Jul 17 05:38:11.871787 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.871746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-tls-certs\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.871984 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.871847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-tmp\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.871984 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.871903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgbgg\" (UniqueName: \"kubernetes.io/projected/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-kube-api-access-jgbgg\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.972723 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.972637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-tls-certs\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.973180 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.972722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-tmp\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.973180 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.972752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbgg\" (UniqueName: \"kubernetes.io/projected/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-kube-api-access-jgbgg\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.975854 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.975820    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-tmp\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.976040 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.976017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-tls-certs\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:11.984318 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:11.984286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgbgg\" (UniqueName: \"kubernetes.io/projected/5bed2dfe-2036-4c3f-9abd-cd701858d6ae-kube-api-access-jgbgg\") pod \"kube-auth-proxy-86f645db4-6d879\" (UID: \"5bed2dfe-2036-4c3f-9abd-cd701858d6ae\") " pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:12.027244 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.027205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879"
Jul 17 05:38:12.173949 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.173910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:12.174189 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:12.174162    2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 05:38:12.174279 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:12.174256    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs podName:5958dbc5-f465-416c-b096-868621218b09 nodeName:}" failed. No retries permitted until 2026-07-17 05:38:13.17423176 +0000 UTC m=+316.349633146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs") pod "model-serving-api-54d89bd5fc-4l7br" (UID: "5958dbc5-f465-416c-b096-868621218b09") : secret "model-serving-api-tls" not found
Jul 17 05:38:12.214275 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.214237    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86f645db4-6d879"]
Jul 17 05:38:12.216859 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:38:12.216822    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bed2dfe_2036_4c3f_9abd_cd701858d6ae.slice/crio-b4ba19d7c60a5e9c2a6ef88078b81f68aae3acd6f360152cb03a2e4bec37f23e WatchSource:0}: Error finding container b4ba19d7c60a5e9c2a6ef88078b81f68aae3acd6f360152cb03a2e4bec37f23e: Status 404 returned error can't find the container with id b4ba19d7c60a5e9c2a6ef88078b81f68aae3acd6f360152cb03a2e4bec37f23e
Jul 17 05:38:12.594833 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.594789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879" event={"ID":"5bed2dfe-2036-4c3f-9abd-cd701858d6ae","Type":"ContainerStarted","Data":"b4ba19d7c60a5e9c2a6ef88078b81f68aae3acd6f360152cb03a2e4bec37f23e"}
Jul 17 05:38:12.726436 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.726406    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"]
Jul 17 05:38:12.731021 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.730996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.733941 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.733917    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 05:38:12.733941 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.733929    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 05:38:12.734191 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.734170    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6d4db\""
Jul 17 05:38:12.734322 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.734239    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 05:38:12.734322 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.734282    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 05:38:12.741261 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.741242    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"]
Jul 17 05:38:12.881522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.881432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/499f2bf1-eb99-435e-822b-61dfbae6d47c-local-certs\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.881522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.881477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vhg\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-kube-api-access-z8vhg\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.881522 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.881515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-cacerts\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.881780 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.881611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.881780 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.881660    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-token\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.881904 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.881773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.881904 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.881832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.983161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.983161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/499f2bf1-eb99-435e-822b-61dfbae6d47c-local-certs\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.983161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vhg\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-kube-api-access-z8vhg\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.983161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-cacerts\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.983161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.983830 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-token\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.983830 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.984045 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.983885    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.985764 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.985740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/499f2bf1-eb99-435e-822b-61dfbae6d47c-local-certs\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.986128 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.986107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.986255 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.986235    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-cacerts\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.986793 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.986767    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.991157 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.991114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-token\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:12.991548 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:12.991523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vhg\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-kube-api-access-z8vhg\") pod \"istiod-openshift-gateway-7574459656-msmb4\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:13.044422 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:13.044385    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:13.184920 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:13.184827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:13.187374 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:13.187344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5958dbc5-f465-416c-b096-868621218b09-tls-certs\") pod \"model-serving-api-54d89bd5fc-4l7br\" (UID: \"5958dbc5-f465-416c-b096-868621218b09\") " pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:13.256502 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:13.256463    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:14.363911 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:14.363863    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"]
Jul 17 05:38:14.367332 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:38:14.367303    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499f2bf1_eb99_435e_822b_61dfbae6d47c.slice/crio-e3ad2a9434ed51e12c2a816151a083b021c79cfa469261a6dd4f68d4f035ceb3 WatchSource:0}: Error finding container e3ad2a9434ed51e12c2a816151a083b021c79cfa469261a6dd4f68d4f035ceb3: Status 404 returned error can't find the container with id e3ad2a9434ed51e12c2a816151a083b021c79cfa469261a6dd4f68d4f035ceb3
Jul 17 05:38:14.374494 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:14.374418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4l7br"]
Jul 17 05:38:14.378325 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:38:14.378299    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5958dbc5_f465_416c_b096_868621218b09.slice/crio-16f00feb52b6ae3c9c92b44afa89c51d13236353f85ab59f797e00665fee0862 WatchSource:0}: Error finding container 16f00feb52b6ae3c9c92b44afa89c51d13236353f85ab59f797e00665fee0862: Status 404 returned error can't find the container with id 16f00feb52b6ae3c9c92b44afa89c51d13236353f85ab59f797e00665fee0862
Jul 17 05:38:14.614667 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:14.614630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc" event={"ID":"83df0755-9289-48d7-9b50-ab2b63b6dc95","Type":"ContainerStarted","Data":"ce87ed731367169d9230ec853f97f0df1ebdc60f3c62393b72deda7d8e1d6888"}
Jul 17 05:38:14.614994 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:14.614967    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:14.616368 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:14.616341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4" event={"ID":"499f2bf1-eb99-435e-822b-61dfbae6d47c","Type":"ContainerStarted","Data":"e3ad2a9434ed51e12c2a816151a083b021c79cfa469261a6dd4f68d4f035ceb3"}
Jul 17 05:38:14.618849 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:14.618820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4l7br" event={"ID":"5958dbc5-f465-416c-b096-868621218b09","Type":"ContainerStarted","Data":"16f00feb52b6ae3c9c92b44afa89c51d13236353f85ab59f797e00665fee0862"}
Jul 17 05:38:14.632763 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:14.631477    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc" podStartSLOduration=1.715033267 podStartE2EDuration="4.631458528s" totalImagesPullingTime="2.916425261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:14.630734586 +0000 UTC m=+317.806135975" watchObservedRunningTime="2026-07-17 05:38:14.631458528 +0000 UTC m=+317.806859918"
Jul 17 05:38:17.568514 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:17.568479    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:38:17.568865 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:17.568547    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:38:18.641445 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.641400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879" event={"ID":"5bed2dfe-2036-4c3f-9abd-cd701858d6ae","Type":"ContainerStarted","Data":"2a63bdc6c2d7e35e8a833a2da6e67cfbca23c54a81ae0af7196def776d948b8d"}
Jul 17 05:38:18.643060 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.643031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4" event={"ID":"499f2bf1-eb99-435e-822b-61dfbae6d47c","Type":"ContainerStarted","Data":"04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49"}
Jul 17 05:38:18.643208 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.643186    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:18.644998 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.644924    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4l7br" event={"ID":"5958dbc5-f465-416c-b096-868621218b09","Type":"ContainerStarted","Data":"b7cc02df4b77db0e73a7940a280976d7cd10dded83621e388d46b1aebbb479d0"}
Jul 17 05:38:18.644998 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.644957    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-msmb4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 05:38:18.645181 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.645008    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4" podUID="499f2bf1-eb99-435e-822b-61dfbae6d47c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 05:38:18.645236 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.645174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:18.662243 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.662189    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86f645db4-6d879" podStartSLOduration=2.3195178739999998 podStartE2EDuration="7.662173017s" totalImagesPullingTime="5.342655143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:18.661060685 +0000 UTC m=+321.836462077" watchObservedRunningTime="2026-07-17 05:38:18.662173017 +0000 UTC m=+321.837574443"
Jul 17 05:38:18.682455 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.682392    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4" podStartSLOduration=3.484369679 podStartE2EDuration="6.6823707s" totalImagesPullingTime="3.198001021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:18.681475756 +0000 UTC m=+321.856877145" watchObservedRunningTime="2026-07-17 05:38:18.6823707 +0000 UTC m=+321.857772090"
Jul 17 05:38:18.705488 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:18.705427    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4l7br" podStartSLOduration=4.523272279 podStartE2EDuration="7.705405932s" totalImagesPullingTime="3.182133653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:18.705152921 +0000 UTC m=+321.880554310" watchObservedRunningTime="2026-07-17 05:38:18.705405932 +0000 UTC m=+321.880807321"
Jul 17 05:38:19.021475 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.021388    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"]
Jul 17 05:38:19.024596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.024570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.027225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.027196    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rzzxm\""
Jul 17 05:38:19.035658 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.035632    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"]
Jul 17 05:38:19.137721 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/270b2f72-a236-42e5-9c9b-2cb58d952317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.137880 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.137880 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.137880 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.137880 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.138042 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlv78\" (UniqueName: \"kubernetes.io/projected/270b2f72-a236-42e5-9c9b-2cb58d952317-kube-api-access-jlv78\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.138042 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.138042 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.137990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.138042 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.138022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.238900 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.238845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.238900 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.238898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.238934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/270b2f72-a236-42e5-9c9b-2cb58d952317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.238953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.238969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlv78\" (UniqueName: \"kubernetes.io/projected/270b2f72-a236-42e5-9c9b-2cb58d952317-kube-api-access-jlv78\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239531 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239531 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239484    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239762 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239741    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.239835 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.239793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/270b2f72-a236-42e5-9c9b-2cb58d952317-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.241224 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.241199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.241467 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.241449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.249767 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.249740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlv78\" (UniqueName: \"kubernetes.io/projected/270b2f72-a236-42e5-9c9b-2cb58d952317-kube-api-access-jlv78\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.249916 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.249827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/270b2f72-a236-42e5-9c9b-2cb58d952317-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n69bx\" (UID: \"270b2f72-a236-42e5-9c9b-2cb58d952317\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.335044 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.335009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:19.465215 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.465005    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"]
Jul 17 05:38:19.467554 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:38:19.467527    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270b2f72_a236_42e5_9c9b_2cb58d952317.slice/crio-8e50c87820b9e5f730b402fe591f285301a94ea8c047888ee6def7dfe5cdc27e WatchSource:0}: Error finding container 8e50c87820b9e5f730b402fe591f285301a94ea8c047888ee6def7dfe5cdc27e: Status 404 returned error can't find the container with id 8e50c87820b9e5f730b402fe591f285301a94ea8c047888ee6def7dfe5cdc27e
Jul 17 05:38:19.651028 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.650942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx" event={"ID":"270b2f72-a236-42e5-9c9b-2cb58d952317","Type":"ContainerStarted","Data":"8e50c87820b9e5f730b402fe591f285301a94ea8c047888ee6def7dfe5cdc27e"}
Jul 17 05:38:19.651690 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:19.651665    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:21.139572 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.139534    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"]
Jul 17 05:38:21.145152 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.145129    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.148023 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.147824    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-z9g2d\""
Jul 17 05:38:21.148153 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.148029    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 05:38:21.152596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.152574    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"]
Jul 17 05:38:21.155914 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.155835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rcc8\" (UniqueName: \"kubernetes.io/projected/45813893-dd1c-42a4-a350-ffb044f3d45f-kube-api-access-8rcc8\") pod \"kserve-controller-manager-d6f4b65b8-84ttf\" (UID: \"45813893-dd1c-42a4-a350-ffb044f3d45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.156023 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.155913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45813893-dd1c-42a4-a350-ffb044f3d45f-cert\") pod \"kserve-controller-manager-d6f4b65b8-84ttf\" (UID: \"45813893-dd1c-42a4-a350-ffb044f3d45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.157167 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.157134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:21.157735 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.157715    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"]
Jul 17 05:38:21.161083 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.161048    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 05:38:21.161177 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.161050    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-p9wvh\""
Jul 17 05:38:21.168039 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.168017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"]
Jul 17 05:38:21.258905 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.258226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45813893-dd1c-42a4-a350-ffb044f3d45f-cert\") pod \"kserve-controller-manager-d6f4b65b8-84ttf\" (UID: \"45813893-dd1c-42a4-a350-ffb044f3d45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.258905 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.258293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9239ed6b-953f-445b-9e10-f77d6dc73be8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9t6sb\" (UID: \"9239ed6b-953f-445b-9e10-f77d6dc73be8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:21.258905 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.258378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxtxq\" (UniqueName: \"kubernetes.io/projected/9239ed6b-953f-445b-9e10-f77d6dc73be8-kube-api-access-qxtxq\") pod \"llmisvc-controller-manager-777c6bd7d5-9t6sb\" (UID: \"9239ed6b-953f-445b-9e10-f77d6dc73be8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:21.258905 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.258427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rcc8\" (UniqueName: \"kubernetes.io/projected/45813893-dd1c-42a4-a350-ffb044f3d45f-kube-api-access-8rcc8\") pod \"kserve-controller-manager-d6f4b65b8-84ttf\" (UID: \"45813893-dd1c-42a4-a350-ffb044f3d45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.259414 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:21.259261    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 17 05:38:21.259414 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:21.259344    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45813893-dd1c-42a4-a350-ffb044f3d45f-cert podName:45813893-dd1c-42a4-a350-ffb044f3d45f nodeName:}" failed. No retries permitted until 2026-07-17 05:38:21.759323061 +0000 UTC m=+324.934724434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45813893-dd1c-42a4-a350-ffb044f3d45f-cert") pod "kserve-controller-manager-d6f4b65b8-84ttf" (UID: "45813893-dd1c-42a4-a350-ffb044f3d45f") : secret "kserve-webhook-server-cert" not found
Jul 17 05:38:21.269296 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.269263    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rcc8\" (UniqueName: \"kubernetes.io/projected/45813893-dd1c-42a4-a350-ffb044f3d45f-kube-api-access-8rcc8\") pod \"kserve-controller-manager-d6f4b65b8-84ttf\" (UID: \"45813893-dd1c-42a4-a350-ffb044f3d45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.359303 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.359261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9239ed6b-953f-445b-9e10-f77d6dc73be8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9t6sb\" (UID: \"9239ed6b-953f-445b-9e10-f77d6dc73be8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:21.359476 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.359351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxtxq\" (UniqueName: \"kubernetes.io/projected/9239ed6b-953f-445b-9e10-f77d6dc73be8-kube-api-access-qxtxq\") pod \"llmisvc-controller-manager-777c6bd7d5-9t6sb\" (UID: \"9239ed6b-953f-445b-9e10-f77d6dc73be8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:21.359538 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:21.359478    2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 17 05:38:21.359591 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:21.359554    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9239ed6b-953f-445b-9e10-f77d6dc73be8-cert podName:9239ed6b-953f-445b-9e10-f77d6dc73be8 nodeName:}" failed. No retries permitted until 2026-07-17 05:38:21.859532304 +0000 UTC m=+325.034933675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9239ed6b-953f-445b-9e10-f77d6dc73be8-cert") pod "llmisvc-controller-manager-777c6bd7d5-9t6sb" (UID: "9239ed6b-953f-445b-9e10-f77d6dc73be8") : secret "llmisvc-webhook-server-cert" not found
Jul 17 05:38:21.373135 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.373104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxtxq\" (UniqueName: \"kubernetes.io/projected/9239ed6b-953f-445b-9e10-f77d6dc73be8-kube-api-access-qxtxq\") pod \"llmisvc-controller-manager-777c6bd7d5-9t6sb\" (UID: \"9239ed6b-953f-445b-9e10-f77d6dc73be8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:21.764220 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.764171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45813893-dd1c-42a4-a350-ffb044f3d45f-cert\") pod \"kserve-controller-manager-d6f4b65b8-84ttf\" (UID: \"45813893-dd1c-42a4-a350-ffb044f3d45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.766828 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.766802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45813893-dd1c-42a4-a350-ffb044f3d45f-cert\") pod \"kserve-controller-manager-d6f4b65b8-84ttf\" (UID: \"45813893-dd1c-42a4-a350-ffb044f3d45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:21.865249 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.865208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9239ed6b-953f-445b-9e10-f77d6dc73be8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9t6sb\" (UID: \"9239ed6b-953f-445b-9e10-f77d6dc73be8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:21.868284 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:21.868245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9239ed6b-953f-445b-9e10-f77d6dc73be8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9t6sb\" (UID: \"9239ed6b-953f-445b-9e10-f77d6dc73be8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:22.061268 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.061227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:22.076256 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.076230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:22.201793 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.201753    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:38:22.202200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.201842    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:38:22.202200 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.201906    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:38:22.281720 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.281696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"]
Jul 17 05:38:22.283242 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:38:22.283217    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45813893_dd1c_42a4_a350_ffb044f3d45f.slice/crio-5c65482ca6cb2cacfa53925d1a49963ad46700e301a168104c3bab2aebe04751 WatchSource:0}: Error finding container 5c65482ca6cb2cacfa53925d1a49963ad46700e301a168104c3bab2aebe04751: Status 404 returned error can't find the container with id 5c65482ca6cb2cacfa53925d1a49963ad46700e301a168104c3bab2aebe04751
Jul 17 05:38:22.294446 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.294418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"]
Jul 17 05:38:22.298120 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:38:22.298091    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9239ed6b_953f_445b_9e10_f77d6dc73be8.slice/crio-4fa4498ffac8634a7bc23a28165d74f42ecca9154204d12b6aa90f5eedb5d6d4 WatchSource:0}: Error finding container 4fa4498ffac8634a7bc23a28165d74f42ecca9154204d12b6aa90f5eedb5d6d4: Status 404 returned error can't find the container with id 4fa4498ffac8634a7bc23a28165d74f42ecca9154204d12b6aa90f5eedb5d6d4
Jul 17 05:38:22.666334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.666297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb" event={"ID":"9239ed6b-953f-445b-9e10-f77d6dc73be8","Type":"ContainerStarted","Data":"4fa4498ffac8634a7bc23a28165d74f42ecca9154204d12b6aa90f5eedb5d6d4"}
Jul 17 05:38:22.667638 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.667606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf" event={"ID":"45813893-dd1c-42a4-a350-ffb044f3d45f","Type":"ContainerStarted","Data":"5c65482ca6cb2cacfa53925d1a49963ad46700e301a168104c3bab2aebe04751"}
Jul 17 05:38:22.669168 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.669146    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx" event={"ID":"270b2f72-a236-42e5-9c9b-2cb58d952317","Type":"ContainerStarted","Data":"e4110a90f993b418b1bee2c3c50b7c78662087bfa09efd0ece19ac3c772214d9"}
Jul 17 05:38:22.702121 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.702091    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"]
Jul 17 05:38:22.702358 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.702336    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4" podUID="499f2bf1-eb99-435e-822b-61dfbae6d47c" containerName="discovery" containerID="cri-o://04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49" gracePeriod=30
Jul 17 05:38:22.717032 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.716956    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx" podStartSLOduration=1.985050693 podStartE2EDuration="4.716942731s" totalImagesPullingTime="2.731892038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:22.716834447 +0000 UTC m=+325.892235835" watchObservedRunningTime="2026-07-17 05:38:22.716942731 +0000 UTC m=+325.892344119"
Jul 17 05:38:22.940511 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.940483    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:22.974193 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-kubeconfig\") pod \"499f2bf1-eb99-435e-822b-61dfbae6d47c\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") "
Jul 17 05:38:22.974379 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974212    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-ca-configmap\") pod \"499f2bf1-eb99-435e-822b-61dfbae6d47c\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") "
Jul 17 05:38:22.974379 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974250    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8vhg\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-kube-api-access-z8vhg\") pod \"499f2bf1-eb99-435e-822b-61dfbae6d47c\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") "
Jul 17 05:38:22.974379 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-cacerts\") pod \"499f2bf1-eb99-435e-822b-61dfbae6d47c\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") "
Jul 17 05:38:22.974552 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974389    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/499f2bf1-eb99-435e-822b-61dfbae6d47c-local-certs\") pod \"499f2bf1-eb99-435e-822b-61dfbae6d47c\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") "
Jul 17 05:38:22.974552 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974419    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-dns-cert\") pod \"499f2bf1-eb99-435e-822b-61dfbae6d47c\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") "
Jul 17 05:38:22.974552 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-token\") pod \"499f2bf1-eb99-435e-822b-61dfbae6d47c\" (UID: \"499f2bf1-eb99-435e-822b-61dfbae6d47c\") "
Jul 17 05:38:22.975155 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.974857    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "499f2bf1-eb99-435e-822b-61dfbae6d47c" (UID: "499f2bf1-eb99-435e-822b-61dfbae6d47c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:38:22.977355 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.977317    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "499f2bf1-eb99-435e-822b-61dfbae6d47c" (UID: "499f2bf1-eb99-435e-822b-61dfbae6d47c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:38:22.977612 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.977583    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-kube-api-access-z8vhg" (OuterVolumeSpecName: "kube-api-access-z8vhg") pod "499f2bf1-eb99-435e-822b-61dfbae6d47c" (UID: "499f2bf1-eb99-435e-822b-61dfbae6d47c"). InnerVolumeSpecName "kube-api-access-z8vhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:38:22.977727 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.977657    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-token" (OuterVolumeSpecName: "istio-token") pod "499f2bf1-eb99-435e-822b-61dfbae6d47c" (UID: "499f2bf1-eb99-435e-822b-61dfbae6d47c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:38:22.977898 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.977860    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "499f2bf1-eb99-435e-822b-61dfbae6d47c" (UID: "499f2bf1-eb99-435e-822b-61dfbae6d47c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:38:22.978185 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.978168    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/499f2bf1-eb99-435e-822b-61dfbae6d47c-local-certs" (OuterVolumeSpecName: "local-certs") pod "499f2bf1-eb99-435e-822b-61dfbae6d47c" (UID: "499f2bf1-eb99-435e-822b-61dfbae6d47c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:38:22.979062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:22.979043    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-cacerts" (OuterVolumeSpecName: "cacerts") pod "499f2bf1-eb99-435e-822b-61dfbae6d47c" (UID: "499f2bf1-eb99-435e-822b-61dfbae6d47c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:38:23.075475 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.075442    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-cacerts\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:38:23.075475 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.075474    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/499f2bf1-eb99-435e-822b-61dfbae6d47c-local-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:38:23.075649 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.075485    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-dns-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:38:23.075649 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.075497    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:38:23.075649 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.075507    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-kubeconfig\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:38:23.075649 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.075515    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/499f2bf1-eb99-435e-822b-61dfbae6d47c-istio-csr-ca-configmap\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:38:23.075649 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.075523    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8vhg\" (UniqueName: \"kubernetes.io/projected/499f2bf1-eb99-435e-822b-61dfbae6d47c-kube-api-access-z8vhg\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:38:23.336167 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.336141    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:23.340638 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.340616    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:23.679814 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.679145    2559 generic.go:356] "Generic (PLEG): container finished" podID="499f2bf1-eb99-435e-822b-61dfbae6d47c" containerID="04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49" exitCode=0
Jul 17 05:38:23.679814 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.679224    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"
Jul 17 05:38:23.679814 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.679311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4" event={"ID":"499f2bf1-eb99-435e-822b-61dfbae6d47c","Type":"ContainerDied","Data":"04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49"}
Jul 17 05:38:23.679814 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.679358    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-msmb4" event={"ID":"499f2bf1-eb99-435e-822b-61dfbae6d47c","Type":"ContainerDied","Data":"e3ad2a9434ed51e12c2a816151a083b021c79cfa469261a6dd4f68d4f035ceb3"}
Jul 17 05:38:23.679814 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.679384    2559 scope.go:117] "RemoveContainer" containerID="04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49"
Jul 17 05:38:23.680227 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.680205    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:23.681666 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.681623    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n69bx"
Jul 17 05:38:23.713834 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.713796    2559 scope.go:117] "RemoveContainer" containerID="04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49"
Jul 17 05:38:23.714280 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:38:23.714215    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49\": container with ID starting with 04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49 not found: ID does not exist" containerID="04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49"
Jul 17 05:38:23.714280 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.714254    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49"} err="failed to get container status \"04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49\": rpc error: code = NotFound desc = could not find container \"04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49\": container with ID starting with 04420cebd69ddf6ac26a549f3fb64f12e835423811f9cb3b5b29fdd8be79be49 not found: ID does not exist"
Jul 17 05:38:23.737158 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.736857    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"]
Jul 17 05:38:23.739111 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:23.739088    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-msmb4"]
Jul 17 05:38:25.324465 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:25.324426    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="499f2bf1-eb99-435e-822b-61dfbae6d47c" path="/var/lib/kubelet/pods/499f2bf1-eb99-435e-822b-61dfbae6d47c/volumes"
Jul 17 05:38:25.628300 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:25.628190    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6m5pc"
Jul 17 05:38:26.695383 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:26.695350    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb" event={"ID":"9239ed6b-953f-445b-9e10-f77d6dc73be8","Type":"ContainerStarted","Data":"fbeffadee79dcbba2d342d10a3e62b3a2dc6056d4b056815938e767c31eeff1a"}
Jul 17 05:38:26.695861 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:26.695437    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:26.696965 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:26.696933    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf" event={"ID":"45813893-dd1c-42a4-a350-ffb044f3d45f","Type":"ContainerStarted","Data":"d5bb3f626a816cf4357fc1ba74d4134bca05d69d0096bdd84ccedb65616df238"}
Jul 17 05:38:26.697078 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:26.697065    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:38:26.714782 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:26.714733    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb" podStartSLOduration=2.217258954 podStartE2EDuration="5.714717534s" totalImagesPullingTime="3.49745858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:26.712399497 +0000 UTC m=+329.887800921" watchObservedRunningTime="2026-07-17 05:38:26.714717534 +0000 UTC m=+329.890118921"
Jul 17 05:38:26.737081 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:26.737035    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf" podStartSLOduration=2.228820597 podStartE2EDuration="5.737021426s" totalImagesPullingTime="3.508200829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:38:26.735207024 +0000 UTC m=+329.910608422" watchObservedRunningTime="2026-07-17 05:38:26.737021426 +0000 UTC m=+329.912422813"
Jul 17 05:38:29.655300 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:29.655274    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4l7br"
Jul 17 05:38:57.703778 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:57.703741    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9t6sb"
Jul 17 05:38:57.706807 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:38:57.706789    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84ttf"
Jul 17 05:39:12.200666 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.200626    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncsmq"]
Jul 17 05:39:12.201161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.201093    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="499f2bf1-eb99-435e-822b-61dfbae6d47c" containerName="discovery"
Jul 17 05:39:12.201161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.201114    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="499f2bf1-eb99-435e-822b-61dfbae6d47c" containerName="discovery"
Jul 17 05:39:12.201272 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.201203    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="499f2bf1-eb99-435e-822b-61dfbae6d47c" containerName="discovery"
Jul 17 05:39:12.211905 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.211855    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncsmq"]
Jul 17 05:39:12.212067 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.211988    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq"
Jul 17 05:39:12.214639 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.214615    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 05:39:12.215994 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.215974    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zkl9f\""
Jul 17 05:39:12.215994 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.215985    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 05:39:12.374474 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.374442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt28w\" (UniqueName: \"kubernetes.io/projected/3ba1b5b1-6111-4b48-9fc9-8a64426528e7-kube-api-access-xt28w\") pod \"kuadrant-operator-catalog-ncsmq\" (UID: \"3ba1b5b1-6111-4b48-9fc9-8a64426528e7\") " pod="kuadrant-system/kuadrant-operator-catalog-ncsmq"
Jul 17 05:39:12.475389 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.475312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt28w\" (UniqueName: \"kubernetes.io/projected/3ba1b5b1-6111-4b48-9fc9-8a64426528e7-kube-api-access-xt28w\") pod \"kuadrant-operator-catalog-ncsmq\" (UID: \"3ba1b5b1-6111-4b48-9fc9-8a64426528e7\") " pod="kuadrant-system/kuadrant-operator-catalog-ncsmq"
Jul 17 05:39:12.488130 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.488104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt28w\" (UniqueName: \"kubernetes.io/projected/3ba1b5b1-6111-4b48-9fc9-8a64426528e7-kube-api-access-xt28w\") pod \"kuadrant-operator-catalog-ncsmq\" (UID: \"3ba1b5b1-6111-4b48-9fc9-8a64426528e7\") " pod="kuadrant-system/kuadrant-operator-catalog-ncsmq"
Jul 17 05:39:12.523137 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.523111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq"
Jul 17 05:39:12.566380 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.566345    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncsmq"]
Jul 17 05:39:12.647638 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.647618    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncsmq"]
Jul 17 05:39:12.650237 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:39:12.650207    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba1b5b1_6111_4b48_9fc9_8a64426528e7.slice/crio-beff2c177727546895aa0e9cc51e76a3996fd55b1dbb25e5b43efc80616451c9 WatchSource:0}: Error finding container beff2c177727546895aa0e9cc51e76a3996fd55b1dbb25e5b43efc80616451c9: Status 404 returned error can't find the container with id beff2c177727546895aa0e9cc51e76a3996fd55b1dbb25e5b43efc80616451c9
Jul 17 05:39:12.775145 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.775048    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vpkh"]
Jul 17 05:39:12.778122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.778096    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:12.784412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.784387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vpkh"]
Jul 17 05:39:12.878738 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.878705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2559q\" (UniqueName: \"kubernetes.io/projected/302d1ba0-4bff-4c28-b4cd-ac271a24e254-kube-api-access-2559q\") pod \"kuadrant-operator-catalog-7vpkh\" (UID: \"302d1ba0-4bff-4c28-b4cd-ac271a24e254\") " pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:12.881997 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.881966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq" event={"ID":"3ba1b5b1-6111-4b48-9fc9-8a64426528e7","Type":"ContainerStarted","Data":"beff2c177727546895aa0e9cc51e76a3996fd55b1dbb25e5b43efc80616451c9"}
Jul 17 05:39:12.979693 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.979656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2559q\" (UniqueName: \"kubernetes.io/projected/302d1ba0-4bff-4c28-b4cd-ac271a24e254-kube-api-access-2559q\") pod \"kuadrant-operator-catalog-7vpkh\" (UID: \"302d1ba0-4bff-4c28-b4cd-ac271a24e254\") " pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:12.988189 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:12.988158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2559q\" (UniqueName: \"kubernetes.io/projected/302d1ba0-4bff-4c28-b4cd-ac271a24e254-kube-api-access-2559q\") pod \"kuadrant-operator-catalog-7vpkh\" (UID: \"302d1ba0-4bff-4c28-b4cd-ac271a24e254\") " pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:13.088340 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:13.088301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:13.212444 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:13.212422    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vpkh"]
Jul 17 05:39:13.214816 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:39:13.214789    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302d1ba0_4bff_4c28_b4cd_ac271a24e254.slice/crio-5623b50fd24dd1f14f498def886f539404e030009ab30821ab121fd8e0b465de WatchSource:0}: Error finding container 5623b50fd24dd1f14f498def886f539404e030009ab30821ab121fd8e0b465de: Status 404 returned error can't find the container with id 5623b50fd24dd1f14f498def886f539404e030009ab30821ab121fd8e0b465de
Jul 17 05:39:13.887815 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:13.887773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh" event={"ID":"302d1ba0-4bff-4c28-b4cd-ac271a24e254","Type":"ContainerStarted","Data":"5623b50fd24dd1f14f498def886f539404e030009ab30821ab121fd8e0b465de"}
Jul 17 05:39:15.898212 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:15.898170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh" event={"ID":"302d1ba0-4bff-4c28-b4cd-ac271a24e254","Type":"ContainerStarted","Data":"c5df0935f328bbd08556d82cd84039833f6832c4512effb2529f696820d829e2"}
Jul 17 05:39:15.899761 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:15.899727    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq" event={"ID":"3ba1b5b1-6111-4b48-9fc9-8a64426528e7","Type":"ContainerStarted","Data":"41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1"}
Jul 17 05:39:15.899908 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:15.899774    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq" podUID="3ba1b5b1-6111-4b48-9fc9-8a64426528e7" containerName="registry-server" containerID="cri-o://41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1" gracePeriod=2
Jul 17 05:39:15.912968 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:15.912927    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh" podStartSLOduration=1.862679622 podStartE2EDuration="3.912911263s" totalImagesPullingTime="2.050231641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:39:15.912911047 +0000 UTC m=+379.088312435" watchObservedRunningTime="2026-07-17 05:39:15.912911263 +0000 UTC m=+379.088312633"
Jul 17 05:39:15.926631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:15.926590    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq" podStartSLOduration=1.308432497 podStartE2EDuration="3.926576821s" totalImagesPullingTime="2.618144324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:39:15.926153667 +0000 UTC m=+379.101555057" watchObservedRunningTime="2026-07-17 05:39:15.926576821 +0000 UTC m=+379.101978209"
Jul 17 05:39:16.143497 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.143473    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq"
Jul 17 05:39:16.206340 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.206268    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt28w\" (UniqueName: \"kubernetes.io/projected/3ba1b5b1-6111-4b48-9fc9-8a64426528e7-kube-api-access-xt28w\") pod \"3ba1b5b1-6111-4b48-9fc9-8a64426528e7\" (UID: \"3ba1b5b1-6111-4b48-9fc9-8a64426528e7\") "
Jul 17 05:39:16.208336 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.208307    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ba1b5b1-6111-4b48-9fc9-8a64426528e7-kube-api-access-xt28w" (OuterVolumeSpecName: "kube-api-access-xt28w") pod "3ba1b5b1-6111-4b48-9fc9-8a64426528e7" (UID: "3ba1b5b1-6111-4b48-9fc9-8a64426528e7"). InnerVolumeSpecName "kube-api-access-xt28w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:39:16.307357 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.307327    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt28w\" (UniqueName: \"kubernetes.io/projected/3ba1b5b1-6111-4b48-9fc9-8a64426528e7-kube-api-access-xt28w\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:39:16.904658 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.904625    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ba1b5b1-6111-4b48-9fc9-8a64426528e7" containerID="41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1" exitCode=0
Jul 17 05:39:16.905062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.904671    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq"
Jul 17 05:39:16.905062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.904707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq" event={"ID":"3ba1b5b1-6111-4b48-9fc9-8a64426528e7","Type":"ContainerDied","Data":"41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1"}
Jul 17 05:39:16.905062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.904757    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncsmq" event={"ID":"3ba1b5b1-6111-4b48-9fc9-8a64426528e7","Type":"ContainerDied","Data":"beff2c177727546895aa0e9cc51e76a3996fd55b1dbb25e5b43efc80616451c9"}
Jul 17 05:39:16.905062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.904777    2559 scope.go:117] "RemoveContainer" containerID="41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1"
Jul 17 05:39:16.913760 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.913736    2559 scope.go:117] "RemoveContainer" containerID="41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1"
Jul 17 05:39:16.914247 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:39:16.914191    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1\": container with ID starting with 41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1 not found: ID does not exist" containerID="41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1"
Jul 17 05:39:16.914247 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.914233    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1"} err="failed to get container status \"41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1\": rpc error: code = NotFound desc = could not find container \"41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1\": container with ID starting with 41ec13ee29759e28e8b0f4b452fbac7b9c17ca6adfbc1927f9ee98df727a3cf1 not found: ID does not exist"
Jul 17 05:39:16.927147 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.927124    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncsmq"]
Jul 17 05:39:16.930338 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:16.930316    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncsmq"]
Jul 17 05:39:17.323999 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:17.323959    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ba1b5b1-6111-4b48-9fc9-8a64426528e7" path="/var/lib/kubelet/pods/3ba1b5b1-6111-4b48-9fc9-8a64426528e7/volumes"
Jul 17 05:39:23.088618 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:23.088575    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:23.089137 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:23.088649    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:23.110777 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:23.110753    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:23.957636 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:23.957608    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7vpkh"
Jul 17 05:39:44.782212 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.782166    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"]
Jul 17 05:39:44.782748 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.782655    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba1b5b1-6111-4b48-9fc9-8a64426528e7" containerName="registry-server"
Jul 17 05:39:44.782748 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.782677    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba1b5b1-6111-4b48-9fc9-8a64426528e7" containerName="registry-server"
Jul 17 05:39:44.782902 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.782766    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba1b5b1-6111-4b48-9fc9-8a64426528e7" containerName="registry-server"
Jul 17 05:39:44.790445 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.790420    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"
Jul 17 05:39:44.793850 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.793818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bjt5n\""
Jul 17 05:39:44.794446 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.794427    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"]
Jul 17 05:39:44.847568 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.847537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8jkk\" (UniqueName: \"kubernetes.io/projected/a666c0ad-5e26-46c7-90f0-f8af79603ad3-kube-api-access-f8jkk\") pod \"authorino-operator-75cc8d5cb7-kslt4\" (UID: \"a666c0ad-5e26-46c7-90f0-f8af79603ad3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"
Jul 17 05:39:44.948494 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.948460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8jkk\" (UniqueName: \"kubernetes.io/projected/a666c0ad-5e26-46c7-90f0-f8af79603ad3-kube-api-access-f8jkk\") pod \"authorino-operator-75cc8d5cb7-kslt4\" (UID: \"a666c0ad-5e26-46c7-90f0-f8af79603ad3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"
Jul 17 05:39:44.959294 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:44.959270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8jkk\" (UniqueName: \"kubernetes.io/projected/a666c0ad-5e26-46c7-90f0-f8af79603ad3-kube-api-access-f8jkk\") pod \"authorino-operator-75cc8d5cb7-kslt4\" (UID: \"a666c0ad-5e26-46c7-90f0-f8af79603ad3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"
Jul 17 05:39:45.101445 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.101400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"
Jul 17 05:39:45.228588 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.228561    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"]
Jul 17 05:39:45.231421 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:39:45.231386    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda666c0ad_5e26_46c7_90f0_f8af79603ad3.slice/crio-5369b9d6cbff34e791ef2f63e9d57d4444a20b673a927dde45b9842430d7e04e WatchSource:0}: Error finding container 5369b9d6cbff34e791ef2f63e9d57d4444a20b673a927dde45b9842430d7e04e: Status 404 returned error can't find the container with id 5369b9d6cbff34e791ef2f63e9d57d4444a20b673a927dde45b9842430d7e04e
Jul 17 05:39:45.953917 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.952823    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-564b5cdc49-j7b2m"]
Jul 17 05:39:45.956814 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.956790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:45.959710 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.959673    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 05:39:45.961323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.961302    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k5npd\""
Jul 17 05:39:45.961433 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.961357    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 05:39:45.961579 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.961561    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 05:39:45.961653 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.961607    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 05:39:45.961718 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.961563    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 05:39:45.962321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.962033    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 05:39:45.962321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.962130    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 05:39:45.967850 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.967823    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564b5cdc49-j7b2m"]
Jul 17 05:39:45.967966 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:45.967838    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 05:39:46.034277 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.034229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4" event={"ID":"a666c0ad-5e26-46c7-90f0-f8af79603ad3","Type":"ContainerStarted","Data":"5369b9d6cbff34e791ef2f63e9d57d4444a20b673a927dde45b9842430d7e04e"}
Jul 17 05:39:46.059075 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.058931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8dddc16-2358-46d4-842f-f894d9131c27-console-oauth-config\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.059075 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.059036    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-console-config\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.059299 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.059113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-oauth-serving-cert\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.059299 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.059178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-service-ca\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.059299 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.059212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8dddc16-2358-46d4-842f-f894d9131c27-console-serving-cert\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.059299 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.059236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dlh\" (UniqueName: \"kubernetes.io/projected/f8dddc16-2358-46d4-842f-f894d9131c27-kube-api-access-b6dlh\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.059299 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.059268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-trusted-ca-bundle\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.160704 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.160666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8dddc16-2358-46d4-842f-f894d9131c27-console-oauth-config\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.160951 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.160865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-console-config\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.161068 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.160982    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-oauth-serving-cert\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.161068 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.161035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-service-ca\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.161068 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.161065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8dddc16-2358-46d4-842f-f894d9131c27-console-serving-cert\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.161232 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.161090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dlh\" (UniqueName: \"kubernetes.io/projected/f8dddc16-2358-46d4-842f-f894d9131c27-kube-api-access-b6dlh\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.161232 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.161122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-trusted-ca-bundle\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.162747 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.161907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-service-ca\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.162747 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.162254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-console-config\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.162747 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.162421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-oauth-serving-cert\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.162747 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.162438    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8dddc16-2358-46d4-842f-f894d9131c27-trusted-ca-bundle\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.164358 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.164334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8dddc16-2358-46d4-842f-f894d9131c27-console-serving-cert\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.164837 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.164797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8dddc16-2358-46d4-842f-f894d9131c27-console-oauth-config\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.181082 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.181050    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dlh\" (UniqueName: \"kubernetes.io/projected/f8dddc16-2358-46d4-842f-f894d9131c27-kube-api-access-b6dlh\") pod \"console-564b5cdc49-j7b2m\" (UID: \"f8dddc16-2358-46d4-842f-f894d9131c27\") " pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.273188 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.273100    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:46.442849 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:46.442819    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564b5cdc49-j7b2m"]
Jul 17 05:39:46.445911 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:39:46.445862    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8dddc16_2358_46d4_842f_f894d9131c27.slice/crio-b962eb3311bf490ab0ad42c29e1b63cbfac915f57fb5a9eb52aa08e115be61eb WatchSource:0}: Error finding container b962eb3311bf490ab0ad42c29e1b63cbfac915f57fb5a9eb52aa08e115be61eb: Status 404 returned error can't find the container with id b962eb3311bf490ab0ad42c29e1b63cbfac915f57fb5a9eb52aa08e115be61eb
Jul 17 05:39:47.040352 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:47.040308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564b5cdc49-j7b2m" event={"ID":"f8dddc16-2358-46d4-842f-f894d9131c27","Type":"ContainerStarted","Data":"ad94017ccbb75db386842d2e47daeac1eb4ab3ef6a9d0ac0a8dca0c16b305238"}
Jul 17 05:39:47.040779 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:47.040371    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564b5cdc49-j7b2m" event={"ID":"f8dddc16-2358-46d4-842f-f894d9131c27","Type":"ContainerStarted","Data":"b962eb3311bf490ab0ad42c29e1b63cbfac915f57fb5a9eb52aa08e115be61eb"}
Jul 17 05:39:47.059581 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:47.059525    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-564b5cdc49-j7b2m" podStartSLOduration=2.059506338 podStartE2EDuration="2.059506338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:39:47.05768694 +0000 UTC m=+410.233088320" watchObservedRunningTime="2026-07-17 05:39:47.059506338 +0000 UTC m=+410.234907733"
Jul 17 05:39:48.046624 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.046590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4" event={"ID":"a666c0ad-5e26-46c7-90f0-f8af79603ad3","Type":"ContainerStarted","Data":"04facfb8082e2b3e43845f5c80ad0219f1202a48250ca05497ff72768517a1d9"}
Jul 17 05:39:48.061425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.061396    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"]
Jul 17 05:39:48.064813 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.064795    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"
Jul 17 05:39:48.068089 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.068064    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hfrd9\""
Jul 17 05:39:48.069010 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.068989    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 05:39:48.069739 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.069704    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4" podStartSLOduration=1.7272980690000002 podStartE2EDuration="4.069691369s" totalImagesPullingTime="2.3423933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:39:48.069334199 +0000 UTC m=+411.244735587" watchObservedRunningTime="2026-07-17 05:39:48.069691369 +0000 UTC m=+411.245092756"
Jul 17 05:39:48.077548 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.077527    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"]
Jul 17 05:39:48.179731 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.179697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lc5q\" (UniqueName: \"kubernetes.io/projected/574cd401-7aa1-4d41-b463-dcacc16e5e15-kube-api-access-2lc5q\") pod \"dns-operator-controller-manager-864dd78c4c-dm6h5\" (UID: \"574cd401-7aa1-4d41-b463-dcacc16e5e15\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"
Jul 17 05:39:48.280347 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.280299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lc5q\" (UniqueName: \"kubernetes.io/projected/574cd401-7aa1-4d41-b463-dcacc16e5e15-kube-api-access-2lc5q\") pod \"dns-operator-controller-manager-864dd78c4c-dm6h5\" (UID: \"574cd401-7aa1-4d41-b463-dcacc16e5e15\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"
Jul 17 05:39:48.290515 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.290488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lc5q\" (UniqueName: \"kubernetes.io/projected/574cd401-7aa1-4d41-b463-dcacc16e5e15-kube-api-access-2lc5q\") pod \"dns-operator-controller-manager-864dd78c4c-dm6h5\" (UID: \"574cd401-7aa1-4d41-b463-dcacc16e5e15\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"
Jul 17 05:39:48.376661 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.376571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"
Jul 17 05:39:48.530649 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:48.530600    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"]
Jul 17 05:39:48.532835 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:39:48.532805    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574cd401_7aa1_4d41_b463_dcacc16e5e15.slice/crio-b82181e5b1b28d7c79e0323c907893e99dfee14fd449cfdecaf5eca1d6dba77b WatchSource:0}: Error finding container b82181e5b1b28d7c79e0323c907893e99dfee14fd449cfdecaf5eca1d6dba77b: Status 404 returned error can't find the container with id b82181e5b1b28d7c79e0323c907893e99dfee14fd449cfdecaf5eca1d6dba77b
Jul 17 05:39:49.052496 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:49.052458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5" event={"ID":"574cd401-7aa1-4d41-b463-dcacc16e5e15","Type":"ContainerStarted","Data":"b82181e5b1b28d7c79e0323c907893e99dfee14fd449cfdecaf5eca1d6dba77b"}
Jul 17 05:39:49.052894 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:49.052561    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"
Jul 17 05:39:51.062963 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:51.062927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5" event={"ID":"574cd401-7aa1-4d41-b463-dcacc16e5e15","Type":"ContainerStarted","Data":"c9090f9a0920b54ccd952acceae6a5ca29ba2ebac129f1ea51a9355815f07ae0"}
Jul 17 05:39:51.063341 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:51.063083    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"
Jul 17 05:39:51.082032 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:51.081984    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5" podStartSLOduration=0.952779093 podStartE2EDuration="3.081969595s" totalImagesPullingTime="2.129190502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:39:51.080993046 +0000 UTC m=+414.256394436" watchObservedRunningTime="2026-07-17 05:39:51.081969595 +0000 UTC m=+414.257371024"
Jul 17 05:39:52.776168 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:52.776130    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"]
Jul 17 05:39:52.779501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:52.779484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:52.782819 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:52.782800    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kvzrw\""
Jul 17 05:39:52.796014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:52.795992    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"]
Jul 17 05:39:52.920237 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:52.920198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7b0f49-a0a9-49cf-a336-73986c543e3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:52.920394 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:52.920262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkvvr\" (UniqueName: \"kubernetes.io/projected/2c7b0f49-a0a9-49cf-a336-73986c543e3f-kube-api-access-qkvvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:53.021094 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:53.021058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7b0f49-a0a9-49cf-a336-73986c543e3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:53.021250 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:53.021104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkvvr\" (UniqueName: \"kubernetes.io/projected/2c7b0f49-a0a9-49cf-a336-73986c543e3f-kube-api-access-qkvvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:53.021498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:53.021475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7b0f49-a0a9-49cf-a336-73986c543e3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:53.030266 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:53.030215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkvvr\" (UniqueName: \"kubernetes.io/projected/2c7b0f49-a0a9-49cf-a336-73986c543e3f-kube-api-access-qkvvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:53.089208 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:53.089178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:53.223829 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:53.223803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"]
Jul 17 05:39:53.226412 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:39:53.226386    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7b0f49_a0a9_49cf_a336_73986c543e3f.slice/crio-ddf94ab2c4b2668557988652c52843c996a6bb78b126f340147a5c30f9412df1 WatchSource:0}: Error finding container ddf94ab2c4b2668557988652c52843c996a6bb78b126f340147a5c30f9412df1: Status 404 returned error can't find the container with id ddf94ab2c4b2668557988652c52843c996a6bb78b126f340147a5c30f9412df1
Jul 17 05:39:54.076571 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:54.076534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x" event={"ID":"2c7b0f49-a0a9-49cf-a336-73986c543e3f","Type":"ContainerStarted","Data":"ddf94ab2c4b2668557988652c52843c996a6bb78b126f340147a5c30f9412df1"}
Jul 17 05:39:54.927425 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:54.927389    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"]
Jul 17 05:39:54.930780 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:54.930755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:39:54.934151 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:54.934126    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dgtwj\""
Jul 17 05:39:54.953653 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:54.953611    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"]
Jul 17 05:39:55.039696 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:55.039660    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4t4\" (UniqueName: \"kubernetes.io/projected/cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7-kube-api-access-jh4t4\") pod \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" (UID: \"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:39:55.140735 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:55.140698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4t4\" (UniqueName: \"kubernetes.io/projected/cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7-kube-api-access-jh4t4\") pod \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" (UID: \"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:39:55.156059 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:55.156024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4t4\" (UniqueName: \"kubernetes.io/projected/cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7-kube-api-access-jh4t4\") pod \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" (UID: \"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:39:55.248500 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:55.248420    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:39:55.403990 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:55.403969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"]
Jul 17 05:39:55.406300 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:39:55.406262    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbda05ff_0bbd_4bf1_8790_8f25e0aab7f7.slice/crio-b670c615fcfbef19f10e6edb192c0d59bb82518e001464cedad04178441b329a WatchSource:0}: Error finding container b670c615fcfbef19f10e6edb192c0d59bb82518e001464cedad04178441b329a: Status 404 returned error can't find the container with id b670c615fcfbef19f10e6edb192c0d59bb82518e001464cedad04178441b329a
Jul 17 05:39:56.087833 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:56.087794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf" event={"ID":"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7","Type":"ContainerStarted","Data":"b670c615fcfbef19f10e6edb192c0d59bb82518e001464cedad04178441b329a"}
Jul 17 05:39:56.273450 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:56.273412    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:56.273913 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:56.273494    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:56.279982 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:56.279956    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:57.097987 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:57.097936    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564b5cdc49-j7b2m"
Jul 17 05:39:58.100350 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:58.100306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf" event={"ID":"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7","Type":"ContainerStarted","Data":"4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4"}
Jul 17 05:39:58.119863 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:58.119813    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf" podStartSLOduration=2.471758501 podStartE2EDuration="4.119799132s" totalImagesPullingTime="1.648040631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:39:58.118574146 +0000 UTC m=+421.293975533" watchObservedRunningTime="2026-07-17 05:39:58.119799132 +0000 UTC m=+421.295200519"
Jul 17 05:39:59.106368 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:59.106328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x" event={"ID":"2c7b0f49-a0a9-49cf-a336-73986c543e3f","Type":"ContainerStarted","Data":"6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc"}
Jul 17 05:39:59.106759 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:59.106576    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:39:59.106759 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:59.106618    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:39:59.129250 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:39:59.129202    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x" podStartSLOduration=1.967735018 podStartE2EDuration="7.129190178s" totalImagesPullingTime="5.16145516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:39:59.12743432 +0000 UTC m=+422.302835742" watchObservedRunningTime="2026-07-17 05:39:59.129190178 +0000 UTC m=+422.304591566"
Jul 17 05:40:00.059375 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:00.059348    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kslt4"
Jul 17 05:40:02.068832 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:02.068803    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm6h5"
Jul 17 05:40:10.113498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:10.113467    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:10.114002 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:10.113716    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:12.222050 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.222011    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"]
Jul 17 05:40:12.222439 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.222193    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" containerName="manager" containerID="cri-o://6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc" gracePeriod=2
Jul 17 05:40:12.227503 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.227469    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"]
Jul 17 05:40:12.246513 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.246483    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"]
Jul 17 05:40:12.246734 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.246707    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" containerName="manager" containerID="cri-o://4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4" gracePeriod=2
Jul 17 05:40:12.258372 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.258339    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"]
Jul 17 05:40:12.259298 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.259242    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-s5ltf\": pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:12.262346 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.262304    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:12.274561 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.274527    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"]
Jul 17 05:40:12.275038 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.275022    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" containerName="manager"
Jul 17 05:40:12.275097 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.275042    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" containerName="manager"
Jul 17 05:40:12.275097 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.275060    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" containerName="manager"
Jul 17 05:40:12.275097 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.275069    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" containerName="manager"
Jul 17 05:40:12.275193 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.275163    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" containerName="manager"
Jul 17 05:40:12.275193 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.275172    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" containerName="manager"
Jul 17 05:40:12.278536 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.278514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.280447 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.280422    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"]
Jul 17 05:40:12.281338 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.281308    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:12.283612 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.283549    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"
Jul 17 05:40:12.284058 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.283789    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:12.302041 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.302014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"]
Jul 17 05:40:12.305953 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.305930    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"]
Jul 17 05:40:12.331154 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.331118    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:12.334079 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.334046    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:12.378108 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.378085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jm5k\" (UniqueName: \"kubernetes.io/projected/3b6ee091-f7d2-4706-8246-40d3eca922c8-kube-api-access-5jm5k\") pod \"limitador-operator-controller-manager-859d7b78bd-tlprh\" (UID: \"3b6ee091-f7d2-4706-8246-40d3eca922c8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"
Jul 17 05:40:12.378221 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.378119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwxwt\" (UniqueName: \"kubernetes.io/projected/eef46d2d-b7c7-4339-9c91-8956acf15545-kube-api-access-lwxwt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qjbrg\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.378221 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.378145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef46d2d-b7c7-4339-9c91-8956acf15545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qjbrg\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.478596 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.478563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jm5k\" (UniqueName: \"kubernetes.io/projected/3b6ee091-f7d2-4706-8246-40d3eca922c8-kube-api-access-5jm5k\") pod \"limitador-operator-controller-manager-859d7b78bd-tlprh\" (UID: \"3b6ee091-f7d2-4706-8246-40d3eca922c8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"
Jul 17 05:40:12.478723 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.478610    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwxwt\" (UniqueName: \"kubernetes.io/projected/eef46d2d-b7c7-4339-9c91-8956acf15545-kube-api-access-lwxwt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qjbrg\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.478723 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.478644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef46d2d-b7c7-4339-9c91-8956acf15545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qjbrg\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.479167 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.479146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef46d2d-b7c7-4339-9c91-8956acf15545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qjbrg\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.490220 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.490197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jm5k\" (UniqueName: \"kubernetes.io/projected/3b6ee091-f7d2-4706-8246-40d3eca922c8-kube-api-access-5jm5k\") pod \"limitador-operator-controller-manager-859d7b78bd-tlprh\" (UID: \"3b6ee091-f7d2-4706-8246-40d3eca922c8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"
Jul 17 05:40:12.490443 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.490420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwxwt\" (UniqueName: \"kubernetes.io/projected/eef46d2d-b7c7-4339-9c91-8956acf15545-kube-api-access-lwxwt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qjbrg\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.497390 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.497369    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:12.499424 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.499405    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:12.499899 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.499854    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:12.502055 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.502034    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:12.504923 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.504905    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:12.508642 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:12.508623    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:12.579233 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.579204    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh4t4\" (UniqueName: \"kubernetes.io/projected/cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7-kube-api-access-jh4t4\") pod \"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7\" (UID: \"cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7\") "
Jul 17 05:40:12.579365 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.579246    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7b0f49-a0a9-49cf-a336-73986c543e3f-extensions-socket-volume\") pod \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") "
Jul 17 05:40:12.579365 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.579273    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkvvr\" (UniqueName: \"kubernetes.io/projected/2c7b0f49-a0a9-49cf-a336-73986c543e3f-kube-api-access-qkvvr\") pod \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\" (UID: \"2c7b0f49-a0a9-49cf-a336-73986c543e3f\") "
Jul 17 05:40:12.579692 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.579668    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c7b0f49-a0a9-49cf-a336-73986c543e3f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c7b0f49-a0a9-49cf-a336-73986c543e3f" (UID: "2c7b0f49-a0a9-49cf-a336-73986c543e3f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:40:12.581316 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.581293    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7-kube-api-access-jh4t4" (OuterVolumeSpecName: "kube-api-access-jh4t4") pod "cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" (UID: "cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7"). InnerVolumeSpecName "kube-api-access-jh4t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:40:12.581397 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.581329    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c7b0f49-a0a9-49cf-a336-73986c543e3f-kube-api-access-qkvvr" (OuterVolumeSpecName: "kube-api-access-qkvvr") pod "2c7b0f49-a0a9-49cf-a336-73986c543e3f" (UID: "2c7b0f49-a0a9-49cf-a336-73986c543e3f"). InnerVolumeSpecName "kube-api-access-qkvvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:40:12.666553 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.666525    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:12.673765 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.673748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"
Jul 17 05:40:12.680054 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.680026    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkvvr\" (UniqueName: \"kubernetes.io/projected/2c7b0f49-a0a9-49cf-a336-73986c543e3f-kube-api-access-qkvvr\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:40:12.680167 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.680057    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh4t4\" (UniqueName: \"kubernetes.io/projected/cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7-kube-api-access-jh4t4\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:40:12.680167 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.680070    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7b0f49-a0a9-49cf-a336-73986c543e3f-extensions-socket-volume\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:40:12.817275 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.817238    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"]
Jul 17 05:40:12.821005 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:40:12.820978    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef46d2d_b7c7_4339_9c91_8956acf15545.slice/crio-a11c1e8001738474f065f3fc1a27a1504935d6426766ebab29c2208a16011b71 WatchSource:0}: Error finding container a11c1e8001738474f065f3fc1a27a1504935d6426766ebab29c2208a16011b71: Status 404 returned error can't find the container with id a11c1e8001738474f065f3fc1a27a1504935d6426766ebab29c2208a16011b71
Jul 17 05:40:12.841192 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:12.841170    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"]
Jul 17 05:40:12.844091 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:40:12.844058    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6ee091_f7d2_4706_8246_40d3eca922c8.slice/crio-08f469a6327f2c7449d870fe3fefa66160d4ab512122525bc6b43910df27039a WatchSource:0}: Error finding container 08f469a6327f2c7449d870fe3fefa66160d4ab512122525bc6b43910df27039a: Status 404 returned error can't find the container with id 08f469a6327f2c7449d870fe3fefa66160d4ab512122525bc6b43910df27039a
Jul 17 05:40:13.170847 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.170812    2559 generic.go:356] "Generic (PLEG): container finished" podID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" containerID="4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4" exitCode=0
Jul 17 05:40:13.171044 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.170881    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:13.171044 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.170911    2559 scope.go:117] "RemoveContainer" containerID="4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4"
Jul 17 05:40:13.172761 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.172728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh" event={"ID":"3b6ee091-f7d2-4706-8246-40d3eca922c8","Type":"ContainerStarted","Data":"57c672663f8352e18efc5a96596506ade3563632e596bd2f3cecd1e59772f009"}
Jul 17 05:40:13.172975 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.172790    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh" event={"ID":"3b6ee091-f7d2-4706-8246-40d3eca922c8","Type":"ContainerStarted","Data":"08f469a6327f2c7449d870fe3fefa66160d4ab512122525bc6b43910df27039a"}
Jul 17 05:40:13.172975 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.172824    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"
Jul 17 05:40:13.173935 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.173904    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:13.175033 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.174994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg" event={"ID":"eef46d2d-b7c7-4339-9c91-8956acf15545","Type":"ContainerStarted","Data":"d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5"}
Jul 17 05:40:13.175163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.175056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg" event={"ID":"eef46d2d-b7c7-4339-9c91-8956acf15545","Type":"ContainerStarted","Data":"a11c1e8001738474f065f3fc1a27a1504935d6426766ebab29c2208a16011b71"}
Jul 17 05:40:13.175163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.175086    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:13.176180 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.176153    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:13.176694 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.176675    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:13.176694 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.176624    2559 generic.go:356] "Generic (PLEG): container finished" podID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" containerID="6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc" exitCode=0
Jul 17 05:40:13.181704 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.181680    2559 scope.go:117] "RemoveContainer" containerID="4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4"
Jul 17 05:40:13.181976 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.181957    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4\": container with ID starting with 4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4 not found: ID does not exist" containerID="4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4"
Jul 17 05:40:13.182061 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.181982    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4"} err="failed to get container status \"4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4\": rpc error: code = NotFound desc = could not find container \"4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4\": container with ID starting with 4ff831afdba3c5da78bbc7ee5881470efb2b76fb1ea42e58e108b29aedb223c4 not found: ID does not exist"
Jul 17 05:40:13.182061 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.181998    2559 scope.go:117] "RemoveContainer" containerID="6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc"
Jul 17 05:40:13.190009 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.189991    2559 scope.go:117] "RemoveContainer" containerID="6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc"
Jul 17 05:40:13.190279 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.190261    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc\": container with ID starting with 6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc not found: ID does not exist" containerID="6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc"
Jul 17 05:40:13.190333 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.190296    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc"} err="failed to get container status \"6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc\": rpc error: code = NotFound desc = could not find container \"6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc\": container with ID starting with 6bd8a45418044c7ac04dcfb73f83947fa6b00c6572c6d417f2756e4da236cabc not found: ID does not exist"
Jul 17 05:40:13.197464 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.197427    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh" podStartSLOduration=1.197416066 podStartE2EDuration="1.197416066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:40:13.196062135 +0000 UTC m=+436.371463525" watchObservedRunningTime="2026-07-17 05:40:13.197416066 +0000 UTC m=+436.372817453"
Jul 17 05:40:13.199898 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.199862    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:13.204889 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.204853    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:13.230882 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.230836    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg" podStartSLOduration=1.230823193 podStartE2EDuration="1.230823193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:40:13.229541389 +0000 UTC m=+436.404942776" watchObservedRunningTime="2026-07-17 05:40:13.230823193 +0000 UTC m=+436.406224581"
Jul 17 05:40:13.232541 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.232514    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p746x\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p746x"
Jul 17 05:40:13.234534 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:13.234515    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-s5ltf\" is forbidden: User \"system:node:ip-10-0-128-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-37.ec2.internal' and this object" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5ltf"
Jul 17 05:40:13.323697 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.323665    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c7b0f49-a0a9-49cf-a336-73986c543e3f" path="/var/lib/kubelet/pods/2c7b0f49-a0a9-49cf-a336-73986c543e3f/volumes"
Jul 17 05:40:13.324014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:13.324001    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7" path="/var/lib/kubelet/pods/cbda05ff-0bbd-4bf1-8790-8f25e0aab7f7/volumes"
Jul 17 05:40:24.185458 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:24.185376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tlprh"
Jul 17 05:40:24.185458 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:24.185450    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:43.914995 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:43.914960    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"]
Jul 17 05:40:43.915479 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:43.915164    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg" podUID="eef46d2d-b7c7-4339-9c91-8956acf15545" containerName="manager" containerID="cri-o://d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5" gracePeriod=10
Jul 17 05:40:44.174221 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.174159    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:44.233146 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.233108    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef46d2d-b7c7-4339-9c91-8956acf15545-extensions-socket-volume\") pod \"eef46d2d-b7c7-4339-9c91-8956acf15545\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") "
Jul 17 05:40:44.233344 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.233216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwxwt\" (UniqueName: \"kubernetes.io/projected/eef46d2d-b7c7-4339-9c91-8956acf15545-kube-api-access-lwxwt\") pod \"eef46d2d-b7c7-4339-9c91-8956acf15545\" (UID: \"eef46d2d-b7c7-4339-9c91-8956acf15545\") "
Jul 17 05:40:44.233564 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.233534    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef46d2d-b7c7-4339-9c91-8956acf15545-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eef46d2d-b7c7-4339-9c91-8956acf15545" (UID: "eef46d2d-b7c7-4339-9c91-8956acf15545"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:40:44.235368 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.235343    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef46d2d-b7c7-4339-9c91-8956acf15545-kube-api-access-lwxwt" (OuterVolumeSpecName: "kube-api-access-lwxwt") pod "eef46d2d-b7c7-4339-9c91-8956acf15545" (UID: "eef46d2d-b7c7-4339-9c91-8956acf15545"). InnerVolumeSpecName "kube-api-access-lwxwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:40:44.333320 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.333282    2559 generic.go:356] "Generic (PLEG): container finished" podID="eef46d2d-b7c7-4339-9c91-8956acf15545" containerID="d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5" exitCode=0
Jul 17 05:40:44.333478 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.333325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"
Jul 17 05:40:44.333478 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.333338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg" event={"ID":"eef46d2d-b7c7-4339-9c91-8956acf15545","Type":"ContainerDied","Data":"d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5"}
Jul 17 05:40:44.333478 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.333388    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg" event={"ID":"eef46d2d-b7c7-4339-9c91-8956acf15545","Type":"ContainerDied","Data":"a11c1e8001738474f065f3fc1a27a1504935d6426766ebab29c2208a16011b71"}
Jul 17 05:40:44.333478 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.333422    2559 scope.go:117] "RemoveContainer" containerID="d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5"
Jul 17 05:40:44.333786 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.333757    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwxwt\" (UniqueName: \"kubernetes.io/projected/eef46d2d-b7c7-4339-9c91-8956acf15545-kube-api-access-lwxwt\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:40:44.333786 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.333787    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef46d2d-b7c7-4339-9c91-8956acf15545-extensions-socket-volume\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:40:44.344063 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.342232    2559 scope.go:117] "RemoveContainer" containerID="d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5"
Jul 17 05:40:44.347250 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:40:44.344189    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5\": container with ID starting with d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5 not found: ID does not exist" containerID="d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5"
Jul 17 05:40:44.347250 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.344232    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5"} err="failed to get container status \"d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5\": rpc error: code = NotFound desc = could not find container \"d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5\": container with ID starting with d45c5acba7d2ba8c9824fcbd512d7b872742ffdc2c10f947baf900f74bb5f2d5 not found: ID does not exist"
Jul 17 05:40:44.360287 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.360259    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"]
Jul 17 05:40:44.367806 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:44.367776    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qjbrg"]
Jul 17 05:40:45.324048 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:40:45.324009    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef46d2d-b7c7-4339-9c91-8956acf15545" path="/var/lib/kubelet/pods/eef46d2d-b7c7-4339-9c91-8956acf15545/volumes"
Jul 17 05:41:00.274723 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.274689    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"]
Jul 17 05:41:00.275099 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.275039    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef46d2d-b7c7-4339-9c91-8956acf15545" containerName="manager"
Jul 17 05:41:00.275099 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.275052    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef46d2d-b7c7-4339-9c91-8956acf15545" containerName="manager"
Jul 17 05:41:00.275169 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.275128    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef46d2d-b7c7-4339-9c91-8956acf15545" containerName="manager"
Jul 17 05:41:00.279194 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.279177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.281657 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.281630    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hkpgx\""
Jul 17 05:41:00.292776 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.292755    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"]
Jul 17 05:41:00.371724 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.371679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.371923 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.371768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/216d117f-cbc9-437b-a3ca-382748a4994e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.371923 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.371799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fq4z\" (UniqueName: \"kubernetes.io/projected/216d117f-cbc9-437b-a3ca-382748a4994e-kube-api-access-2fq4z\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.371923 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.371828    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.372093 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.371919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/216d117f-cbc9-437b-a3ca-382748a4994e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.372093 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.371958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/216d117f-cbc9-437b-a3ca-382748a4994e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.372093 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.371993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.372093 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.372021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.372093 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.372071    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.473491 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/216d117f-cbc9-437b-a3ca-382748a4994e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.473491 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fq4z\" (UniqueName: \"kubernetes.io/projected/216d117f-cbc9-437b-a3ca-382748a4994e-kube-api-access-2fq4z\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.473738 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.473738 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/216d117f-cbc9-437b-a3ca-382748a4994e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.473738 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/216d117f-cbc9-437b-a3ca-382748a4994e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.473738 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.473738 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.474026 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.474026 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.474026 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.473955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.474196 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.474054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.474336 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.474315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/216d117f-cbc9-437b-a3ca-382748a4994e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.474497 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.474476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.474554 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.474483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.476245 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.476220    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/216d117f-cbc9-437b-a3ca-382748a4994e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.476334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.476229    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/216d117f-cbc9-437b-a3ca-382748a4994e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.481805 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.481777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/216d117f-cbc9-437b-a3ca-382748a4994e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.481966 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.481946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fq4z\" (UniqueName: \"kubernetes.io/projected/216d117f-cbc9-437b-a3ca-382748a4994e-kube-api-access-2fq4z\") pod \"maas-default-gateway-openshift-default-56654dcf7-nzjms\" (UID: \"216d117f-cbc9-437b-a3ca-382748a4994e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.589249 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.589220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:00.725201 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.725164    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"]
Jul 17 05:41:00.728594 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:41:00.728567    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216d117f_cbc9_437b_a3ca_382748a4994e.slice/crio-08071495dc1d65a5059d100dec91ac7d0bbee63381251285413b159bce24d977 WatchSource:0}: Error finding container 08071495dc1d65a5059d100dec91ac7d0bbee63381251285413b159bce24d977: Status 404 returned error can't find the container with id 08071495dc1d65a5059d100dec91ac7d0bbee63381251285413b159bce24d977
Jul 17 05:41:00.731276 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.731242    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:41:00.731344 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.731330    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:41:00.731384 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:00.731371    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:41:01.410476 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:01.410441    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" event={"ID":"216d117f-cbc9-437b-a3ca-382748a4994e","Type":"ContainerStarted","Data":"181778f52ee0e68416555076342563ecf59ab5a780213a033a4dfc6cc2579844"}
Jul 17 05:41:01.410894 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:01.410511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" event={"ID":"216d117f-cbc9-437b-a3ca-382748a4994e","Type":"ContainerStarted","Data":"08071495dc1d65a5059d100dec91ac7d0bbee63381251285413b159bce24d977"}
Jul 17 05:41:01.432286 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:01.432239    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" podStartSLOduration=1.4322247940000001 podStartE2EDuration="1.432224794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:01.430723658 +0000 UTC m=+484.606125052" watchObservedRunningTime="2026-07-17 05:41:01.432224794 +0000 UTC m=+484.607626182"
Jul 17 05:41:01.590133 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:01.590096    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:01.594776 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:01.594748    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:02.414831 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.414799    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:02.415931 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.415913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:41:02.538484 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.538451    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"]
Jul 17 05:41:02.541949 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.541931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.544534 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.544513    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 05:41:02.544647 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.544577    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mmw6m\""
Jul 17 05:41:02.548744 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.548714    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"]
Jul 17 05:41:02.640471 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.640436    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"]
Jul 17 05:41:02.700855 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.700779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp6r8\" (UniqueName: \"kubernetes.io/projected/3d178ed3-353f-4a75-8d66-d7fc818294fb-kube-api-access-qp6r8\") pod \"limitador-limitador-64c94fd64f-j7ntg\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.700855 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.700829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d178ed3-353f-4a75-8d66-d7fc818294fb-config-file\") pod \"limitador-limitador-64c94fd64f-j7ntg\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.801427 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.801395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d178ed3-353f-4a75-8d66-d7fc818294fb-config-file\") pod \"limitador-limitador-64c94fd64f-j7ntg\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.801621 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.801472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp6r8\" (UniqueName: \"kubernetes.io/projected/3d178ed3-353f-4a75-8d66-d7fc818294fb-kube-api-access-qp6r8\") pod \"limitador-limitador-64c94fd64f-j7ntg\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.802166 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.802140    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d178ed3-353f-4a75-8d66-d7fc818294fb-config-file\") pod \"limitador-limitador-64c94fd64f-j7ntg\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.810390 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.810369    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp6r8\" (UniqueName: \"kubernetes.io/projected/3d178ed3-353f-4a75-8d66-d7fc818294fb-kube-api-access-qp6r8\") pod \"limitador-limitador-64c94fd64f-j7ntg\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.853332 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.853296    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:02.993192 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:02.993164    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"]
Jul 17 05:41:02.995841 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:41:02.995809    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d178ed3_353f_4a75_8d66_d7fc818294fb.slice/crio-0d2b808fb801b6897176ae108d9c53ee174751de4393d74c27e2bd7a21166c41 WatchSource:0}: Error finding container 0d2b808fb801b6897176ae108d9c53ee174751de4393d74c27e2bd7a21166c41: Status 404 returned error can't find the container with id 0d2b808fb801b6897176ae108d9c53ee174751de4393d74c27e2bd7a21166c41
Jul 17 05:41:03.324619 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.324589    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-j6tsn"]
Jul 17 05:41:03.329007 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.328980    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j6tsn"
Jul 17 05:41:03.329351 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.329331    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j6tsn"]
Jul 17 05:41:03.331638 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.331616    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rqjkh\""
Jul 17 05:41:03.420232 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.420196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg" event={"ID":"3d178ed3-353f-4a75-8d66-d7fc818294fb","Type":"ContainerStarted","Data":"0d2b808fb801b6897176ae108d9c53ee174751de4393d74c27e2bd7a21166c41"}
Jul 17 05:41:03.507145 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.507078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f777k\" (UniqueName: \"kubernetes.io/projected/a6a7817c-b834-4454-9363-7b4b2caed1aa-kube-api-access-f777k\") pod \"authorino-58cd955675-j6tsn\" (UID: \"a6a7817c-b834-4454-9363-7b4b2caed1aa\") " pod="kuadrant-system/authorino-58cd955675-j6tsn"
Jul 17 05:41:03.608433 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.608347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f777k\" (UniqueName: \"kubernetes.io/projected/a6a7817c-b834-4454-9363-7b4b2caed1aa-kube-api-access-f777k\") pod \"authorino-58cd955675-j6tsn\" (UID: \"a6a7817c-b834-4454-9363-7b4b2caed1aa\") " pod="kuadrant-system/authorino-58cd955675-j6tsn"
Jul 17 05:41:03.620109 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.620077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f777k\" (UniqueName: \"kubernetes.io/projected/a6a7817c-b834-4454-9363-7b4b2caed1aa-kube-api-access-f777k\") pod \"authorino-58cd955675-j6tsn\" (UID: \"a6a7817c-b834-4454-9363-7b4b2caed1aa\") " pod="kuadrant-system/authorino-58cd955675-j6tsn"
Jul 17 05:41:03.639309 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.639274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j6tsn"
Jul 17 05:41:03.818423 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:03.818346    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j6tsn"]
Jul 17 05:41:03.823052 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:41:03.823020    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6a7817c_b834_4454_9363_7b4b2caed1aa.slice/crio-c8d3438edd514f9c14d3972d37f66dfe6b7194d2c12a3daf605f9313a5e342fb WatchSource:0}: Error finding container c8d3438edd514f9c14d3972d37f66dfe6b7194d2c12a3daf605f9313a5e342fb: Status 404 returned error can't find the container with id c8d3438edd514f9c14d3972d37f66dfe6b7194d2c12a3daf605f9313a5e342fb
Jul 17 05:41:04.425568 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:04.425531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j6tsn" event={"ID":"a6a7817c-b834-4454-9363-7b4b2caed1aa","Type":"ContainerStarted","Data":"c8d3438edd514f9c14d3972d37f66dfe6b7194d2c12a3daf605f9313a5e342fb"}
Jul 17 05:41:08.098713 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:08.098680    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j6tsn"]
Jul 17 05:41:08.446948 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:08.446832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j6tsn" event={"ID":"a6a7817c-b834-4454-9363-7b4b2caed1aa","Type":"ContainerStarted","Data":"b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771"}
Jul 17 05:41:08.448497 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:08.448464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg" event={"ID":"3d178ed3-353f-4a75-8d66-d7fc818294fb","Type":"ContainerStarted","Data":"301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758"}
Jul 17 05:41:08.448642 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:08.448582    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:08.466275 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:08.466225    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-j6tsn" podStartSLOduration=1.7158682189999999 podStartE2EDuration="5.466206915s" totalImagesPullingTime="3.750338696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:08.464432002 +0000 UTC m=+491.639833390" watchObservedRunningTime="2026-07-17 05:41:08.466206915 +0000 UTC m=+491.641608303"
Jul 17 05:41:08.480674 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:08.480623    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg" podStartSLOduration=1.911247618 podStartE2EDuration="6.480608762s" totalImagesPullingTime="4.569361144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:08.479934059 +0000 UTC m=+491.655335447" watchObservedRunningTime="2026-07-17 05:41:08.480608762 +0000 UTC m=+491.656010150"
Jul 17 05:41:09.453172 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:09.453126    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-j6tsn" podUID="a6a7817c-b834-4454-9363-7b4b2caed1aa" containerName="authorino" containerID="cri-o://b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771" gracePeriod=30
Jul 17 05:41:09.700501 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:09.700474    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j6tsn"
Jul 17 05:41:09.760230 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:09.760151    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f777k\" (UniqueName: \"kubernetes.io/projected/a6a7817c-b834-4454-9363-7b4b2caed1aa-kube-api-access-f777k\") pod \"a6a7817c-b834-4454-9363-7b4b2caed1aa\" (UID: \"a6a7817c-b834-4454-9363-7b4b2caed1aa\") "
Jul 17 05:41:09.762137 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:09.762106    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a7817c-b834-4454-9363-7b4b2caed1aa-kube-api-access-f777k" (OuterVolumeSpecName: "kube-api-access-f777k") pod "a6a7817c-b834-4454-9363-7b4b2caed1aa" (UID: "a6a7817c-b834-4454-9363-7b4b2caed1aa"). InnerVolumeSpecName "kube-api-access-f777k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:41:09.861763 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:09.861719    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f777k\" (UniqueName: \"kubernetes.io/projected/a6a7817c-b834-4454-9363-7b4b2caed1aa-kube-api-access-f777k\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:41:10.458367 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.458332    2559 generic.go:356] "Generic (PLEG): container finished" podID="a6a7817c-b834-4454-9363-7b4b2caed1aa" containerID="b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771" exitCode=0
Jul 17 05:41:10.458367 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.458370    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j6tsn"
Jul 17 05:41:10.458891 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.458383    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j6tsn" event={"ID":"a6a7817c-b834-4454-9363-7b4b2caed1aa","Type":"ContainerDied","Data":"b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771"}
Jul 17 05:41:10.458891 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.458418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j6tsn" event={"ID":"a6a7817c-b834-4454-9363-7b4b2caed1aa","Type":"ContainerDied","Data":"c8d3438edd514f9c14d3972d37f66dfe6b7194d2c12a3daf605f9313a5e342fb"}
Jul 17 05:41:10.458891 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.458435    2559 scope.go:117] "RemoveContainer" containerID="b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771"
Jul 17 05:41:10.467135 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.467120    2559 scope.go:117] "RemoveContainer" containerID="b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771"
Jul 17 05:41:10.467401 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:41:10.467383    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771\": container with ID starting with b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771 not found: ID does not exist" containerID="b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771"
Jul 17 05:41:10.467446 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.467408    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771"} err="failed to get container status \"b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771\": rpc error: code = NotFound desc = could not find container \"b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771\": container with ID starting with b5c296ef2bc2c74f9eb16313c575f0e5cccbb69e06a8f02941d3780f7b275771 not found: ID does not exist"
Jul 17 05:41:10.476787 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.476762    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j6tsn"]
Jul 17 05:41:10.479359 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:10.479340    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-j6tsn"]
Jul 17 05:41:11.328675 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:11.328640    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a7817c-b834-4454-9363-7b4b2caed1aa" path="/var/lib/kubelet/pods/a6a7817c-b834-4454-9363-7b4b2caed1aa/volumes"
Jul 17 05:41:17.523099 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:17.523063    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"]
Jul 17 05:41:17.523595 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:17.523297    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg" podUID="3d178ed3-353f-4a75-8d66-d7fc818294fb" containerName="limitador" containerID="cri-o://301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758" gracePeriod=30
Jul 17 05:41:17.524075 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:17.524057    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:18.072247 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.072220    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:18.135161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.135086    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp6r8\" (UniqueName: \"kubernetes.io/projected/3d178ed3-353f-4a75-8d66-d7fc818294fb-kube-api-access-qp6r8\") pod \"3d178ed3-353f-4a75-8d66-d7fc818294fb\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") "
Jul 17 05:41:18.135161 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.135147    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d178ed3-353f-4a75-8d66-d7fc818294fb-config-file\") pod \"3d178ed3-353f-4a75-8d66-d7fc818294fb\" (UID: \"3d178ed3-353f-4a75-8d66-d7fc818294fb\") "
Jul 17 05:41:18.135484 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.135463    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d178ed3-353f-4a75-8d66-d7fc818294fb-config-file" (OuterVolumeSpecName: "config-file") pod "3d178ed3-353f-4a75-8d66-d7fc818294fb" (UID: "3d178ed3-353f-4a75-8d66-d7fc818294fb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:41:18.137163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.137128    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d178ed3-353f-4a75-8d66-d7fc818294fb-kube-api-access-qp6r8" (OuterVolumeSpecName: "kube-api-access-qp6r8") pod "3d178ed3-353f-4a75-8d66-d7fc818294fb" (UID: "3d178ed3-353f-4a75-8d66-d7fc818294fb"). InnerVolumeSpecName "kube-api-access-qp6r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:41:18.236012 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.235975    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp6r8\" (UniqueName: \"kubernetes.io/projected/3d178ed3-353f-4a75-8d66-d7fc818294fb-kube-api-access-qp6r8\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:41:18.236012 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.236006    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3d178ed3-353f-4a75-8d66-d7fc818294fb-config-file\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:41:18.496242 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.496159    2559 generic.go:356] "Generic (PLEG): container finished" podID="3d178ed3-353f-4a75-8d66-d7fc818294fb" containerID="301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758" exitCode=0
Jul 17 05:41:18.496242 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.496201    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"
Jul 17 05:41:18.496405 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.496248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg" event={"ID":"3d178ed3-353f-4a75-8d66-d7fc818294fb","Type":"ContainerDied","Data":"301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758"}
Jul 17 05:41:18.496405 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.496292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j7ntg" event={"ID":"3d178ed3-353f-4a75-8d66-d7fc818294fb","Type":"ContainerDied","Data":"0d2b808fb801b6897176ae108d9c53ee174751de4393d74c27e2bd7a21166c41"}
Jul 17 05:41:18.496405 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.496314    2559 scope.go:117] "RemoveContainer" containerID="301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758"
Jul 17 05:41:18.505333 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.505313    2559 scope.go:117] "RemoveContainer" containerID="301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758"
Jul 17 05:41:18.505596 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:41:18.505577    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758\": container with ID starting with 301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758 not found: ID does not exist" containerID="301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758"
Jul 17 05:41:18.505645 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.505605    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758"} err="failed to get container status \"301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758\": rpc error: code = NotFound desc = could not find container \"301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758\": container with ID starting with 301ffbcb667361f119068ca42ab81a8ec0b109a82e47852963ae09fee4af8758 not found: ID does not exist"
Jul 17 05:41:18.517768 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.517743    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"]
Jul 17 05:41:18.520691 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:18.520668    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j7ntg"]
Jul 17 05:41:19.204249 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.204220    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"]
Jul 17 05:41:19.204631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.204545    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d178ed3-353f-4a75-8d66-d7fc818294fb" containerName="limitador"
Jul 17 05:41:19.204631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.204556    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d178ed3-353f-4a75-8d66-d7fc818294fb" containerName="limitador"
Jul 17 05:41:19.204631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.204568    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a7817c-b834-4454-9363-7b4b2caed1aa" containerName="authorino"
Jul 17 05:41:19.204631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.204574    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a7817c-b834-4454-9363-7b4b2caed1aa" containerName="authorino"
Jul 17 05:41:19.204748 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.204635    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d178ed3-353f-4a75-8d66-d7fc818294fb" containerName="limitador"
Jul 17 05:41:19.204748 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.204643    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a7817c-b834-4454-9363-7b4b2caed1aa" containerName="authorino"
Jul 17 05:41:19.208998 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.208977    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.211634 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.211613    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 05:41:19.211767 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.211613    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:41:19.211767 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.211692    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 05:41:19.211767 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.211613    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v9t78\""
Jul 17 05:41:19.214412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.214390    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"]
Jul 17 05:41:19.243035 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.243003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94l92\" (UniqueName: \"kubernetes.io/projected/d1bbeda8-2c0d-40c0-8d51-2a609d297667-kube-api-access-94l92\") pod \"postgres-69fb4594cf-cj6bg\" (UID: \"d1bbeda8-2c0d-40c0-8d51-2a609d297667\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.243163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.243050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1bbeda8-2c0d-40c0-8d51-2a609d297667-data\") pod \"postgres-69fb4594cf-cj6bg\" (UID: \"d1bbeda8-2c0d-40c0-8d51-2a609d297667\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.324428 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.324398    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d178ed3-353f-4a75-8d66-d7fc818294fb" path="/var/lib/kubelet/pods/3d178ed3-353f-4a75-8d66-d7fc818294fb/volumes"
Jul 17 05:41:19.344395 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.344368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94l92\" (UniqueName: \"kubernetes.io/projected/d1bbeda8-2c0d-40c0-8d51-2a609d297667-kube-api-access-94l92\") pod \"postgres-69fb4594cf-cj6bg\" (UID: \"d1bbeda8-2c0d-40c0-8d51-2a609d297667\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.344537 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.344411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1bbeda8-2c0d-40c0-8d51-2a609d297667-data\") pod \"postgres-69fb4594cf-cj6bg\" (UID: \"d1bbeda8-2c0d-40c0-8d51-2a609d297667\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.344728 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.344710    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1bbeda8-2c0d-40c0-8d51-2a609d297667-data\") pod \"postgres-69fb4594cf-cj6bg\" (UID: \"d1bbeda8-2c0d-40c0-8d51-2a609d297667\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.352222 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.352191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94l92\" (UniqueName: \"kubernetes.io/projected/d1bbeda8-2c0d-40c0-8d51-2a609d297667-kube-api-access-94l92\") pod \"postgres-69fb4594cf-cj6bg\" (UID: \"d1bbeda8-2c0d-40c0-8d51-2a609d297667\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.520651 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.520572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:19.645136 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:19.645110    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"]
Jul 17 05:41:20.511088 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:20.510956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg" event={"ID":"d1bbeda8-2c0d-40c0-8d51-2a609d297667","Type":"ContainerStarted","Data":"0eccb1c7b5d9266fadea053c20c8f357a3364ec8c020a2ebe429272cacdf7a86"}
Jul 17 05:41:25.537641 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:25.537595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg" event={"ID":"d1bbeda8-2c0d-40c0-8d51-2a609d297667","Type":"ContainerStarted","Data":"3a1a417dc8d51a28c14cb834aa0330e5e33cbdcb68861f8874fef9f25ea08404"}
Jul 17 05:41:25.538054 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:25.537697    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:25.567839 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:25.567782    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg" podStartSLOduration=1.668657666 podStartE2EDuration="6.567762385s" totalImagesPullingTime="4.899104719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:25.566991952 +0000 UTC m=+508.742393340" watchObservedRunningTime="2026-07-17 05:41:25.567762385 +0000 UTC m=+508.743163775"
Jul 17 05:41:31.571065 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:31.571037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cj6bg"
Jul 17 05:41:32.136847 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.136809    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9wklp"]
Jul 17 05:41:32.145813 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.145785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9wklp"
Jul 17 05:41:32.149650 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.149622    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rqjkh\""
Jul 17 05:41:32.151978 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.151954    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9wklp"]
Jul 17 05:41:32.262624 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.262586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq6lh\" (UniqueName: \"kubernetes.io/projected/31fc5cdd-7297-4c64-bdcd-98736362d319-kube-api-access-fq6lh\") pod \"authorino-5d4b67c446-9wklp\" (UID: \"31fc5cdd-7297-4c64-bdcd-98736362d319\") " pod="kuadrant-system/authorino-5d4b67c446-9wklp"
Jul 17 05:41:32.363169 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.363134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq6lh\" (UniqueName: \"kubernetes.io/projected/31fc5cdd-7297-4c64-bdcd-98736362d319-kube-api-access-fq6lh\") pod \"authorino-5d4b67c446-9wklp\" (UID: \"31fc5cdd-7297-4c64-bdcd-98736362d319\") " pod="kuadrant-system/authorino-5d4b67c446-9wklp"
Jul 17 05:41:32.375538 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.375507    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq6lh\" (UniqueName: \"kubernetes.io/projected/31fc5cdd-7297-4c64-bdcd-98736362d319-kube-api-access-fq6lh\") pod \"authorino-5d4b67c446-9wklp\" (UID: \"31fc5cdd-7297-4c64-bdcd-98736362d319\") " pod="kuadrant-system/authorino-5d4b67c446-9wklp"
Jul 17 05:41:32.425225 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.425138    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9wklp"]
Jul 17 05:41:32.425436 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.425419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9wklp"
Jul 17 05:41:32.465861 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.465834    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fb474bd7-5ds8v"]
Jul 17 05:41:32.496353 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.496317    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fb474bd7-5ds8v"]
Jul 17 05:41:32.496518 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.496403    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb474bd7-5ds8v"
Jul 17 05:41:32.564686 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.564650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6j9\" (UniqueName: \"kubernetes.io/projected/53948dba-e0e8-44db-9614-5ac9a0301223-kube-api-access-mt6j9\") pod \"authorino-7fb474bd7-5ds8v\" (UID: \"53948dba-e0e8-44db-9614-5ac9a0301223\") " pod="kuadrant-system/authorino-7fb474bd7-5ds8v"
Jul 17 05:41:32.589719 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.589694    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9wklp"]
Jul 17 05:41:32.591564 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:41:32.591538    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31fc5cdd_7297_4c64_bdcd_98736362d319.slice/crio-69f38198314ec04d72dff92e9852714cac4ce84cec76534d20f3d365b81e9f5d WatchSource:0}: Error finding container 69f38198314ec04d72dff92e9852714cac4ce84cec76534d20f3d365b81e9f5d: Status 404 returned error can't find the container with id 69f38198314ec04d72dff92e9852714cac4ce84cec76534d20f3d365b81e9f5d
Jul 17 05:41:32.644492 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.644466    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fb474bd7-5ds8v"]
Jul 17 05:41:32.644728 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:41:32.644709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mt6j9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7fb474bd7-5ds8v" podUID="53948dba-e0e8-44db-9614-5ac9a0301223"
Jul 17 05:41:32.665248 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.665216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6j9\" (UniqueName: \"kubernetes.io/projected/53948dba-e0e8-44db-9614-5ac9a0301223-kube-api-access-mt6j9\") pod \"authorino-7fb474bd7-5ds8v\" (UID: \"53948dba-e0e8-44db-9614-5ac9a0301223\") " pod="kuadrant-system/authorino-7fb474bd7-5ds8v"
Jul 17 05:41:32.675645 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.675593    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-756748d879-2f56l"]
Jul 17 05:41:32.681895 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.681856    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6j9\" (UniqueName: \"kubernetes.io/projected/53948dba-e0e8-44db-9614-5ac9a0301223-kube-api-access-mt6j9\") pod \"authorino-7fb474bd7-5ds8v\" (UID: \"53948dba-e0e8-44db-9614-5ac9a0301223\") " pod="kuadrant-system/authorino-7fb474bd7-5ds8v"
Jul 17 05:41:32.707600 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.707571    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-756748d879-2f56l"]
Jul 17 05:41:32.707706 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.707660    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:32.710281 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.710257    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 05:41:32.766642 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.766609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h554\" (UniqueName: \"kubernetes.io/projected/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-kube-api-access-5h554\") pod \"authorino-756748d879-2f56l\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") " pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:32.766642 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.766645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-tls-cert\") pod \"authorino-756748d879-2f56l\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") " pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:32.867707 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.867666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-tls-cert\") pod \"authorino-756748d879-2f56l\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") " pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:32.867936 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.867775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h554\" (UniqueName: \"kubernetes.io/projected/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-kube-api-access-5h554\") pod \"authorino-756748d879-2f56l\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") " pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:32.870163 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.870139    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-tls-cert\") pod \"authorino-756748d879-2f56l\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") " pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:32.876312 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:32.876289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h554\" (UniqueName: \"kubernetes.io/projected/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-kube-api-access-5h554\") pod \"authorino-756748d879-2f56l\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") " pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:33.017314 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.017234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:41:33.160188 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.160163    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-756748d879-2f56l"]
Jul 17 05:41:33.162771 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:41:33.162743    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41353bf1_4bbd_4bdd_ac1f_2d750d6c5c05.slice/crio-c5fdc2f588aaf9d671e657c10b82b95e264e08fc5c01d5d643f335491a1b182d WatchSource:0}: Error finding container c5fdc2f588aaf9d671e657c10b82b95e264e08fc5c01d5d643f335491a1b182d: Status 404 returned error can't find the container with id c5fdc2f588aaf9d671e657c10b82b95e264e08fc5c01d5d643f335491a1b182d
Jul 17 05:41:33.574323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.574280    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9wklp" event={"ID":"31fc5cdd-7297-4c64-bdcd-98736362d319","Type":"ContainerStarted","Data":"893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd"}
Jul 17 05:41:33.574323 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.574329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9wklp" event={"ID":"31fc5cdd-7297-4c64-bdcd-98736362d319","Type":"ContainerStarted","Data":"69f38198314ec04d72dff92e9852714cac4ce84cec76534d20f3d365b81e9f5d"}
Jul 17 05:41:33.574573 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.574329    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-9wklp" podUID="31fc5cdd-7297-4c64-bdcd-98736362d319" containerName="authorino" containerID="cri-o://893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd" gracePeriod=30
Jul 17 05:41:33.575687 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.575652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756748d879-2f56l" event={"ID":"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05","Type":"ContainerStarted","Data":"c5fdc2f588aaf9d671e657c10b82b95e264e08fc5c01d5d643f335491a1b182d"}
Jul 17 05:41:33.575687 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.575681    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb474bd7-5ds8v"
Jul 17 05:41:33.591263 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.591239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb474bd7-5ds8v"
Jul 17 05:41:33.591697 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.591659    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-9wklp" podStartSLOduration=0.996818136 podStartE2EDuration="1.591647664s" totalImagesPullingTime="594.829528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:33.590132309 +0000 UTC m=+516.765533697" watchObservedRunningTime="2026-07-17 05:41:33.591647664 +0000 UTC m=+516.767049054"
Jul 17 05:41:33.674777 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.674753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt6j9\" (UniqueName: \"kubernetes.io/projected/53948dba-e0e8-44db-9614-5ac9a0301223-kube-api-access-mt6j9\") pod \"53948dba-e0e8-44db-9614-5ac9a0301223\" (UID: \"53948dba-e0e8-44db-9614-5ac9a0301223\") "
Jul 17 05:41:33.676551 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.676527    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53948dba-e0e8-44db-9614-5ac9a0301223-kube-api-access-mt6j9" (OuterVolumeSpecName: "kube-api-access-mt6j9") pod "53948dba-e0e8-44db-9614-5ac9a0301223" (UID: "53948dba-e0e8-44db-9614-5ac9a0301223"). InnerVolumeSpecName "kube-api-access-mt6j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:41:33.775728 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.775693    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt6j9\" (UniqueName: \"kubernetes.io/projected/53948dba-e0e8-44db-9614-5ac9a0301223-kube-api-access-mt6j9\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:41:33.842356 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.842326    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9wklp"
Jul 17 05:41:33.976611 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.976583    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq6lh\" (UniqueName: \"kubernetes.io/projected/31fc5cdd-7297-4c64-bdcd-98736362d319-kube-api-access-fq6lh\") pod \"31fc5cdd-7297-4c64-bdcd-98736362d319\" (UID: \"31fc5cdd-7297-4c64-bdcd-98736362d319\") "
Jul 17 05:41:33.978532 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:33.978509    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fc5cdd-7297-4c64-bdcd-98736362d319-kube-api-access-fq6lh" (OuterVolumeSpecName: "kube-api-access-fq6lh") pod "31fc5cdd-7297-4c64-bdcd-98736362d319" (UID: "31fc5cdd-7297-4c64-bdcd-98736362d319"). InnerVolumeSpecName "kube-api-access-fq6lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:41:34.078267 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.078193    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq6lh\" (UniqueName: \"kubernetes.io/projected/31fc5cdd-7297-4c64-bdcd-98736362d319-kube-api-access-fq6lh\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:41:34.581242 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.581203    2559 generic.go:356] "Generic (PLEG): container finished" podID="31fc5cdd-7297-4c64-bdcd-98736362d319" containerID="893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd" exitCode=0
Jul 17 05:41:34.581242 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.581248    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9wklp"
Jul 17 05:41:34.581439 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.581289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9wklp" event={"ID":"31fc5cdd-7297-4c64-bdcd-98736362d319","Type":"ContainerDied","Data":"893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd"}
Jul 17 05:41:34.581439 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.581342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9wklp" event={"ID":"31fc5cdd-7297-4c64-bdcd-98736362d319","Type":"ContainerDied","Data":"69f38198314ec04d72dff92e9852714cac4ce84cec76534d20f3d365b81e9f5d"}
Jul 17 05:41:34.581439 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.581365    2559 scope.go:117] "RemoveContainer" containerID="893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd"
Jul 17 05:41:34.583049 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.582988    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb474bd7-5ds8v"
Jul 17 05:41:34.583136 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.582988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756748d879-2f56l" event={"ID":"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05","Type":"ContainerStarted","Data":"55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e"}
Jul 17 05:41:34.590751 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.590731    2559 scope.go:117] "RemoveContainer" containerID="893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd"
Jul 17 05:41:34.591119 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:41:34.591089    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd\": container with ID starting with 893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd not found: ID does not exist" containerID="893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd"
Jul 17 05:41:34.591178 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.591118    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd"} err="failed to get container status \"893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd\": rpc error: code = NotFound desc = could not find container \"893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd\": container with ID starting with 893d008c0fa9a17787d00a82322acb5c49b9452a5a48b004137091052740fbcd not found: ID does not exist"
Jul 17 05:41:34.599812 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.599754    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-756748d879-2f56l" podStartSLOduration=2.106434125 podStartE2EDuration="2.59974198s" totalImagesPullingTime="493.307855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:34.599025007 +0000 UTC m=+517.774426395" watchObservedRunningTime="2026-07-17 05:41:34.59974198 +0000 UTC m=+517.775143367"
Jul 17 05:41:34.629712 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.629685    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fb474bd7-5ds8v"]
Jul 17 05:41:34.637138 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.637076    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7fb474bd7-5ds8v"]
Jul 17 05:41:34.648988 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.648958    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9wklp"]
Jul 17 05:41:34.651903 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:34.651882    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9wklp"]
Jul 17 05:41:35.325099 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:35.325066    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31fc5cdd-7297-4c64-bdcd-98736362d319" path="/var/lib/kubelet/pods/31fc5cdd-7297-4c64-bdcd-98736362d319/volumes"
Jul 17 05:41:35.325589 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:35.325565    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53948dba-e0e8-44db-9614-5ac9a0301223" path="/var/lib/kubelet/pods/53948dba-e0e8-44db-9614-5ac9a0301223/volumes"
Jul 17 05:41:39.669933 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.669895    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-rpfkm"]
Jul 17 05:41:39.670526 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.670262    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fc5cdd-7297-4c64-bdcd-98736362d319" containerName="authorino"
Jul 17 05:41:39.670526 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.670277    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fc5cdd-7297-4c64-bdcd-98736362d319" containerName="authorino"
Jul 17 05:41:39.670526 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.670375    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31fc5cdd-7297-4c64-bdcd-98736362d319" containerName="authorino"
Jul 17 05:41:39.685022 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.684992    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-rpfkm"]
Jul 17 05:41:39.685167 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.685134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:39.688136 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.688111    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 05:41:39.688334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.688130    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xcgwf\""
Jul 17 05:41:39.688417 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.688218    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 05:41:39.827281 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.827245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cx27\" (UniqueName: \"kubernetes.io/projected/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-kube-api-access-9cx27\") pod \"maas-controller-7994cc7dcc-rpfkm\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") " pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:39.827281 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.827287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert\") pod \"maas-controller-7994cc7dcc-rpfkm\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") " pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:39.927955 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.927845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cx27\" (UniqueName: \"kubernetes.io/projected/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-kube-api-access-9cx27\") pod \"maas-controller-7994cc7dcc-rpfkm\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") " pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:39.927955 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.927926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert\") pod \"maas-controller-7994cc7dcc-rpfkm\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") " pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:39.928143 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:41:39.928054    2559 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 17 05:41:39.928143 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:41:39.928111    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert podName:e8b110cf-2d13-4b62-ba24-cae8e93b6ac6 nodeName:}" failed. No retries permitted until 2026-07-17 05:41:40.428092075 +0000 UTC m=+523.603493458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert") pod "maas-controller-7994cc7dcc-rpfkm" (UID: "e8b110cf-2d13-4b62-ba24-cae8e93b6ac6") : secret "maas-controller-webhook-cert" not found
Jul 17 05:41:39.939216 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:39.939190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cx27\" (UniqueName: \"kubernetes.io/projected/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-kube-api-access-9cx27\") pod \"maas-controller-7994cc7dcc-rpfkm\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") " pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:40.431548 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:40.431511    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert\") pod \"maas-controller-7994cc7dcc-rpfkm\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") " pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:40.433988 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:40.433967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert\") pod \"maas-controller-7994cc7dcc-rpfkm\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") " pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:40.595972 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:40.595931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:40.728287 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:40.728264    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-rpfkm"]
Jul 17 05:41:40.730321 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:41:40.730277    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b110cf_2d13_4b62_ba24_cae8e93b6ac6.slice/crio-8169530a0ccdbfbe1a22360b9f7e555df95d709c26988d4dfd4ebb9f6fa0a979 WatchSource:0}: Error finding container 8169530a0ccdbfbe1a22360b9f7e555df95d709c26988d4dfd4ebb9f6fa0a979: Status 404 returned error can't find the container with id 8169530a0ccdbfbe1a22360b9f7e555df95d709c26988d4dfd4ebb9f6fa0a979
Jul 17 05:41:41.628153 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:41.628076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm" event={"ID":"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6","Type":"ContainerStarted","Data":"8169530a0ccdbfbe1a22360b9f7e555df95d709c26988d4dfd4ebb9f6fa0a979"}
Jul 17 05:41:43.642124 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:43.642081    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm" event={"ID":"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6","Type":"ContainerStarted","Data":"7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb"}
Jul 17 05:41:43.642654 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:43.642274    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:41:43.666255 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:43.666197    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm" podStartSLOduration=2.296473287 podStartE2EDuration="4.666174339s" totalImagesPullingTime="2.369701052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:41:43.663548092 +0000 UTC m=+526.838949481" watchObservedRunningTime="2026-07-17 05:41:43.666174339 +0000 UTC m=+526.841575728"
Jul 17 05:41:54.649753 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:41:54.649677    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:42:15.437447 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.437409    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"]
Jul 17 05:42:15.442394 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.442374    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.444749 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.444726    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 05:42:15.444862 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.444832    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cggjx\""
Jul 17 05:42:15.449671 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.449647    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"]
Jul 17 05:42:15.514164 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.514128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpspk\" (UniqueName: \"kubernetes.io/projected/2d5230b5-f55a-426b-a977-e10ae169411e-kube-api-access-lpspk\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.514360 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.514177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5230b5-f55a-426b-a977-e10ae169411e-openshift-service-ca\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.514360 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.514198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d5230b5-f55a-426b-a977-e10ae169411e-maas-api-tls\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.615310 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.615274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpspk\" (UniqueName: \"kubernetes.io/projected/2d5230b5-f55a-426b-a977-e10ae169411e-kube-api-access-lpspk\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.615472 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.615330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5230b5-f55a-426b-a977-e10ae169411e-openshift-service-ca\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.615472 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.615376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d5230b5-f55a-426b-a977-e10ae169411e-maas-api-tls\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.615919 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.615896    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5230b5-f55a-426b-a977-e10ae169411e-openshift-service-ca\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.617732 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.617715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d5230b5-f55a-426b-a977-e10ae169411e-maas-api-tls\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.623386 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.623366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpspk\" (UniqueName: \"kubernetes.io/projected/2d5230b5-f55a-426b-a977-e10ae169411e-kube-api-access-lpspk\") pod \"maas-api-6d6d9dd47b-s29nk\" (UID: \"2d5230b5-f55a-426b-a977-e10ae169411e\") " pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.755800 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.755716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:15.902039 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.902009    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"]
Jul 17 05:42:15.904066 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:42:15.904035    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5230b5_f55a_426b_a977_e10ae169411e.slice/crio-8b1834406f0cf4366103df075baac07b883d9637a448962170a2dbc7c2333675 WatchSource:0}: Error finding container 8b1834406f0cf4366103df075baac07b883d9637a448962170a2dbc7c2333675: Status 404 returned error can't find the container with id 8b1834406f0cf4366103df075baac07b883d9637a448962170a2dbc7c2333675
Jul 17 05:42:15.926375 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.926347    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qzclq"]
Jul 17 05:42:15.929689 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.929672    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:15.933342 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.933321    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 05:42:15.933461 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.933401    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2lwc7\""
Jul 17 05:42:15.942943 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.942917    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qzclq"]
Jul 17 05:42:15.955121 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.955094    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5xhml"]
Jul 17 05:42:15.958312 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.958282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:15.970576 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:15.970549    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5xhml"]
Jul 17 05:42:16.019595 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.019506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5xhml\" (UID: \"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16\") " pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:16.019595 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.019557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq7s2\" (UniqueName: \"kubernetes.io/projected/469f8e54-8905-4476-adb0-55df63351219-kube-api-access-tq7s2\") pod \"payload-pre-processing-7677b774bb-qzclq\" (UID: \"469f8e54-8905-4476-adb0-55df63351219\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:16.019825 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.019626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/469f8e54-8905-4476-adb0-55df63351219-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qzclq\" (UID: \"469f8e54-8905-4476-adb0-55df63351219\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:16.019825 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.019750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9r92\" (UniqueName: \"kubernetes.io/projected/ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16-kube-api-access-w9r92\") pod \"payload-processing-5bf47cd988-5xhml\" (UID: \"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16\") " pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:16.121043 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.120998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/469f8e54-8905-4476-adb0-55df63351219-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qzclq\" (UID: \"469f8e54-8905-4476-adb0-55df63351219\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:16.121222 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.121108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9r92\" (UniqueName: \"kubernetes.io/projected/ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16-kube-api-access-w9r92\") pod \"payload-processing-5bf47cd988-5xhml\" (UID: \"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16\") " pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:16.121222 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.121187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5xhml\" (UID: \"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16\") " pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:16.121222 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.121217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq7s2\" (UniqueName: \"kubernetes.io/projected/469f8e54-8905-4476-adb0-55df63351219-kube-api-access-tq7s2\") pod \"payload-pre-processing-7677b774bb-qzclq\" (UID: \"469f8e54-8905-4476-adb0-55df63351219\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:16.121811 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.121790    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/469f8e54-8905-4476-adb0-55df63351219-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qzclq\" (UID: \"469f8e54-8905-4476-adb0-55df63351219\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:16.121952 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.121934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5xhml\" (UID: \"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16\") " pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:16.132484 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.132446    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq7s2\" (UniqueName: \"kubernetes.io/projected/469f8e54-8905-4476-adb0-55df63351219-kube-api-access-tq7s2\") pod \"payload-pre-processing-7677b774bb-qzclq\" (UID: \"469f8e54-8905-4476-adb0-55df63351219\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:16.132707 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.132685    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9r92\" (UniqueName: \"kubernetes.io/projected/ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16-kube-api-access-w9r92\") pod \"payload-processing-5bf47cd988-5xhml\" (UID: \"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16\") " pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:16.240941 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.240906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:16.269718 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.269626    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:16.388760 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.388729    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qzclq"]
Jul 17 05:42:16.391533 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:42:16.391502    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469f8e54_8905_4476_adb0_55df63351219.slice/crio-f8f2adfd58540d15bcfe676345a7df7d95274a04613aa3606762ec2bf5eac97e WatchSource:0}: Error finding container f8f2adfd58540d15bcfe676345a7df7d95274a04613aa3606762ec2bf5eac97e: Status 404 returned error can't find the container with id f8f2adfd58540d15bcfe676345a7df7d95274a04613aa3606762ec2bf5eac97e
Jul 17 05:42:16.421292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.421265    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5xhml"]
Jul 17 05:42:16.421587 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:42:16.421566    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3d2ea1_186c_4dfa_bc0b_8a3207d53a16.slice/crio-9286607101fe535bb01d7c6c2b794b2b5962475510aed944893f7c4e5affe1ae WatchSource:0}: Error finding container 9286607101fe535bb01d7c6c2b794b2b5962475510aed944893f7c4e5affe1ae: Status 404 returned error can't find the container with id 9286607101fe535bb01d7c6c2b794b2b5962475510aed944893f7c4e5affe1ae
Jul 17 05:42:16.800631 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.800586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk" event={"ID":"2d5230b5-f55a-426b-a977-e10ae169411e","Type":"ContainerStarted","Data":"8b1834406f0cf4366103df075baac07b883d9637a448962170a2dbc7c2333675"}
Jul 17 05:42:16.802003 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.801970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-5xhml" event={"ID":"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16","Type":"ContainerStarted","Data":"9286607101fe535bb01d7c6c2b794b2b5962475510aed944893f7c4e5affe1ae"}
Jul 17 05:42:16.803601 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:16.803571    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq" event={"ID":"469f8e54-8905-4476-adb0-55df63351219","Type":"ContainerStarted","Data":"f8f2adfd58540d15bcfe676345a7df7d95274a04613aa3606762ec2bf5eac97e"}
Jul 17 05:42:18.820217 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.820177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-5xhml" event={"ID":"ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16","Type":"ContainerStarted","Data":"99ec34f69d6a17f961282a24a0492538aaf8480f2a4e616e4b361214f462abeb"}
Jul 17 05:42:18.820600 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.820391    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:18.821760 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.821735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq" event={"ID":"469f8e54-8905-4476-adb0-55df63351219","Type":"ContainerStarted","Data":"ec9e13286cf7a9471fe8b3d83de2ceb5be65c00d5db6f12d69504d975f15d600"}
Jul 17 05:42:18.822148 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.822132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:18.824083 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.823955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk" event={"ID":"2d5230b5-f55a-426b-a977-e10ae169411e","Type":"ContainerStarted","Data":"d3486824782f0e787d41127232c2ceca56a58e4ba212ccf15eabd788c2add327"}
Jul 17 05:42:18.824450 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.824399    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:18.838755 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.838701    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-5xhml" podStartSLOduration=1.559823623 podStartE2EDuration="3.838673706s" totalImagesPullingTime="2.278850083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:42:18.835798774 +0000 UTC m=+562.011200255" watchObservedRunningTime="2026-07-17 05:42:18.838673706 +0000 UTC m=+562.014075094"
Jul 17 05:42:18.851829 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.851785    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk" podStartSLOduration=1.622147045 podStartE2EDuration="3.851770505s" totalImagesPullingTime="2.22962346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:42:18.850785178 +0000 UTC m=+562.026186566" watchObservedRunningTime="2026-07-17 05:42:18.851770505 +0000 UTC m=+562.027171893"
Jul 17 05:42:18.875895 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:18.870156    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq" podStartSLOduration=1.567496609 podStartE2EDuration="3.87013259s" totalImagesPullingTime="2.302635981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:42:18.867209212 +0000 UTC m=+562.042610600" watchObservedRunningTime="2026-07-17 05:42:18.87013259 +0000 UTC m=+562.045533979"
Jul 17 05:42:23.852771 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:23.852739    2559 generic.go:356] "Generic (PLEG): container finished" podID="216d117f-cbc9-437b-a3ca-382748a4994e" containerID="181778f52ee0e68416555076342563ecf59ab5a780213a033a4dfc6cc2579844" exitCode=0
Jul 17 05:42:23.853227 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:23.852811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" event={"ID":"216d117f-cbc9-437b-a3ca-382748a4994e","Type":"ContainerDied","Data":"181778f52ee0e68416555076342563ecf59ab5a780213a033a4dfc6cc2579844"}
Jul 17 05:42:23.853227 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:23.853218    2559 scope.go:117] "RemoveContainer" containerID="181778f52ee0e68416555076342563ecf59ab5a780213a033a4dfc6cc2579844"
Jul 17 05:42:23.854281 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:23.854255    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:42:23.854351 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:23.854336    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:42:23.854404 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:23.854375    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:42:24.860013 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:24.859976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" event={"ID":"216d117f-cbc9-437b-a3ca-382748a4994e","Type":"ContainerStarted","Data":"fa65544cad4c5f07dfbd4d54e2b93831dbbb3ba89eb732e827bb41e4c5a0b8d3"}
Jul 17 05:42:25.590360 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:25.590320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:42:25.590582 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:25.590556    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nzjms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 17 05:42:25.590636 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:25.590611    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" podUID="216d117f-cbc9-437b-a3ca-382748a4994e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 17 05:42:25.843020 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:25.842940    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d6d9dd47b-s29nk"
Jul 17 05:42:26.590617 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:26.590227    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nzjms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 17 05:42:26.590617 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:26.590282    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" podUID="216d117f-cbc9-437b-a3ca-382748a4994e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 17 05:42:27.589850 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:27.589807    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nzjms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 17 05:42:27.590075 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:27.589908    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" podUID="216d117f-cbc9-437b-a3ca-382748a4994e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 17 05:42:28.589735 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:28.589695    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nzjms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 17 05:42:28.590142 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:28.589771    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms" podUID="216d117f-cbc9-437b-a3ca-382748a4994e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 17 05:42:29.593959 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:29.593929    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:42:29.594436 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:29.594208    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:42:29.595029 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:29.595009    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nzjms"
Jul 17 05:42:29.831499 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:29.831466    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-5xhml"
Jul 17 05:42:30.839268 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:30.839236    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qzclq"
Jul 17 05:42:57.260292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:57.260264    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:42:57.261231 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:42:57.261208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:43:15.620565 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.620528    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"]
Jul 17 05:43:15.624480 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.624459    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.627057 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.627033    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 05:43:15.628115 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.628095    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 05:43:15.628220 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.628100    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 05:43:15.628220 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.628141    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vzdzz\""
Jul 17 05:43:15.632673 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.632652    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"]
Jul 17 05:43:15.646186 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.646157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.646290 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.646188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.646290 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.646209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.646412 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.646368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj65d\" (UniqueName: \"kubernetes.io/projected/3000844f-7011-472d-b5b4-8959aef4a4b8-kube-api-access-nj65d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.646464 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.646411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.646533 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.646508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3000844f-7011-472d-b5b4-8959aef4a4b8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747141 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj65d\" (UniqueName: \"kubernetes.io/projected/3000844f-7011-472d-b5b4-8959aef4a4b8-kube-api-access-nj65d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747339 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747339 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3000844f-7011-472d-b5b4-8959aef4a4b8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747339 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747339 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747339 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747605 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747672 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.747758 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.747739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.749578 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.749557    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3000844f-7011-472d-b5b4-8959aef4a4b8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.749818 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.749802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3000844f-7011-472d-b5b4-8959aef4a4b8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.754792 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.754772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj65d\" (UniqueName: \"kubernetes.io/projected/3000844f-7011-472d-b5b4-8959aef4a4b8-kube-api-access-nj65d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v\" (UID: \"3000844f-7011-472d-b5b4-8959aef4a4b8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:15.935604 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:15.935504    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:16.072677 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:16.072654    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"]
Jul 17 05:43:16.074828 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:43:16.074804    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3000844f_7011_472d_b5b4_8959aef4a4b8.slice/crio-3447f57b7615b371fa5079ce63951e02b454d1f3769adfef5513826440e2ea70 WatchSource:0}: Error finding container 3447f57b7615b371fa5079ce63951e02b454d1f3769adfef5513826440e2ea70: Status 404 returned error can't find the container with id 3447f57b7615b371fa5079ce63951e02b454d1f3769adfef5513826440e2ea70
Jul 17 05:43:16.076520 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:16.076500    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:43:16.118406 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:16.118372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v" event={"ID":"3000844f-7011-472d-b5b4-8959aef4a4b8","Type":"ContainerStarted","Data":"3447f57b7615b371fa5079ce63951e02b454d1f3769adfef5513826440e2ea70"}
Jul 17 05:43:18.129802 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:18.129762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v" event={"ID":"3000844f-7011-472d-b5b4-8959aef4a4b8","Type":"ContainerStarted","Data":"584f5cc971cf92ac1e8255010bf8c1694928726dfeab1dc56505718c19f23703"}
Jul 17 05:43:18.147496 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:18.147425    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v" podStartSLOduration=2.110043324 podStartE2EDuration="3.14740999s" totalImagesPullingTime="1.037366666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:43:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:43:18.146568094 +0000 UTC m=+621.321969482" watchObservedRunningTime="2026-07-17 05:43:18.14740999 +0000 UTC m=+621.322811377"
Jul 17 05:43:25.936664 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:25.936575    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:25.936664 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:25.936641    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:25.949191 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:25.949168    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:26.185623 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:26.185589    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v"
Jul 17 05:43:30.213232 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.213200    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"]
Jul 17 05:43:30.217075 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.217052    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.219575 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.219557    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 17 05:43:30.227780 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.227754    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"]
Jul 17 05:43:30.273401 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.273368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7qj\" (UniqueName: \"kubernetes.io/projected/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-kube-api-access-7n7qj\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.273544 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.273419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.273544 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.273454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.273544 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.273474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.273650 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.273568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.273650 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.273601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.374376 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.374336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.374562 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.374385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.374562 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.374421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.374562 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.374494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.374562 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.374527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.374819 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.374647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7qj\" (UniqueName: \"kubernetes.io/projected/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-kube-api-access-7n7qj\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.375074 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.375041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.375251 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.375201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.375465 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.375428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.377502 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.377476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.377715 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.377692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.383365 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.383334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7qj\" (UniqueName: \"kubernetes.io/projected/1a6a1204-39a6-4994-aa09-f0fc52b15b4d-kube-api-access-7n7qj\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr\" (UID: \"1a6a1204-39a6-4994-aa09-f0fc52b15b4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.529482 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.529401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:30.660802 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:30.660774    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"]
Jul 17 05:43:30.662693 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:43:30.662667    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a6a1204_39a6_4994_aa09_f0fc52b15b4d.slice/crio-4c2e6b48e055f28e4a0afe9c50f91b89beb72de702cc7b8bdab449c8fc051570 WatchSource:0}: Error finding container 4c2e6b48e055f28e4a0afe9c50f91b89beb72de702cc7b8bdab449c8fc051570: Status 404 returned error can't find the container with id 4c2e6b48e055f28e4a0afe9c50f91b89beb72de702cc7b8bdab449c8fc051570
Jul 17 05:43:31.194972 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:31.194864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr" event={"ID":"1a6a1204-39a6-4994-aa09-f0fc52b15b4d","Type":"ContainerStarted","Data":"428ad9d20712d247422d1b96d919030a2d4b5a4f6b95f4b530c503b40c8bf1a2"}
Jul 17 05:43:31.194972 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:31.194919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr" event={"ID":"1a6a1204-39a6-4994-aa09-f0fc52b15b4d","Type":"ContainerStarted","Data":"4c2e6b48e055f28e4a0afe9c50f91b89beb72de702cc7b8bdab449c8fc051570"}
Jul 17 05:43:31.212162 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:31.212107    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr" podStartSLOduration=1.051231343 podStartE2EDuration="1.212090354s" totalImagesPullingTime="160.859011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:43:31.211219554 +0000 UTC m=+634.386620945" watchObservedRunningTime="2026-07-17 05:43:31.212090354 +0000 UTC m=+634.387491742"
Jul 17 05:43:40.530092 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:40.530059    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:40.530568 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:40.530421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:40.542930 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:40.542904    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:43:41.257339 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:43:41.257301    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr"
Jul 17 05:44:38.687129 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.687087    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65cf699f86-ndt5s"]
Jul 17 05:44:38.690937 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.690912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:38.697419 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.697388    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65cf699f86-ndt5s"]
Jul 17 05:44:38.710964 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.710930    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rct7\" (UniqueName: \"kubernetes.io/projected/53f59a22-f577-41a7-b7c0-65058d47b613-kube-api-access-7rct7\") pod \"authorino-65cf699f86-ndt5s\" (UID: \"53f59a22-f577-41a7-b7c0-65058d47b613\") " pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:38.711083 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.711051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53f59a22-f577-41a7-b7c0-65058d47b613-tls-cert\") pod \"authorino-65cf699f86-ndt5s\" (UID: \"53f59a22-f577-41a7-b7c0-65058d47b613\") " pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:38.812065 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.812029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53f59a22-f577-41a7-b7c0-65058d47b613-tls-cert\") pod \"authorino-65cf699f86-ndt5s\" (UID: \"53f59a22-f577-41a7-b7c0-65058d47b613\") " pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:38.812265 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.812076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rct7\" (UniqueName: \"kubernetes.io/projected/53f59a22-f577-41a7-b7c0-65058d47b613-kube-api-access-7rct7\") pod \"authorino-65cf699f86-ndt5s\" (UID: \"53f59a22-f577-41a7-b7c0-65058d47b613\") " pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:38.815041 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.815018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53f59a22-f577-41a7-b7c0-65058d47b613-tls-cert\") pod \"authorino-65cf699f86-ndt5s\" (UID: \"53f59a22-f577-41a7-b7c0-65058d47b613\") " pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:38.822831 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:38.822811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rct7\" (UniqueName: \"kubernetes.io/projected/53f59a22-f577-41a7-b7c0-65058d47b613-kube-api-access-7rct7\") pod \"authorino-65cf699f86-ndt5s\" (UID: \"53f59a22-f577-41a7-b7c0-65058d47b613\") " pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:39.002905 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:39.002796    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cf699f86-ndt5s"
Jul 17 05:44:39.192621 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:39.192583    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65cf699f86-ndt5s"]
Jul 17 05:44:39.196257 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:44:39.196215    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53f59a22_f577_41a7_b7c0_65058d47b613.slice/crio-e1143508e1450062cf29007634f3d95d5f34a2e5574fca00823f0af9ed1533f3 WatchSource:0}: Error finding container e1143508e1450062cf29007634f3d95d5f34a2e5574fca00823f0af9ed1533f3: Status 404 returned error can't find the container with id e1143508e1450062cf29007634f3d95d5f34a2e5574fca00823f0af9ed1533f3
Jul 17 05:44:39.527392 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:39.527347    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cf699f86-ndt5s" event={"ID":"53f59a22-f577-41a7-b7c0-65058d47b613","Type":"ContainerStarted","Data":"e1143508e1450062cf29007634f3d95d5f34a2e5574fca00823f0af9ed1533f3"}
Jul 17 05:44:40.535416 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.535367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cf699f86-ndt5s" event={"ID":"53f59a22-f577-41a7-b7c0-65058d47b613","Type":"ContainerStarted","Data":"495f2cc25537f7a5d8734f37557abeeb3983e9f4888783fddc6ce4b7592a97f0"}
Jul 17 05:44:40.586069 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.586011    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65cf699f86-ndt5s" podStartSLOduration=1.8811693790000001 podStartE2EDuration="2.585991501s" totalImagesPullingTime="704.822122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:44:40.559012507 +0000 UTC m=+703.734413896" watchObservedRunningTime="2026-07-17 05:44:40.585991501 +0000 UTC m=+703.761392888"
Jul 17 05:44:40.587255 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.587225    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-756748d879-2f56l"]
Jul 17 05:44:40.587549 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.587506    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-756748d879-2f56l" podUID="41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" containerName="authorino" containerID="cri-o://55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e" gracePeriod=30
Jul 17 05:44:40.874498 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.874470    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:44:40.932353 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.932314    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-tls-cert\") pod \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") "
Jul 17 05:44:40.932550 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.932381    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h554\" (UniqueName: \"kubernetes.io/projected/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-kube-api-access-5h554\") pod \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\" (UID: \"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05\") "
Jul 17 05:44:40.935053 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.935019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-kube-api-access-5h554" (OuterVolumeSpecName: "kube-api-access-5h554") pod "41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" (UID: "41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05"). InnerVolumeSpecName "kube-api-access-5h554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:44:40.944138 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:40.944100    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" (UID: "41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:44:41.033680 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.033642    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-tls-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:44:41.033680 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.033674    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h554\" (UniqueName: \"kubernetes.io/projected/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05-kube-api-access-5h554\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:44:41.541983 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.541944    2559 generic.go:356] "Generic (PLEG): container finished" podID="41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" containerID="55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e" exitCode=0
Jul 17 05:44:41.542471 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.542004    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756748d879-2f56l"
Jul 17 05:44:41.542471 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.542024    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756748d879-2f56l" event={"ID":"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05","Type":"ContainerDied","Data":"55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e"}
Jul 17 05:44:41.542471 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.542083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756748d879-2f56l" event={"ID":"41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05","Type":"ContainerDied","Data":"c5fdc2f588aaf9d671e657c10b82b95e264e08fc5c01d5d643f335491a1b182d"}
Jul 17 05:44:41.542471 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.542116    2559 scope.go:117] "RemoveContainer" containerID="55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e"
Jul 17 05:44:41.553141 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.553117    2559 scope.go:117] "RemoveContainer" containerID="55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e"
Jul 17 05:44:41.553485 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:44:41.553452    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e\": container with ID starting with 55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e not found: ID does not exist" containerID="55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e"
Jul 17 05:44:41.553572 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.553491    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e"} err="failed to get container status \"55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e\": rpc error: code = NotFound desc = could not find container \"55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e\": container with ID starting with 55ee3d373818c9c7a11937646867db51bb9306aac4b2083f49267a8257ccea5e not found: ID does not exist"
Jul 17 05:44:41.560357 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.560331    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-756748d879-2f56l"]
Jul 17 05:44:41.562586 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:41.562560    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-756748d879-2f56l"]
Jul 17 05:44:43.324549 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:44:43.324518    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" path="/var/lib/kubelet/pods/41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05/volumes"
Jul 17 05:45:26.247398 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.247353    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-rpfkm"]
Jul 17 05:45:26.247947 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.247650    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm" podUID="e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" containerName="manager" containerID="cri-o://7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb" gracePeriod=30
Jul 17 05:45:26.502920 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.502838    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:45:26.554500 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.554466    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cx27\" (UniqueName: \"kubernetes.io/projected/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-kube-api-access-9cx27\") pod \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") "
Jul 17 05:45:26.554649 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.554528    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert\") pod \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\" (UID: \"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6\") "
Jul 17 05:45:26.556632 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.556601    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" (UID: "e8b110cf-2d13-4b62-ba24-cae8e93b6ac6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:45:26.556632 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.556613    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-kube-api-access-9cx27" (OuterVolumeSpecName: "kube-api-access-9cx27") pod "e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" (UID: "e8b110cf-2d13-4b62-ba24-cae8e93b6ac6"). InnerVolumeSpecName "kube-api-access-9cx27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:26.656235 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.656205    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cx27\" (UniqueName: \"kubernetes.io/projected/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-kube-api-access-9cx27\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:45:26.656235 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.656231    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6-webhook-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:45:26.769610 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.769526    2559 generic.go:356] "Generic (PLEG): container finished" podID="e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" containerID="7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb" exitCode=0
Jul 17 05:45:26.769610 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.769564    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm"
Jul 17 05:45:26.769773 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.769611    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm" event={"ID":"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6","Type":"ContainerDied","Data":"7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb"}
Jul 17 05:45:26.769773 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.769664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-rpfkm" event={"ID":"e8b110cf-2d13-4b62-ba24-cae8e93b6ac6","Type":"ContainerDied","Data":"8169530a0ccdbfbe1a22360b9f7e555df95d709c26988d4dfd4ebb9f6fa0a979"}
Jul 17 05:45:26.769773 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.769694    2559 scope.go:117] "RemoveContainer" containerID="7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb"
Jul 17 05:45:26.781369 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.781350    2559 scope.go:117] "RemoveContainer" containerID="7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb"
Jul 17 05:45:26.781667 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:45:26.781648    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb\": container with ID starting with 7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb not found: ID does not exist" containerID="7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb"
Jul 17 05:45:26.781732 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.781678    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb"} err="failed to get container status \"7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb\": rpc error: code = NotFound desc = could not find container \"7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb\": container with ID starting with 7d63556a0438be96608f358739848c8ef3b6edc469d0da6295a832817358f7cb not found: ID does not exist"
Jul 17 05:45:26.795126 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.795102    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-rpfkm"]
Jul 17 05:45:26.798817 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:26.798797    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-rpfkm"]
Jul 17 05:45:27.324569 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:45:27.324534    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" path="/var/lib/kubelet/pods/e8b110cf-2d13-4b62-ba24-cae8e93b6ac6/volumes"
Jul 17 05:46:27.662926 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.662846    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-blbgs"]
Jul 17 05:46:27.663329 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.663269    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" containerName="manager"
Jul 17 05:46:27.663329 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.663280    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" containerName="manager"
Jul 17 05:46:27.663329 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.663289    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" containerName="authorino"
Jul 17 05:46:27.663329 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.663294    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" containerName="authorino"
Jul 17 05:46:27.663458 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.663347    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="41353bf1-4bbd-4bdd-ac1f-2d750d6c5c05" containerName="authorino"
Jul 17 05:46:27.663458 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.663355    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8b110cf-2d13-4b62-ba24-cae8e93b6ac6" containerName="manager"
Jul 17 05:46:27.666415 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.666395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:27.669124 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.669099    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 05:46:27.670467 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.670447    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 05:46:27.670568 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.670504    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xcgwf\""
Jul 17 05:46:27.675975 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.675918    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-blbgs"]
Jul 17 05:46:27.693788 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.693749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49cf5\" (UniqueName: \"kubernetes.io/projected/22171315-df73-4879-9319-5d5821fabedd-kube-api-access-49cf5\") pod \"maas-controller-7994cc7dcc-blbgs\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") " pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:27.693950 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.693826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171315-df73-4879-9319-5d5821fabedd-webhook-cert\") pod \"maas-controller-7994cc7dcc-blbgs\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") " pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:27.795143 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.795091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49cf5\" (UniqueName: \"kubernetes.io/projected/22171315-df73-4879-9319-5d5821fabedd-kube-api-access-49cf5\") pod \"maas-controller-7994cc7dcc-blbgs\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") " pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:27.795334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.795177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171315-df73-4879-9319-5d5821fabedd-webhook-cert\") pod \"maas-controller-7994cc7dcc-blbgs\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") " pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:27.797552 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.797523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171315-df73-4879-9319-5d5821fabedd-webhook-cert\") pod \"maas-controller-7994cc7dcc-blbgs\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") " pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:27.805707 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.805680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49cf5\" (UniqueName: \"kubernetes.io/projected/22171315-df73-4879-9319-5d5821fabedd-kube-api-access-49cf5\") pod \"maas-controller-7994cc7dcc-blbgs\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") " pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:27.978604 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:27.978509    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:28.116574 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:28.116551    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-blbgs"]
Jul 17 05:46:28.118243 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:46:28.118216    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22171315_df73_4879_9319_5d5821fabedd.slice/crio-a26f6ce72fea132ddccb2b5caee3bef54cb48d8c4a7937e117d2c75c85feb80e WatchSource:0}: Error finding container a26f6ce72fea132ddccb2b5caee3bef54cb48d8c4a7937e117d2c75c85feb80e: Status 404 returned error can't find the container with id a26f6ce72fea132ddccb2b5caee3bef54cb48d8c4a7937e117d2c75c85feb80e
Jul 17 05:46:29.077697 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:29.077656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-blbgs" event={"ID":"22171315-df73-4879-9319-5d5821fabedd","Type":"ContainerStarted","Data":"25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040"}
Jul 17 05:46:29.078134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:29.077729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:29.078134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:29.077748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-blbgs" event={"ID":"22171315-df73-4879-9319-5d5821fabedd","Type":"ContainerStarted","Data":"a26f6ce72fea132ddccb2b5caee3bef54cb48d8c4a7937e117d2c75c85feb80e"}
Jul 17 05:46:29.100117 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:29.100057    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7994cc7dcc-blbgs" podStartSLOduration=1.471980009 podStartE2EDuration="2.100036168s" totalImagesPullingTime="628.056159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:46:29.097649148 +0000 UTC m=+812.273050548" watchObservedRunningTime="2026-07-17 05:46:29.100036168 +0000 UTC m=+812.275437556"
Jul 17 05:46:40.084912 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:40.084851    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:44.790292 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:44.790259    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-blbgs"]
Jul 17 05:46:44.790940 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:44.790483    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7994cc7dcc-blbgs" podUID="22171315-df73-4879-9319-5d5821fabedd" containerName="manager" containerID="cri-o://25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040" gracePeriod=30
Jul 17 05:46:45.041237 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.041162    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:45.153122 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.153075    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49cf5\" (UniqueName: \"kubernetes.io/projected/22171315-df73-4879-9319-5d5821fabedd-kube-api-access-49cf5\") pod \"22171315-df73-4879-9319-5d5821fabedd\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") "
Jul 17 05:46:45.153321 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.153135    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171315-df73-4879-9319-5d5821fabedd-webhook-cert\") pod \"22171315-df73-4879-9319-5d5821fabedd\" (UID: \"22171315-df73-4879-9319-5d5821fabedd\") "
Jul 17 05:46:45.155258 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.155223    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22171315-df73-4879-9319-5d5821fabedd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "22171315-df73-4879-9319-5d5821fabedd" (UID: "22171315-df73-4879-9319-5d5821fabedd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:46:45.155557 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.155531    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22171315-df73-4879-9319-5d5821fabedd-kube-api-access-49cf5" (OuterVolumeSpecName: "kube-api-access-49cf5") pod "22171315-df73-4879-9319-5d5821fabedd" (UID: "22171315-df73-4879-9319-5d5821fabedd"). InnerVolumeSpecName "kube-api-access-49cf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:46:45.159770 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.159730    2559 generic.go:356] "Generic (PLEG): container finished" podID="22171315-df73-4879-9319-5d5821fabedd" containerID="25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040" exitCode=0
Jul 17 05:46:45.159907 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.159780    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7994cc7dcc-blbgs"
Jul 17 05:46:45.159907 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.159802    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-blbgs" event={"ID":"22171315-df73-4879-9319-5d5821fabedd","Type":"ContainerDied","Data":"25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040"}
Jul 17 05:46:45.159907 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.159861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7994cc7dcc-blbgs" event={"ID":"22171315-df73-4879-9319-5d5821fabedd","Type":"ContainerDied","Data":"a26f6ce72fea132ddccb2b5caee3bef54cb48d8c4a7937e117d2c75c85feb80e"}
Jul 17 05:46:45.159907 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.159902    2559 scope.go:117] "RemoveContainer" containerID="25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040"
Jul 17 05:46:45.175113 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.175090    2559 scope.go:117] "RemoveContainer" containerID="25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040"
Jul 17 05:46:45.175456 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:46:45.175432    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040\": container with ID starting with 25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040 not found: ID does not exist" containerID="25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040"
Jul 17 05:46:45.175523 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.175470    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040"} err="failed to get container status \"25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040\": rpc error: code = NotFound desc = could not find container \"25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040\": container with ID starting with 25f748adb423e8875d954e9c9d718f0922b3ca5f282d988f2f5debd556a35040 not found: ID does not exist"
Jul 17 05:46:45.186276 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.186245    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-blbgs"]
Jul 17 05:46:45.190217 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.190189    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7994cc7dcc-blbgs"]
Jul 17 05:46:45.254039 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.253994    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49cf5\" (UniqueName: \"kubernetes.io/projected/22171315-df73-4879-9319-5d5821fabedd-kube-api-access-49cf5\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:46:45.254039 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.254030    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171315-df73-4879-9319-5d5821fabedd-webhook-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 05:46:45.324253 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:46:45.324217    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22171315-df73-4879-9319-5d5821fabedd" path="/var/lib/kubelet/pods/22171315-df73-4879-9319-5d5821fabedd/volumes"
Jul 17 05:47:57.290368 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:47:57.290267    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:47:57.291610 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:47:57.291585    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:52:57.319373 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:52:57.319341    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:52:57.322655 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:52:57.322629    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:57:57.347110 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:57:57.347079    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:57:57.351557 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:57:57.351533    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 05:58:26.820062 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.819981    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"]
Jul 17 05:58:26.820512 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.820363    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22171315-df73-4879-9319-5d5821fabedd" containerName="manager"
Jul 17 05:58:26.820512 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.820374    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="22171315-df73-4879-9319-5d5821fabedd" containerName="manager"
Jul 17 05:58:26.820512 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.820472    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="22171315-df73-4879-9319-5d5821fabedd" containerName="manager"
Jul 17 05:58:26.823620 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.823603    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.826324 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.826294    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-81346fa0-openshift-default-dockercfg-94bzg\""
Jul 17 05:58:26.843152 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.843123    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"]
Jul 17 05:58:26.903339 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903300    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-data\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903525 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-certs\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903525 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-istio-token\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903525 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e249c96-c542-4135-b9f3-f0437cd42348-istiod-ca-cert\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903525 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-credential-socket\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903525 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-socket\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903525 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903501    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e249c96-c542-4135-b9f3-f0437cd42348-istio-podinfo\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903779 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltmpv\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-kube-api-access-ltmpv\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:26.903779 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:26.903581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-envoy\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-data\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004334 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-certs\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004555 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-istio-token\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004604 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e249c96-c542-4135-b9f3-f0437cd42348-istiod-ca-cert\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004656 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-credential-socket\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004813 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-socket\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004914 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004823    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-data\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004914 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e249c96-c542-4135-b9f3-f0437cd42348-istio-podinfo\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004914 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-certs\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.004914 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltmpv\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-kube-api-access-ltmpv\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.005134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-credential-socket\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.005134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.004948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-envoy\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.005134 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.005096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-socket\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.005394 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.005374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e249c96-c542-4135-b9f3-f0437cd42348-istiod-ca-cert\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.007168 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.007144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-envoy\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.007332 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.007318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e249c96-c542-4135-b9f3-f0437cd42348-istio-podinfo\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.012140 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.012115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-istio-token\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.012246 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.012228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltmpv\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-kube-api-access-ltmpv\") pod \"e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") " pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.134082 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.133993    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:27.274082 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.274050    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"]
Jul 17 05:58:27.276155 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:58:27.276122    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e249c96_c542_4135_b9f3_f0437cd42348.slice/crio-f964f86da6e757bedef19f341e39170874e11ca3a5f45c77d8d7ca26b7a22a67 WatchSource:0}: Error finding container f964f86da6e757bedef19f341e39170874e11ca3a5f45c77d8d7ca26b7a22a67: Status 404 returned error can't find the container with id f964f86da6e757bedef19f341e39170874e11ca3a5f45c77d8d7ca26b7a22a67
Jul 17 05:58:27.278431 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.278396    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:58:27.278530 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.278462    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:58:27.278530 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.278489    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:58:27.627363 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.627328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" event={"ID":"4e249c96-c542-4135-b9f3-f0437cd42348","Type":"ContainerStarted","Data":"258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a"}
Jul 17 05:58:27.627594 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.627384    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" event={"ID":"4e249c96-c542-4135-b9f3-f0437cd42348","Type":"ContainerStarted","Data":"f964f86da6e757bedef19f341e39170874e11ca3a5f45c77d8d7ca26b7a22a67"}
Jul 17 05:58:27.651414 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:27.651362    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" podStartSLOduration=1.6513455289999999 podStartE2EDuration="1.651345529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:58:27.648969496 +0000 UTC m=+1530.824370885" watchObservedRunningTime="2026-07-17 05:58:27.651345529 +0000 UTC m=+1530.826746919"
Jul 17 05:58:28.085099 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.085069    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"]
Jul 17 05:58:28.088442 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.088423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.093138 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.093110    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-81346fa0-serving-cert\""
Jul 17 05:58:28.100904 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.100882    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"]
Jul 17 05:58:28.134932 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.134902    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:28.139811 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.139787    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:28.215618 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.215583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-openshift-service-ca\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.215758 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.215645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-maas-api-tls\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.215758 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.215673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ltwn\" (UniqueName: \"kubernetes.io/projected/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-kube-api-access-9ltwn\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.316787 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.316748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-openshift-service-ca\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.316983 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.316803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-maas-api-tls\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.316983 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.316823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ltwn\" (UniqueName: \"kubernetes.io/projected/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-kube-api-access-9ltwn\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.317561 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.317539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-openshift-service-ca\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.319291 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.319258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-maas-api-tls\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.349322 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.349256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ltwn\" (UniqueName: \"kubernetes.io/projected/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-kube-api-access-9ltwn\") pod \"maas-api-e2e-ait-81346fa0-54df764b6b-6q99p\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.400745 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.400712    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:28.537978 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.537927    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"]
Jul 17 05:58:28.538915 ip-10-0-128-37 kubenswrapper[2559]: W0717 05:58:28.538864    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6ac773_0751_4a0a_a63a_99c44fd4a23d.slice/crio-41f18bc5d291c9e97cec0d863d09f753a46f02ef8b1373562d53ac5660c4296f WatchSource:0}: Error finding container 41f18bc5d291c9e97cec0d863d09f753a46f02ef8b1373562d53ac5660c4296f: Status 404 returned error can't find the container with id 41f18bc5d291c9e97cec0d863d09f753a46f02ef8b1373562d53ac5660c4296f
Jul 17 05:58:28.540251 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.540234    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:58:28.634187 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.634099    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerStarted","Data":"41f18bc5d291c9e97cec0d863d09f753a46f02ef8b1373562d53ac5660c4296f"}
Jul 17 05:58:28.634472 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.634449    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:28.635503 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:28.635484    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:29.640152 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:29.640114    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerID="1491a08bb7bf05342b9133ecdf8a50f05a5e30de0f88d14aab2f230ad5874a4e" exitCode=1
Jul 17 05:58:29.640530 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:29.640209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerDied","Data":"1491a08bb7bf05342b9133ecdf8a50f05a5e30de0f88d14aab2f230ad5874a4e"}
Jul 17 05:58:29.640530 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:29.640461    2559 scope.go:117] "RemoveContainer" containerID="1491a08bb7bf05342b9133ecdf8a50f05a5e30de0f88d14aab2f230ad5874a4e"
Jul 17 05:58:30.647268 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:30.647236    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerID="9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5" exitCode=1
Jul 17 05:58:30.647706 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:30.647321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerDied","Data":"9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5"}
Jul 17 05:58:30.647706 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:30.647374    2559 scope.go:117] "RemoveContainer" containerID="1491a08bb7bf05342b9133ecdf8a50f05a5e30de0f88d14aab2f230ad5874a4e"
Jul 17 05:58:30.647706 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:30.647623    2559 scope.go:117] "RemoveContainer" containerID="9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5"
Jul 17 05:58:30.647899 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:58:30.647857    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:58:31.653544 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:31.653516    2559 scope.go:117] "RemoveContainer" containerID="9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5"
Jul 17 05:58:31.654137 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:58:31.653704    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:58:33.401496 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:33.401463    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:33.401974 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:33.401847    2559 scope.go:117] "RemoveContainer" containerID="9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5"
Jul 17 05:58:33.402088 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:58:33.402065    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:58:38.400914 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:38.400856    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:38.401368 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:38.401349    2559 scope.go:117] "RemoveContainer" containerID="9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5"
Jul 17 05:58:38.401576 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:58:38.401553    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:58:39.699513 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:39.699420    2559 generic.go:356] "Generic (PLEG): container finished" podID="4e249c96-c542-4135-b9f3-f0437cd42348" containerID="258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a" exitCode=0
Jul 17 05:58:39.699513 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:39.699492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" event={"ID":"4e249c96-c542-4135-b9f3-f0437cd42348","Type":"ContainerDied","Data":"258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a"}
Jul 17 05:58:39.699978 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:39.699913    2559 scope.go:117] "RemoveContainer" containerID="258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a"
Jul 17 05:58:39.700927 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:39.700901    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:58:39.700998 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:39.700983    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:58:39.701046 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:39.701031    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 05:58:40.705936 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:40.705904    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" event={"ID":"4e249c96-c542-4135-b9f3-f0437cd42348","Type":"ContainerStarted","Data":"6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2"}
Jul 17 05:58:41.134937 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:41.134907    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:41.135902 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:41.135858    2559 patch_prober.go:28] interesting pod/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 05:58:41.136073 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:41.135926    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 05:58:42.134304 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:42.134269    2559 patch_prober.go:28] interesting pod/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 05:58:42.134710 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:42.134331    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 05:58:43.134633 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:43.134598    2559 patch_prober.go:28] interesting pod/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 05:58:43.135014 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:43.134656    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 05:58:43.634511 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:43.634478    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:44.135381 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:44.135345    2559 patch_prober.go:28] interesting pod/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 05:58:44.135776 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:44.135408    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 05:58:45.135216 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:45.135172    2559 patch_prober.go:28] interesting pod/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 05:58:45.135384 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:45.135231    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 05:58:46.139092 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:46.139065    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:46.140109 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:46.140090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 05:58:50.318214 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:50.318185    2559 scope.go:117] "RemoveContainer" containerID="9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5"
Jul 17 05:58:51.760196 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:51.760105    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerID="efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05" exitCode=1
Jul 17 05:58:51.760580 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:51.760186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerDied","Data":"efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05"}
Jul 17 05:58:51.760580 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:51.760247    2559 scope.go:117] "RemoveContainer" containerID="9b87b1b780da6d01b0937383e503f9330e8610578aa1508180cb65d1e4d10dd5"
Jul 17 05:58:51.760580 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:51.760530    2559 scope.go:117] "RemoveContainer" containerID="efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05"
Jul 17 05:58:51.760719 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:58:51.760699    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:58:53.401642 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:53.401602    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:53.402090 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:53.401970    2559 scope.go:117] "RemoveContainer" containerID="efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05"
Jul 17 05:58:53.402160 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:58:53.402141    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:58:58.401136 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:58.401093    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:58:58.401560 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:58:58.401518    2559 scope.go:117] "RemoveContainer" containerID="efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05"
Jul 17 05:58:58.401717 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:58:58.401693    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:59:09.318931 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:09.318853    2559 scope.go:117] "RemoveContainer" containerID="efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05"
Jul 17 05:59:09.319509 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:59:09.319186    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:59:22.318136 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:22.318102    2559 scope.go:117] "RemoveContainer" containerID="efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05"
Jul 17 05:59:22.914378 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:22.914341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerStarted","Data":"220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"}
Jul 17 05:59:22.914577 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:22.914564    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:59:22.932532 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:22.932420    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podStartSLOduration=52.613892951 podStartE2EDuration="54.932404408s" totalImagesPullingTime="2.318511457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:58:28 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:59:22.931018379 +0000 UTC m=+1586.106419766" watchObservedRunningTime="2026-07-17 05:59:22.932404408 +0000 UTC m=+1586.107805822"
Jul 17 05:59:23.920918 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:23.920858    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3" exitCode=1
Jul 17 05:59:23.920918 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:23.920906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerDied","Data":"220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"}
Jul 17 05:59:23.921403 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:23.920975    2559 scope.go:117] "RemoveContainer" containerID="efbba6992164b551d079874887b7812aa0ed9066928368c8a5ca4318e96bae05"
Jul 17 05:59:23.921403 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:23.921220    2559 scope.go:117] "RemoveContainer" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"
Jul 17 05:59:23.921477 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:59:23.921436    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:59:24.927257 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:24.927231    2559 scope.go:117] "RemoveContainer" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"
Jul 17 05:59:24.927606 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:59:24.927435    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:59:28.401055 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:28.401020    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 05:59:28.401531 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:28.401484    2559 scope.go:117] "RemoveContainer" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"
Jul 17 05:59:28.401734 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:59:28.401709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:59:42.319169 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:42.319139    2559 scope.go:117] "RemoveContainer" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"
Jul 17 05:59:42.319630 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:59:42.319318    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 05:59:55.318991 ip-10-0-128-37 kubenswrapper[2559]: I0717 05:59:55.318913    2559 scope.go:117] "RemoveContainer" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"
Jul 17 05:59:55.319356 ip-10-0-128-37 kubenswrapper[2559]: E0717 05:59:55.319128    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:00:06.318695 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:06.318658    2559 scope.go:117] "RemoveContainer" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"
Jul 17 06:00:07.140425 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:07.140340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerStarted","Data":"82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"}
Jul 17 06:00:07.140717 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:07.140695    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 06:00:08.147943 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:08.147909    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a" exitCode=1
Jul 17 06:00:08.148351 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:08.147985    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerDied","Data":"82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"}
Jul 17 06:00:08.148351 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:08.148044    2559 scope.go:117] "RemoveContainer" containerID="220fcd84160e8ce079e2a9688429eddb79b6853f41468e9cbc536876e88d64f3"
Jul 17 06:00:08.148351 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:08.148281    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:00:08.148532 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:00:08.148511    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:00:08.401589 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:08.401492    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 06:00:09.155633 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:09.155608    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:00:09.156016 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:00:09.155815    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:00:10.160152 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:10.160125    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:00:10.160522 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:00:10.160320    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:00:22.318046 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:22.318018    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:00:22.318506 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:00:22.318204    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:00:36.318052 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:36.318025    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:00:36.318468 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:00:36.318206    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:00:51.318251 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:00:51.318220    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:00:51.318663 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:00:51.318412    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:01:02.318757 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:02.318729    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:01:02.319211 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:02.318958    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:01:16.318586 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:16.318556    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:01:16.319070 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:16.318731    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:01:30.318893 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:30.318785    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:01:31.570431 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:31.570399    2559 generic.go:356] "Generic (PLEG): container finished" podID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerID="bcb5c6ab3a4f24e553e9d15597c65c8d738cf12adb11dd35a2042cedad60e600" exitCode=1
Jul 17 06:01:31.570797 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:31.570472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerDied","Data":"bcb5c6ab3a4f24e553e9d15597c65c8d738cf12adb11dd35a2042cedad60e600"}
Jul 17 06:01:31.570797 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:31.570540    2559 scope.go:117] "RemoveContainer" containerID="82f37214f1722b871a0bad6517fcd65a9af1c30d24b4307250e0b20fd559480a"
Jul 17 06:01:31.570906 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:31.570806    2559 scope.go:117] "RemoveContainer" containerID="bcb5c6ab3a4f24e553e9d15597c65c8d738cf12adb11dd35a2042cedad60e600"
Jul 17 06:01:31.571056 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:31.571036    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:01:32.141310 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:32.141280    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 06:01:32.577455 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:32.577431    2559 scope.go:117] "RemoveContainer" containerID="bcb5c6ab3a4f24e553e9d15597c65c8d738cf12adb11dd35a2042cedad60e600"
Jul 17 06:01:32.577846 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:32.577626    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:01:33.223434 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:33.223397    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"]
Jul 17 06:01:33.223609 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:33.223590    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy" containerID="cri-o://6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2" gracePeriod=30
Jul 17 06:01:38.401174 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.401140    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 06:01:38.401652 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.401634    2559 scope.go:117] "RemoveContainer" containerID="bcb5c6ab3a4f24e553e9d15597c65c8d738cf12adb11dd35a2042cedad60e600"
Jul 17 06:01:38.401973 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:38.401938    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-81346fa0-54df764b6b-6q99p_odh-ai-gateway-infra(cf6ac773-0751-4a0a-a63a-99c44fd4a23d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d"
Jul 17 06:01:38.479395 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.479369    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 06:01:38.581252 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581220    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-socket\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581416 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581279    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-data\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581416 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581311    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-certs\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581416 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581371    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e249c96-c542-4135-b9f3-f0437cd42348-istio-podinfo\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581416 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581412    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-istio-token\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581646 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581516    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltmpv\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-kube-api-access-ltmpv\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581646 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581562    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e249c96-c542-4135-b9f3-f0437cd42348-istiod-ca-cert\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581646 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581606    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-envoy\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.581646 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.581638    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-credential-socket\") pod \"4e249c96-c542-4135-b9f3-f0437cd42348\" (UID: \"4e249c96-c542-4135-b9f3-f0437cd42348\") "
Jul 17 06:01:38.582430 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.582166    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:01:38.582430 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.582210    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:01:38.582430 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.582222    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:01:38.582430 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.582267    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:01:38.582789 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.582079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e249c96-c542-4135-b9f3-f0437cd42348-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:01:38.584060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.584033    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e249c96-c542-4135-b9f3-f0437cd42348-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:01:38.584695 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.584537    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:01:38.584695 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.584650    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-kube-api-access-ltmpv" (OuterVolumeSpecName: "kube-api-access-ltmpv") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "kube-api-access-ltmpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:01:38.584695 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.584666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e249c96-c542-4135-b9f3-f0437cd42348" (UID: "4e249c96-c542-4135-b9f3-f0437cd42348"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:01:38.607852 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.607825    2559 generic.go:356] "Generic (PLEG): container finished" podID="4e249c96-c542-4135-b9f3-f0437cd42348" containerID="6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2" exitCode=0
Jul 17 06:01:38.607995 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.607897    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"
Jul 17 06:01:38.607995 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.607900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" event={"ID":"4e249c96-c542-4135-b9f3-f0437cd42348","Type":"ContainerDied","Data":"6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2"}
Jul 17 06:01:38.607995 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.607958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt" event={"ID":"4e249c96-c542-4135-b9f3-f0437cd42348","Type":"ContainerDied","Data":"f964f86da6e757bedef19f341e39170874e11ca3a5f45c77d8d7ca26b7a22a67"}
Jul 17 06:01:38.607995 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.607982    2559 scope.go:117] "RemoveContainer" containerID="6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2"
Jul 17 06:01:38.618283 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.618267    2559 scope.go:117] "RemoveContainer" containerID="258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a"
Jul 17 06:01:38.626478 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.626460    2559 scope.go:117] "RemoveContainer" containerID="6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2"
Jul 17 06:01:38.626754 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:38.626732    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2\": container with ID starting with 6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2 not found: ID does not exist" containerID="6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2"
Jul 17 06:01:38.626841 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.626760    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2"} err="failed to get container status \"6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2\": rpc error: code = NotFound desc = could not find container \"6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2\": container with ID starting with 6012f9d4620181dd0136b09ada8a42b10b5c860a336cb49f5d877a94895160f2 not found: ID does not exist"
Jul 17 06:01:38.626841 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.626779    2559 scope.go:117] "RemoveContainer" containerID="258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a"
Jul 17 06:01:38.627039 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:38.627023    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a\": container with ID starting with 258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a not found: ID does not exist" containerID="258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a"
Jul 17 06:01:38.627086 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.627044    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a"} err="failed to get container status \"258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a\": rpc error: code = NotFound desc = could not find container \"258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a\": container with ID starting with 258421b9947218f57fda3b143c2235df29251df8f600b03944e1f3d283ac2d3a not found: ID does not exist"
Jul 17 06:01:38.634829 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.634803    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"]
Jul 17 06:01:38.637363 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.637342    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-81346fa0-openshift-default-68b9f5c677-jlwmt"]
Jul 17 06:01:38.682753 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682723    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltmpv\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-kube-api-access-ltmpv\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682753 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682748    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e249c96-c542-4135-b9f3-f0437cd42348-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682753 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682758    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682979 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682766    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682979 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682775    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682979 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682783    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682979 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682791    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e249c96-c542-4135-b9f3-f0437cd42348-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682979 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682799    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e249c96-c542-4135-b9f3-f0437cd42348-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.682979 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.682806    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e249c96-c542-4135-b9f3-f0437cd42348-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:38.964589 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:38.964489    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"]
Jul 17 06:01:39.103118 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.103088    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 06:01:39.187205 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.187168    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ltwn\" (UniqueName: \"kubernetes.io/projected/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-kube-api-access-9ltwn\") pod \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") "
Jul 17 06:01:39.187401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.187221    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-openshift-service-ca\") pod \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") "
Jul 17 06:01:39.187401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.187260    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-maas-api-tls\") pod \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\" (UID: \"cf6ac773-0751-4a0a-a63a-99c44fd4a23d\") "
Jul 17 06:01:39.187638 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.187604    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf6ac773-0751-4a0a-a63a-99c44fd4a23d" (UID: "cf6ac773-0751-4a0a-a63a-99c44fd4a23d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:01:39.189514 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.189484    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf6ac773-0751-4a0a-a63a-99c44fd4a23d" (UID: "cf6ac773-0751-4a0a-a63a-99c44fd4a23d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:01:39.189621 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.189541    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-kube-api-access-9ltwn" (OuterVolumeSpecName: "kube-api-access-9ltwn") pod "cf6ac773-0751-4a0a-a63a-99c44fd4a23d" (UID: "cf6ac773-0751-4a0a-a63a-99c44fd4a23d"). InnerVolumeSpecName "kube-api-access-9ltwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:01:39.288366 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.288330    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ltwn\" (UniqueName: \"kubernetes.io/projected/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-kube-api-access-9ltwn\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:39.288366 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.288359    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:39.288556 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.288375    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6ac773-0751-4a0a-a63a-99c44fd4a23d-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:01:39.324389 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.324355    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" path="/var/lib/kubelet/pods/4e249c96-c542-4135-b9f3-f0437cd42348/volumes"
Jul 17 06:01:39.614516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.614480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p" event={"ID":"cf6ac773-0751-4a0a-a63a-99c44fd4a23d","Type":"ContainerDied","Data":"41f18bc5d291c9e97cec0d863d09f753a46f02ef8b1373562d53ac5660c4296f"}
Jul 17 06:01:39.614516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.614501    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"
Jul 17 06:01:39.614996 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.614534    2559 scope.go:117] "RemoveContainer" containerID="bcb5c6ab3a4f24e553e9d15597c65c8d738cf12adb11dd35a2042cedad60e600"
Jul 17 06:01:39.632774 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.632751    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"]
Jul 17 06:01:39.637989 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:39.637968    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81346fa0-54df764b6b-6q99p"]
Jul 17 06:01:41.325046 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:41.325009    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" path="/var/lib/kubelet/pods/cf6ac773-0751-4a0a-a63a-99c44fd4a23d/volumes"
Jul 17 06:01:45.806190 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806159    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"]
Jul 17 06:01:45.806564 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806529    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy"
Jul 17 06:01:45.806564 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806540    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy"
Jul 17 06:01:45.806564 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806549    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806564 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806554    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806564 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806563    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806564 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806568    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806581    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806586    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806592    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806597    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806603    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806607    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806670    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806677    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806682    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806687    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806692    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806697    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.806772 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.806702    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:45.811060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.811044    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.813610 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.813589    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-583f1136-gw-openshift-default-dockercfg-kfr8b\""
Jul 17 06:01:45.821906 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.821880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"]
Jul 17 06:01:45.950327 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istiod-ca-cert\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950327 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-credential-socket\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950540 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-envoy\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950540 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-certs\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950540 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950405    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-data\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950540 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsszv\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-kube-api-access-zsszv\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950540 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-socket\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950540 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-podinfo\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:45.950729 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:45.950567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-token\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.051990 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.051957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-envoy\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052182 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-certs\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052182 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-data\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052299 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsszv\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-kube-api-access-zsszv\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052299 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-socket\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052299 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-podinfo\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052456 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-token\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052456 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istiod-ca-cert\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052456 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-certs\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052456 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052424    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-data\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052636 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-credential-socket\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052692 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052668    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-socket\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.052850 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.052829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-credential-socket\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.053223 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.053207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istiod-ca-cert\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.054399 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.054377    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-envoy\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.054606 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.054588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-podinfo\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.060301 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.060278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-token\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.060521 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.060502    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsszv\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-kube-api-access-zsszv\") pod \"e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") " pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.122389 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.122366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:46.267225 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.267198    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"]
Jul 17 06:01:46.269674 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:01:46.269645    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6475e8_32c0_474d_94e6_24c5e2d5cb30.slice/crio-cfef6678eaf78cce646c60b750b0952fcd150bc21dc01f7c17bceb3d84a36005 WatchSource:0}: Error finding container cfef6678eaf78cce646c60b750b0952fcd150bc21dc01f7c17bceb3d84a36005: Status 404 returned error can't find the container with id cfef6678eaf78cce646c60b750b0952fcd150bc21dc01f7c17bceb3d84a36005
Jul 17 06:01:46.272305 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.272273    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:01:46.272426 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.272340    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:01:46.272426 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.272392    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:01:46.651588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.651501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" event={"ID":"ea6475e8-32c0-474d-94e6-24c5e2d5cb30","Type":"ContainerStarted","Data":"38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213"}
Jul 17 06:01:46.651747 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.651590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" event={"ID":"ea6475e8-32c0-474d-94e6-24c5e2d5cb30","Type":"ContainerStarted","Data":"cfef6678eaf78cce646c60b750b0952fcd150bc21dc01f7c17bceb3d84a36005"}
Jul 17 06:01:46.673308 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:46.673253    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" podStartSLOduration=1.6732343680000001 podStartE2EDuration="1.673234368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:01:46.672321022 +0000 UTC m=+1729.847722450" watchObservedRunningTime="2026-07-17 06:01:46.673234368 +0000 UTC m=+1729.848635757"
Jul 17 06:01:47.123378 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.123345    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:47.128181 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.128157    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:47.218515 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.218473    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"]
Jul 17 06:01:47.219169 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.219147    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy"
Jul 17 06:01:47.219169 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.219169    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e249c96-c542-4135-b9f3-f0437cd42348" containerName="istio-proxy"
Jul 17 06:01:47.219343 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.219185    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:47.219343 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.219196    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:47.219343 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.219315    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6ac773-0751-4a0a-a63a-99c44fd4a23d" containerName="maas-api"
Jul 17 06:01:47.222782 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.222760    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.225323 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.225304    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-583f1136-serving-cert\""
Jul 17 06:01:47.232247 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.232224    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"]
Jul 17 06:01:47.263901 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.263851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.263901 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.263906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmt5\" (UniqueName: \"kubernetes.io/projected/0da9170d-07c8-4739-8000-3c303c314194-kube-api-access-dpmt5\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.264093 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.263943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0da9170d-07c8-4739-8000-3c303c314194-openshift-service-ca\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.364948 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.364915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.364948 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.364954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmt5\" (UniqueName: \"kubernetes.io/projected/0da9170d-07c8-4739-8000-3c303c314194-kube-api-access-dpmt5\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.365204 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.364984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0da9170d-07c8-4739-8000-3c303c314194-openshift-service-ca\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.365204 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:47.365059    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-serving-cert: secret "maas-api-e2e-migrate-583f1136-serving-cert" not found
Jul 17 06:01:47.365204 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:47.365146    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls podName:0da9170d-07c8-4739-8000-3c303c314194 nodeName:}" failed. No retries permitted until 2026-07-17 06:01:47.865124499 +0000 UTC m=+1731.040525878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls") pod "maas-api-e2e-migrate-583f1136-766759ff45-595vx" (UID: "0da9170d-07c8-4739-8000-3c303c314194") : secret "maas-api-e2e-migrate-583f1136-serving-cert" not found
Jul 17 06:01:47.365695 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.365678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0da9170d-07c8-4739-8000-3c303c314194-openshift-service-ca\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.373297 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.373275    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmt5\" (UniqueName: \"kubernetes.io/projected/0da9170d-07c8-4739-8000-3c303c314194-kube-api-access-dpmt5\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.656331 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.656302    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:47.657210 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.657192    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:47.868440 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.868397    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:47.870847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:47.870822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls\") pod \"maas-api-e2e-migrate-583f1136-766759ff45-595vx\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:48.138523 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:48.138480    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:48.270858 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:48.270833    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"]
Jul 17 06:01:48.273039 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:01:48.273005    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da9170d_07c8_4739_8000_3c303c314194.slice/crio-0c9ec65cfe55861f8c900fc48ac010f95e6c022e90bc4479b8f9b00493c02ece WatchSource:0}: Error finding container 0c9ec65cfe55861f8c900fc48ac010f95e6c022e90bc4479b8f9b00493c02ece: Status 404 returned error can't find the container with id 0c9ec65cfe55861f8c900fc48ac010f95e6c022e90bc4479b8f9b00493c02ece
Jul 17 06:01:48.662906 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:48.662855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerStarted","Data":"0c9ec65cfe55861f8c900fc48ac010f95e6c022e90bc4479b8f9b00493c02ece"}
Jul 17 06:01:49.668926 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:49.668894    2559 generic.go:356] "Generic (PLEG): container finished" podID="0da9170d-07c8-4739-8000-3c303c314194" containerID="f324f8030d4467529c7729ef7283fd6b6bb88653f90b231b3202927cd0b77046" exitCode=1
Jul 17 06:01:49.669373 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:49.668960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerDied","Data":"f324f8030d4467529c7729ef7283fd6b6bb88653f90b231b3202927cd0b77046"}
Jul 17 06:01:49.669373 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:49.669203    2559 scope.go:117] "RemoveContainer" containerID="f324f8030d4467529c7729ef7283fd6b6bb88653f90b231b3202927cd0b77046"
Jul 17 06:01:50.680169 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:50.680043    2559 generic.go:356] "Generic (PLEG): container finished" podID="0da9170d-07c8-4739-8000-3c303c314194" containerID="eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9" exitCode=1
Jul 17 06:01:50.680169 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:50.680118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerDied","Data":"eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9"}
Jul 17 06:01:50.680705 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:50.680175    2559 scope.go:117] "RemoveContainer" containerID="f324f8030d4467529c7729ef7283fd6b6bb88653f90b231b3202927cd0b77046"
Jul 17 06:01:50.680705 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:50.680687    2559 scope.go:117] "RemoveContainer" containerID="eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9"
Jul 17 06:01:50.680983 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:50.680953    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:01:51.691149 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:51.691120    2559 scope.go:117] "RemoveContainer" containerID="eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9"
Jul 17 06:01:51.691524 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:51.691319    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:01:53.138694 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:53.138664    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:53.139069 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:53.139055    2559 scope.go:117] "RemoveContainer" containerID="eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9"
Jul 17 06:01:53.139238 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:53.139220    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:01:57.723516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:57.723426    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerID="38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213" exitCode=0
Jul 17 06:01:57.723975 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:57.723507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" event={"ID":"ea6475e8-32c0-474d-94e6-24c5e2d5cb30","Type":"ContainerDied","Data":"38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213"}
Jul 17 06:01:57.723975 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:57.723965    2559 scope.go:117] "RemoveContainer" containerID="38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213"
Jul 17 06:01:57.724975 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:57.724950    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:01:57.725043 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:57.725014    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:01:57.725080 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:57.725046    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:01:58.139382 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:58.139294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:01:58.139704 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:58.139691    2559 scope.go:117] "RemoveContainer" containerID="eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9"
Jul 17 06:01:58.139905 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:01:58.139859    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:01:58.730274 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:58.730239    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" event={"ID":"ea6475e8-32c0-474d-94e6-24c5e2d5cb30","Type":"ContainerStarted","Data":"4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09"}
Jul 17 06:01:59.123073 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:59.123033    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:01:59.124343 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:59.124317    2559 patch_prober.go:28] interesting pod/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 06:01:59.124473 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:01:59.124375    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 06:02:00.123731 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:00.123690    2559 patch_prober.go:28] interesting pod/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 06:02:00.124168 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:00.123750    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 06:02:01.123747 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:01.123707    2559 patch_prober.go:28] interesting pod/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 06:02:01.124268 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:01.123769    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 06:02:02.122988 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:02.122946    2559 patch_prober.go:28] interesting pod/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 06:02:02.123162 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:02.123020    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 06:02:02.656914 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:02.656853    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:02:03.127408 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:03.127381    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:02:03.128486 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:03.128462    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:02:13.318465 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:13.318434    2559 scope.go:117] "RemoveContainer" containerID="eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9"
Jul 17 06:02:13.807257 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:13.807224    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerStarted","Data":"63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"}
Jul 17 06:02:13.807451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:13.807431    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:02:13.825237 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:13.825181    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podStartSLOduration=25.761786214 podStartE2EDuration="26.825165612s" totalImagesPullingTime="1.063379398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:01:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:02:13.823275503 +0000 UTC m=+1756.998676881" watchObservedRunningTime="2026-07-17 06:02:13.825165612 +0000 UTC m=+1757.000567003"
Jul 17 06:02:14.814278 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:14.814237    2559 generic.go:356] "Generic (PLEG): container finished" podID="0da9170d-07c8-4739-8000-3c303c314194" containerID="63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795" exitCode=1
Jul 17 06:02:14.814749 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:14.814313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerDied","Data":"63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"}
Jul 17 06:02:14.814749 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:14.814377    2559 scope.go:117] "RemoveContainer" containerID="eefa08864b352f4f883c342b900c245ddfac29b2fe3952c2506fc0a2512a98a9"
Jul 17 06:02:14.814749 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:14.814626    2559 scope.go:117] "RemoveContainer" containerID="63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"
Jul 17 06:02:14.814910 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:14.814885    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:02:15.821102 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:15.821067    2559 scope.go:117] "RemoveContainer" containerID="63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"
Jul 17 06:02:15.821465 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:15.821258    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:02:18.138858 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:18.138826    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:02:18.139275 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:18.139240    2559 scope.go:117] "RemoveContainer" containerID="63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"
Jul 17 06:02:18.139456 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:18.139431    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:02:29.318597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:29.318554    2559 scope.go:117] "RemoveContainer" containerID="63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"
Jul 17 06:02:29.319151 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:29.318775    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:02:43.318423 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:43.318394    2559 scope.go:117] "RemoveContainer" containerID="63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"
Jul 17 06:02:43.966286 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:43.966250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerStarted","Data":"ec846a7b058d1f984b600f72b0994d694bdbb3a244179c04cb37d8c084ecf5fa"}
Jul 17 06:02:43.966502 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:43.966478    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:02:44.973372 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:44.973340    2559 generic.go:356] "Generic (PLEG): container finished" podID="0da9170d-07c8-4739-8000-3c303c314194" containerID="ec846a7b058d1f984b600f72b0994d694bdbb3a244179c04cb37d8c084ecf5fa" exitCode=1
Jul 17 06:02:44.973797 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:44.973386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerDied","Data":"ec846a7b058d1f984b600f72b0994d694bdbb3a244179c04cb37d8c084ecf5fa"}
Jul 17 06:02:44.973797 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:44.973435    2559 scope.go:117] "RemoveContainer" containerID="63c6ebd506b7b08261d15498cbeec9ffb9d59261b2052793be26b15e97e69795"
Jul 17 06:02:44.973797 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:44.973657    2559 scope.go:117] "RemoveContainer" containerID="ec846a7b058d1f984b600f72b0994d694bdbb3a244179c04cb37d8c084ecf5fa"
Jul 17 06:02:44.973968 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:44.973897    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:02:45.979908 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:45.979864    2559 scope.go:117] "RemoveContainer" containerID="ec846a7b058d1f984b600f72b0994d694bdbb3a244179c04cb37d8c084ecf5fa"
Jul 17 06:02:45.980292 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:45.980080    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:02:48.139600 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:48.139564    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:02:48.140020 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:48.140000    2559 scope.go:117] "RemoveContainer" containerID="ec846a7b058d1f984b600f72b0994d694bdbb3a244179c04cb37d8c084ecf5fa"
Jul 17 06:02:48.140218 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:48.140195    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-583f1136-766759ff45-595vx_odh-ai-gateway-infra(0da9170d-07c8-4739-8000-3c303c314194)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" podUID="0da9170d-07c8-4739-8000-3c303c314194"
Jul 17 06:02:51.724325 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:51.724240    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"]
Jul 17 06:02:51.724733 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:51.724442    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy" containerID="cri-o://4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09" gracePeriod=30
Jul 17 06:02:57.006186 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.006123    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:02:57.036674 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.036632    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerID="4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09" exitCode=0
Jul 17 06:02:57.036859 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.036708    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"
Jul 17 06:02:57.036859 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.036784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" event={"ID":"ea6475e8-32c0-474d-94e6-24c5e2d5cb30","Type":"ContainerDied","Data":"4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09"}
Jul 17 06:02:57.036859 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.036842    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p" event={"ID":"ea6475e8-32c0-474d-94e6-24c5e2d5cb30","Type":"ContainerDied","Data":"cfef6678eaf78cce646c60b750b0952fcd150bc21dc01f7c17bceb3d84a36005"}
Jul 17 06:02:57.037053 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.036893    2559 scope.go:117] "RemoveContainer" containerID="4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09"
Jul 17 06:02:57.047030 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.046917    2559 scope.go:117] "RemoveContainer" containerID="38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213"
Jul 17 06:02:57.057095 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.057070    2559 scope.go:117] "RemoveContainer" containerID="4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09"
Jul 17 06:02:57.057415 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:57.057392    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09\": container with ID starting with 4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09 not found: ID does not exist" containerID="4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09"
Jul 17 06:02:57.057514 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.057429    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09"} err="failed to get container status \"4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09\": rpc error: code = NotFound desc = could not find container \"4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09\": container with ID starting with 4daafae3c4877d7cf051967d2429a256043671bead4bdc8cf7748a8017ff9b09 not found: ID does not exist"
Jul 17 06:02:57.057514 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.057468    2559 scope.go:117] "RemoveContainer" containerID="38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213"
Jul 17 06:02:57.057798 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:02:57.057769    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213\": container with ID starting with 38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213 not found: ID does not exist" containerID="38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213"
Jul 17 06:02:57.057884 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.057803    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213"} err="failed to get container status \"38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213\": rpc error: code = NotFound desc = could not find container \"38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213\": container with ID starting with 38b9f96563306eff167b923855ab378a8c60b61f6907388d09235df2f67c5213 not found: ID does not exist"
Jul 17 06:02:57.127640 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-credential-socket\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.127803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127672    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsszv\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-kube-api-access-zsszv\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.127803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127716    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-envoy\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.127803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127737    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-podinfo\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.127803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127765    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-token\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.127803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127782    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-data\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.128106 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127844    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-socket\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.128106 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127977    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:02:57.128106 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.127982    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-certs\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.128106 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128061    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istiod-ca-cert\") pod \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\" (UID: \"ea6475e8-32c0-474d-94e6-24c5e2d5cb30\") "
Jul 17 06:02:57.128321 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128119    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:02:57.128321 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128204    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:02:57.128422 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128408    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.128483 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128427    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.128483 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128442    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.128483 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128471    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:02:57.128858 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.128825    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:02:57.130082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.130058    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:02:57.130178 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.130074    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:02:57.130263 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.130239    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:02:57.130346 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.130326    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-kube-api-access-zsszv" (OuterVolumeSpecName: "kube-api-access-zsszv") pod "ea6475e8-32c0-474d-94e6-24c5e2d5cb30" (UID: "ea6475e8-32c0-474d-94e6-24c5e2d5cb30"). InnerVolumeSpecName "kube-api-access-zsszv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:02:57.229527 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.229486    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.229527 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.229519    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsszv\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-kube-api-access-zsszv\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.229527 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.229535    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.229761 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.229547    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.229761 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.229557    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.229761 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.229567    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea6475e8-32c0-474d-94e6-24c5e2d5cb30-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:57.353577 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.353549    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"]
Jul 17 06:02:57.358512 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.358484    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-583f1136-gw-openshift-default-555d65f9f-gbh2p"]
Jul 17 06:02:57.376760 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.376735    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:02:57.382237 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.382215    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:02:57.637400 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.637304    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"]
Jul 17 06:02:57.778198 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.778172    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:02:57.936091 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.935995    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpmt5\" (UniqueName: \"kubernetes.io/projected/0da9170d-07c8-4739-8000-3c303c314194-kube-api-access-dpmt5\") pod \"0da9170d-07c8-4739-8000-3c303c314194\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") "
Jul 17 06:02:57.936091 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.936069    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0da9170d-07c8-4739-8000-3c303c314194-openshift-service-ca\") pod \"0da9170d-07c8-4739-8000-3c303c314194\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") "
Jul 17 06:02:57.936091 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.936094    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls\") pod \"0da9170d-07c8-4739-8000-3c303c314194\" (UID: \"0da9170d-07c8-4739-8000-3c303c314194\") "
Jul 17 06:02:57.936449 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.936426    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0da9170d-07c8-4739-8000-3c303c314194-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0da9170d-07c8-4739-8000-3c303c314194" (UID: "0da9170d-07c8-4739-8000-3c303c314194"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:02:57.938217 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.938192    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da9170d-07c8-4739-8000-3c303c314194-kube-api-access-dpmt5" (OuterVolumeSpecName: "kube-api-access-dpmt5") pod "0da9170d-07c8-4739-8000-3c303c314194" (UID: "0da9170d-07c8-4739-8000-3c303c314194"). InnerVolumeSpecName "kube-api-access-dpmt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:02:57.938303 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:57.938217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0da9170d-07c8-4739-8000-3c303c314194" (UID: "0da9170d-07c8-4739-8000-3c303c314194"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:02:58.037073 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.037038    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpmt5\" (UniqueName: \"kubernetes.io/projected/0da9170d-07c8-4739-8000-3c303c314194-kube-api-access-dpmt5\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:58.037073 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.037064    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0da9170d-07c8-4739-8000-3c303c314194-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:58.037073 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.037074    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da9170d-07c8-4739-8000-3c303c314194-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:02:58.043325 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.043291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx" event={"ID":"0da9170d-07c8-4739-8000-3c303c314194","Type":"ContainerDied","Data":"0c9ec65cfe55861f8c900fc48ac010f95e6c022e90bc4479b8f9b00493c02ece"}
Jul 17 06:02:58.043477 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.043367    2559 scope.go:117] "RemoveContainer" containerID="ec846a7b058d1f984b600f72b0994d694bdbb3a244179c04cb37d8c084ecf5fa"
Jul 17 06:02:58.043477 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.043303    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"
Jul 17 06:02:58.064705 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.064680    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"]
Jul 17 06:02:58.068941 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:58.068921    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-583f1136-766759ff45-595vx"]
Jul 17 06:02:59.324083 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:59.324048    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0da9170d-07c8-4739-8000-3c303c314194" path="/var/lib/kubelet/pods/0da9170d-07c8-4739-8000-3c303c314194/volumes"
Jul 17 06:02:59.324497 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:02:59.324484    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" path="/var/lib/kubelet/pods/ea6475e8-32c0-474d-94e6-24c5e2d5cb30/volumes"
Jul 17 06:03:03.760918 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.760881    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"]
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761261    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761272    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761280    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761286    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761297    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761302    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761312    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761317    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761330    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy"
Jul 17 06:03:03.761375 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761335    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy"
Jul 17 06:03:03.762099 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761392    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.762099 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761399    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:03.762099 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.761405    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy"
Jul 17 06:03:03.764956 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.764933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.768289 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.768263    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3232801c-openshift-default-dockercfg-75vnh\""
Jul 17 06:03:03.780279 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.780250    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"]
Jul 17 06:03:03.795256 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-credential-socket\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795390 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795269    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-certs\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795390 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-envoy\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795390 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-socket\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795570 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-data\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795570 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5a21240-9279-424c-8ced-25e69e185a10-istio-podinfo\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795570 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcgl\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-kube-api-access-fkcgl\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795570 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-istio-token\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.795570 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.795552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5a21240-9279-424c-8ced-25e69e185a10-istiod-ca-cert\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896045 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-envoy\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896045 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-socket\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896297 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-data\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896297 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5a21240-9279-424c-8ced-25e69e185a10-istio-podinfo\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896297 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcgl\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-kube-api-access-fkcgl\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896297 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-istio-token\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896297 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5a21240-9279-424c-8ced-25e69e185a10-istiod-ca-cert\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896297 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896285    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-credential-socket\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-certs\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-socket\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-data\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896751 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-certs\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.896926 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.896905    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-credential-socket\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.897087 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.897071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5a21240-9279-424c-8ced-25e69e185a10-istiod-ca-cert\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.898434 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.898412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-envoy\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.898677 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.898658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5a21240-9279-424c-8ced-25e69e185a10-istio-podinfo\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.905863 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.905829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-istio-token\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:03.906011 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:03.905980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcgl\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-kube-api-access-fkcgl\") pod \"e2e-ait-3232801c-openshift-default-6d888c45c9-dl457\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") " pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:04.075357 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:04.075330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:04.219081 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:04.219053    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"]
Jul 17 06:03:04.220953 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:03:04.220924    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a21240_9279_424c_8ced_25e69e185a10.slice/crio-3c2d96073d4ab7a7d26dcaf0b24b758ac10e653d701a8e13e21d644bcf2fd297 WatchSource:0}: Error finding container 3c2d96073d4ab7a7d26dcaf0b24b758ac10e653d701a8e13e21d644bcf2fd297: Status 404 returned error can't find the container with id 3c2d96073d4ab7a7d26dcaf0b24b758ac10e653d701a8e13e21d644bcf2fd297
Jul 17 06:03:04.222989 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:04.222956    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:03:04.223085 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:04.223042    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:03:04.223151 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:04.223091    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:03:05.037650 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.037599    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"]
Jul 17 06:03:05.038132 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.038101    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:05.038132 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.038118    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:05.038263 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.038212    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:05.038263 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.038224    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da9170d-07c8-4739-8000-3c303c314194" containerName="maas-api"
Jul 17 06:03:05.038263 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.038234    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea6475e8-32c0-474d-94e6-24c5e2d5cb30" containerName="istio-proxy"
Jul 17 06:03:05.042094 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.042070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.045206 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.045181    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3232801c-serving-cert\""
Jul 17 06:03:05.059272 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.059242    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"]
Jul 17 06:03:05.079050 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.079019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" event={"ID":"a5a21240-9279-424c-8ced-25e69e185a10","Type":"ContainerStarted","Data":"9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854"}
Jul 17 06:03:05.079167 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.079076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" event={"ID":"a5a21240-9279-424c-8ced-25e69e185a10","Type":"ContainerStarted","Data":"3c2d96073d4ab7a7d26dcaf0b24b758ac10e653d701a8e13e21d644bcf2fd297"}
Jul 17 06:03:05.102914 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.102837    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" podStartSLOduration=2.102818907 podStartE2EDuration="2.102818907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:03:05.102635968 +0000 UTC m=+1808.278037392" watchObservedRunningTime="2026-07-17 06:03:05.102818907 +0000 UTC m=+1808.278220296"
Jul 17 06:03:05.104208 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.104181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqjj\" (UniqueName: \"kubernetes.io/projected/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-kube-api-access-8kqjj\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.104310 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.104220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-openshift-service-ca\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.104310 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.104293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.205640 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.205601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqjj\" (UniqueName: \"kubernetes.io/projected/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-kube-api-access-8kqjj\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.205910 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.205774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-openshift-service-ca\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.206006 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.205937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.206118 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:05.206098    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-serving-cert: secret "maas-api-e2e-ait-3232801c-serving-cert" not found
Jul 17 06:03:05.206193 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:05.206167    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls podName:9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c nodeName:}" failed. No retries permitted until 2026-07-17 06:03:05.7061469 +0000 UTC m=+1808.881548269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls") pod "maas-api-e2e-ait-3232801c-56878c949f-59nx8" (UID: "9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c") : secret "maas-api-e2e-ait-3232801c-serving-cert" not found
Jul 17 06:03:05.206508 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.206485    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-openshift-service-ca\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.214327 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.214298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqjj\" (UniqueName: \"kubernetes.io/projected/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-kube-api-access-8kqjj\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.710137 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.710097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.712656 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.712630    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls\") pod \"maas-api-e2e-ait-3232801c-56878c949f-59nx8\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:05.953817 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:05.953781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:06.076188 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:06.076156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:06.081604 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:06.081570    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:06.084784 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:06.084762    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:06.085586 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:06.085566    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:06.090630 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:06.090609    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"]
Jul 17 06:03:06.093384 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:03:06.093358    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fffe0e4_1b11_4639_aa4a_dc7c79a2e60c.slice/crio-64ae00d15ed6d6c4f8cc5d98361576ca92f949d958cb9a48ff8315e0637a66c6 WatchSource:0}: Error finding container 64ae00d15ed6d6c4f8cc5d98361576ca92f949d958cb9a48ff8315e0637a66c6: Status 404 returned error can't find the container with id 64ae00d15ed6d6c4f8cc5d98361576ca92f949d958cb9a48ff8315e0637a66c6
Jul 17 06:03:07.092256 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:07.092215    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerID="9a3695c1ad861c0615de0595ff7428a50ee7c55286f07facf381e5f31ec8c97d" exitCode=1
Jul 17 06:03:07.092702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:07.092319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"9a3695c1ad861c0615de0595ff7428a50ee7c55286f07facf381e5f31ec8c97d"}
Jul 17 06:03:07.092702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:07.092376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerStarted","Data":"64ae00d15ed6d6c4f8cc5d98361576ca92f949d958cb9a48ff8315e0637a66c6"}
Jul 17 06:03:07.092702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:07.092542    2559 scope.go:117] "RemoveContainer" containerID="9a3695c1ad861c0615de0595ff7428a50ee7c55286f07facf381e5f31ec8c97d"
Jul 17 06:03:08.099527 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:08.099490    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerID="43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad" exitCode=1
Jul 17 06:03:08.099930 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:08.099578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad"}
Jul 17 06:03:08.099930 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:08.099649    2559 scope.go:117] "RemoveContainer" containerID="9a3695c1ad861c0615de0595ff7428a50ee7c55286f07facf381e5f31ec8c97d"
Jul 17 06:03:08.099930 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:08.099908    2559 scope.go:117] "RemoveContainer" containerID="43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad"
Jul 17 06:03:08.100166 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:08.100146    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:09.106428 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:09.106392    2559 scope.go:117] "RemoveContainer" containerID="43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad"
Jul 17 06:03:09.106935 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:09.106636    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:10.954878 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:10.954843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:10.955264 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:10.955239    2559 scope.go:117] "RemoveContainer" containerID="43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad"
Jul 17 06:03:10.955461 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:10.955440    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:15.954435 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:15.954346    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:15.954983 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:15.954849    2559 scope.go:117] "RemoveContainer" containerID="43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad"
Jul 17 06:03:15.955151 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:15.955127    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:16.146912 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:16.146881    2559 generic.go:356] "Generic (PLEG): container finished" podID="a5a21240-9279-424c-8ced-25e69e185a10" containerID="9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854" exitCode=0
Jul 17 06:03:16.146912 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:16.146917    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" event={"ID":"a5a21240-9279-424c-8ced-25e69e185a10","Type":"ContainerDied","Data":"9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854"}
Jul 17 06:03:16.147286 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:16.147273    2559 scope.go:117] "RemoveContainer" containerID="9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854"
Jul 17 06:03:16.148213 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:16.148186    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:03:16.148270 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:16.148260    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:03:16.148309 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:16.148295    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:03:17.153211 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:17.153176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" event={"ID":"a5a21240-9279-424c-8ced-25e69e185a10","Type":"ContainerStarted","Data":"416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b"}
Jul 17 06:03:18.075480 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:18.075435    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:18.076697 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:18.076660    2559 patch_prober.go:28] interesting pod/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 17 06:03:18.076839 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:18.076737    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 17 06:03:19.076705 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:19.076207    2559 patch_prober.go:28] interesting pod/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 17 06:03:19.076705 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:19.076279    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 17 06:03:20.076213 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:20.076171    2559 patch_prober.go:28] interesting pod/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 17 06:03:20.076409 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:20.076237    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 17 06:03:21.079942 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:21.079912    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:21.080416 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:21.080306    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:21.080885 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:21.080853    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:03:28.318373 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:28.318340    2559 scope.go:117] "RemoveContainer" containerID="43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad"
Jul 17 06:03:29.221493 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:29.221464    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerID="3fc7f484581d0ba25f9b35be164c2d09e128338c7a53078bb173cc003a52cfd3" exitCode=1
Jul 17 06:03:29.221662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:29.221538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"3fc7f484581d0ba25f9b35be164c2d09e128338c7a53078bb173cc003a52cfd3"}
Jul 17 06:03:29.221662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:29.221598    2559 scope.go:117] "RemoveContainer" containerID="43cbcf8b5219b38869ad8e9d109da31a5988c36b26d2d121042270a32fea77ad"
Jul 17 06:03:29.221920 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:29.221906    2559 scope.go:117] "RemoveContainer" containerID="3fc7f484581d0ba25f9b35be164c2d09e128338c7a53078bb173cc003a52cfd3"
Jul 17 06:03:29.222142 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:29.222123    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:30.954038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:30.954000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:30.954473 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:30.954385    2559 scope.go:117] "RemoveContainer" containerID="3fc7f484581d0ba25f9b35be164c2d09e128338c7a53078bb173cc003a52cfd3"
Jul 17 06:03:30.954590 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:30.954570    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:35.954956 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:35.954921    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:35.955432 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:35.955339    2559 scope.go:117] "RemoveContainer" containerID="3fc7f484581d0ba25f9b35be164c2d09e128338c7a53078bb173cc003a52cfd3"
Jul 17 06:03:35.955538 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:35.955514    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:49.318525 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:49.318493    2559 scope.go:117] "RemoveContainer" containerID="3fc7f484581d0ba25f9b35be164c2d09e128338c7a53078bb173cc003a52cfd3"
Jul 17 06:03:49.318961 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:49.318814    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 06:03:50.331746 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:50.331714    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8" exitCode=1
Jul 17 06:03:50.332148 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:50.331787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"}
Jul 17 06:03:50.332148 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:50.331850    2559 scope.go:117] "RemoveContainer" containerID="3fc7f484581d0ba25f9b35be164c2d09e128338c7a53078bb173cc003a52cfd3"
Jul 17 06:03:50.332285 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:50.332180    2559 scope.go:117] "RemoveContainer" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"
Jul 17 06:03:50.332382 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:50.332364    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:50.953934 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:50.953894    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:51.338199 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:51.338172    2559 scope.go:117] "RemoveContainer" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"
Jul 17 06:03:51.338597 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:51.338378    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:03:55.954805 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:55.954763    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:03:55.955252 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:03:55.955237    2559 scope.go:117] "RemoveContainer" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"
Jul 17 06:03:55.955465 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:03:55.955446    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:04:08.318850 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:08.318819    2559 scope.go:117] "RemoveContainer" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"
Jul 17 06:04:08.319245 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:04:08.319028    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:04:22.318809 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:22.318729    2559 scope.go:117] "RemoveContainer" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"
Jul 17 06:04:22.319348 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:04:22.318973    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:04:34.318697 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:34.318667    2559 scope.go:117] "RemoveContainer" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"
Jul 17 06:04:35.561443 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:35.561401    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2" exitCode=1
Jul 17 06:04:35.561818 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:35.561470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"}
Jul 17 06:04:35.561818 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:35.561531    2559 scope.go:117] "RemoveContainer" containerID="7cadc8ffa4fa5d6ae772462e54f25d29f91614e76007de3d8c9d2ab06f97f9f8"
Jul 17 06:04:35.561966 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:35.561824    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:04:35.562090 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:04:35.562066    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:04:35.954844 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:35.954750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:04:35.954844 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:35.954824    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:04:36.568971 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:36.568947    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:04:36.569341 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:04:36.569138    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:04:47.320975 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:47.320945    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:04:47.321346 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:04:47.321120    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:04:58.318656 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:04:58.318623    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:04:58.319186 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:04:58.318839    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:05:09.318935 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:05:09.318891    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:05:09.319418 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:05:09.319130    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:05:24.318512 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:05:24.318480    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:05:24.319036 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:05:24.318689    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:05:39.318999 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:05:39.318967    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:05:39.319427 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:05:39.319174    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:05:52.318757 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:05:52.318673    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:05:52.319175 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:05:52.318947    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:06:05.318324 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:05.318284    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:06:06.007796 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:06.007709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerStarted","Data":"d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"}
Jul 17 06:06:06.007977 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:06.007912    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:06:06.024443 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:06.024387    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podStartSLOduration=178.57561868 podStartE2EDuration="3m1.024367759s" totalImagesPullingTime="2.448749079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:03:05 +0000 UTC" imagePullSessionsCount=6 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:06:06.024013164 +0000 UTC m=+1989.199414551" watchObservedRunningTime="2026-07-17 06:06:06.024367759 +0000 UTC m=+1989.199769147"
Jul 17 06:06:07.014396 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:07.014366    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8" exitCode=1
Jul 17 06:06:07.014900 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:07.014454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"}
Jul 17 06:06:07.014900 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:07.014524    2559 scope.go:117] "RemoveContainer" containerID="8af81c89ca4131abdf8443d214e80907bf9811a34956f066be0dd8c9777bf2e2"
Jul 17 06:06:07.014900 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:07.014698    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:06:07.015039 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:06:07.014989    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:06:08.020947 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:08.020919    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:06:08.021390 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:06:08.021105    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:06:15.954282 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:15.954235    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:06:15.954760 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:15.954742    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:06:15.954999 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:06:15.954976    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:06:26.318062 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:26.318031    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:06:26.318441 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:06:26.318234    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:06:37.320365 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:37.320338    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:06:37.320779 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:06:37.320501    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:06:49.318411 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:06:49.318377    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:06:49.318887 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:06:49.318574    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:07:04.318793 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:07:04.318765    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:07:04.319198 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:07:04.319026    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:07:16.319109 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:07:16.319074    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:07:16.319523 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:07:16.319290    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:07:29.318213 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:07:29.318131    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:07:29.318642 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:07:29.318357    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:07:42.319179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:07:42.319147    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:07:42.319564 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:07:42.319311    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:07:55.324289 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:07:55.324259    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:07:55.324782 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:07:55.324537    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:07:57.407058 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:07:57.407028    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:07:57.412384 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:07:57.412356    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:08:06.319054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:08:06.319025    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:08:06.319513 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:08:06.319213    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:08:18.318204 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:08:18.318164    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:08:18.320547 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:08:18.318380    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:08:29.319045 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:08:29.319011    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:08:29.319528 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:08:29.319271    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:08:44.318404 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:08:44.318373    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:08:44.318857 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:08:44.318562    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:08:59.319130 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:08:59.319038    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:08:59.319597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:08:59.319356    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 06:09:00.878796 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:00.878758    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerID="06b8e1fb056287019501d2f8312ba65d5a3af9334b95b2ae670fadc61575b8e1" exitCode=1
Jul 17 06:09:00.879233 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:00.878831    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"06b8e1fb056287019501d2f8312ba65d5a3af9334b95b2ae670fadc61575b8e1"}
Jul 17 06:09:00.879233 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:00.878934    2559 scope.go:117] "RemoveContainer" containerID="d3502f680272d70cabdab75869748f088193e5307be2a3869ada8543e7fd1ed8"
Jul 17 06:09:00.879343 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:00.879250    2559 scope.go:117] "RemoveContainer" containerID="06b8e1fb056287019501d2f8312ba65d5a3af9334b95b2ae670fadc61575b8e1"
Jul 17 06:09:00.879461 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:00.879440    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:09:01.008997 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:01.008954    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:09:01.885848 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:01.885821    2559 scope.go:117] "RemoveContainer" containerID="06b8e1fb056287019501d2f8312ba65d5a3af9334b95b2ae670fadc61575b8e1"
Jul 17 06:09:01.886243 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:01.886029    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:09:05.954935 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:05.954902    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:09:05.955323 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:05.955295    2559 scope.go:117] "RemoveContainer" containerID="06b8e1fb056287019501d2f8312ba65d5a3af9334b95b2ae670fadc61575b8e1"
Jul 17 06:09:05.955499 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:05.955479    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-3232801c-56878c949f-59nx8_odh-ai-gateway-infra(9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"
Jul 17 06:09:10.305543 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:10.305505    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"]
Jul 17 06:09:10.305952 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:10.305749    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy" containerID="cri-o://416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b" gracePeriod=30
Jul 17 06:09:15.545065 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.543417    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"]
Jul 17 06:09:15.564409 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.564380    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:09:15.696088 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696060    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-certs\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696247 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696172    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-credential-socket\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696247 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696199    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkcgl\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-kube-api-access-fkcgl\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696247 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696231    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5a21240-9279-424c-8ced-25e69e185a10-istiod-ca-cert\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696690 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696334    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-envoy\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696690 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696365    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-data\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696690 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696370    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:09:15.696690 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696390    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5a21240-9279-424c-8ced-25e69e185a10-istio-podinfo\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696690 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696484    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-socket\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.696690 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696512    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-istio-token\") pod \"a5a21240-9279-424c-8ced-25e69e185a10\" (UID: \"a5a21240-9279-424c-8ced-25e69e185a10\") "
Jul 17 06:09:15.697038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696820    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:09:15.697038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696901    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5a21240-9279-424c-8ced-25e69e185a10-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:09:15.697038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.696919    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.697211 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.697150    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:09:15.697833 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.697801    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:09:15.698658 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.698629    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-kube-api-access-fkcgl" (OuterVolumeSpecName: "kube-api-access-fkcgl") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "kube-api-access-fkcgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:09:15.699214 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.699182    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:09:15.699324 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.699235    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:09:15.699746 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.699724    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5a21240-9279-424c-8ced-25e69e185a10-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5a21240-9279-424c-8ced-25e69e185a10" (UID: "a5a21240-9279-424c-8ced-25e69e185a10"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:09:15.709888 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.709848    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:09:15.797488 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-openshift-service-ca\") pod \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") "
Jul 17 06:09:15.797650 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797524    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kqjj\" (UniqueName: \"kubernetes.io/projected/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-kube-api-access-8kqjj\") pod \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") "
Jul 17 06:09:15.797650 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797628    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls\") pod \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\" (UID: \"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c\") "
Jul 17 06:09:15.797839 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797814    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" (UID: "9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:09:15.797905 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797834    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.797905 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797854    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.797905 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797883    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.797905 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797897    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkcgl\" (UniqueName: \"kubernetes.io/projected/a5a21240-9279-424c-8ced-25e69e185a10-kube-api-access-fkcgl\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.798046 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797928    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5a21240-9279-424c-8ced-25e69e185a10-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.798046 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797943    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.798046 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797955    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5a21240-9279-424c-8ced-25e69e185a10-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.798046 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.797967    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5a21240-9279-424c-8ced-25e69e185a10-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.799610 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.799588    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" (UID: "9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:09:15.799679 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.799644    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-kube-api-access-8kqjj" (OuterVolumeSpecName: "kube-api-access-8kqjj") pod "9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" (UID: "9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c"). InnerVolumeSpecName "kube-api-access-8kqjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:09:15.899503 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.899416    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kqjj\" (UniqueName: \"kubernetes.io/projected/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-kube-api-access-8kqjj\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.899503 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.899448    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.899503 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.899458    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:09:15.956661 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.956625    2559 generic.go:356] "Generic (PLEG): container finished" podID="a5a21240-9279-424c-8ced-25e69e185a10" containerID="416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b" exitCode=0
Jul 17 06:09:15.956834 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.956669    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"
Jul 17 06:09:15.956834 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.956706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" event={"ID":"a5a21240-9279-424c-8ced-25e69e185a10","Type":"ContainerDied","Data":"416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b"}
Jul 17 06:09:15.956834 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.956766    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457" event={"ID":"a5a21240-9279-424c-8ced-25e69e185a10","Type":"ContainerDied","Data":"3c2d96073d4ab7a7d26dcaf0b24b758ac10e653d701a8e13e21d644bcf2fd297"}
Jul 17 06:09:15.956834 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.956792    2559 scope.go:117] "RemoveContainer" containerID="416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b"
Jul 17 06:09:15.958081 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.958050    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"
Jul 17 06:09:15.958081 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.958051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8" event={"ID":"9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c","Type":"ContainerDied","Data":"64ae00d15ed6d6c4f8cc5d98361576ca92f949d958cb9a48ff8315e0637a66c6"}
Jul 17 06:09:15.966774 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.966753    2559 scope.go:117] "RemoveContainer" containerID="9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854"
Jul 17 06:09:15.975461 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.975442    2559 scope.go:117] "RemoveContainer" containerID="416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b"
Jul 17 06:09:15.975750 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:15.975732    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b\": container with ID starting with 416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b not found: ID does not exist" containerID="416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b"
Jul 17 06:09:15.975799 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.975762    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b"} err="failed to get container status \"416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b\": rpc error: code = NotFound desc = could not find container \"416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b\": container with ID starting with 416698c9f5f48f4754930ec84c4610b23f65a47598b1826331e8eca416a90b7b not found: ID does not exist"
Jul 17 06:09:15.975799 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.975779    2559 scope.go:117] "RemoveContainer" containerID="9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854"
Jul 17 06:09:15.976124 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:15.976107    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854\": container with ID starting with 9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854 not found: ID does not exist" containerID="9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854"
Jul 17 06:09:15.976205 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.976126    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854"} err="failed to get container status \"9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854\": rpc error: code = NotFound desc = could not find container \"9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854\": container with ID starting with 9bd91f4e6cbcd56f1d823f059d3692f0862d6ccb93e6d39b59597e80186e5854 not found: ID does not exist"
Jul 17 06:09:15.976205 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.976138    2559 scope.go:117] "RemoveContainer" containerID="06b8e1fb056287019501d2f8312ba65d5a3af9334b95b2ae670fadc61575b8e1"
Jul 17 06:09:15.981990 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.981969    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"]
Jul 17 06:09:15.985347 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.985329    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3232801c-56878c949f-59nx8"]
Jul 17 06:09:15.998649 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:15.998622    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"]
Jul 17 06:09:16.006170 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:16.006145    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3232801c-openshift-default-6d888c45c9-dl457"]
Jul 17 06:09:17.323858 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:17.323823    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" path="/var/lib/kubelet/pods/9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c/volumes"
Jul 17 06:09:17.324340 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:17.324324    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5a21240-9279-424c-8ced-25e69e185a10" path="/var/lib/kubelet/pods/a5a21240-9279-424c-8ced-25e69e185a10/volumes"
Jul 17 06:09:22.049722 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049298    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"]
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049882    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049899    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049906    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049912    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049919    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049925    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049933    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049940    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049948    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049953    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049961    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049969    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049980    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049985    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.049993    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050001    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050010    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050015    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050081    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050089    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050094    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050100    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5a21240-9279-424c-8ced-25e69e185a10" containerName="istio-proxy"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050108    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.050255 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.050118    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:22.054598 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.054576    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.057053 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.057033    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-97f0d5b3-openshift-default-dockercfg-xdt46\""
Jul 17 06:09:22.064162 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.063608    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"]
Jul 17 06:09:22.155883 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.155834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-socket\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.155909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59dfq\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-kube-api-access-59dfq\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.155939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-istio-token\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.155960    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-envoy\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.155985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-credential-socket\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.156030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-certs\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156333 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.156065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-data\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156333 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.156087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840f3658-3063-448b-a84f-6e5a679f012a-istio-podinfo\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.156333 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.156105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840f3658-3063-448b-a84f-6e5a679f012a-istiod-ca-cert\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257394 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-socket\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59dfq\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-kube-api-access-59dfq\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-istio-token\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-envoy\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-credential-socket\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-certs\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-data\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.257597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840f3658-3063-448b-a84f-6e5a679f012a-istio-podinfo\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.258012 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840f3658-3063-448b-a84f-6e5a679f012a-istiod-ca-cert\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.258012 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257834    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-socket\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.258012 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.257852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-credential-socket\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.258178 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.258007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-certs\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.258178 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.258022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-data\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.258474 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.258454    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840f3658-3063-448b-a84f-6e5a679f012a-istiod-ca-cert\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.259949 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.259923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-envoy\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.260095 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.260078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840f3658-3063-448b-a84f-6e5a679f012a-istio-podinfo\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.266638 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.266608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-istio-token\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.267293 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.267270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59dfq\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-kube-api-access-59dfq\") pod \"e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") " pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.369085 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.368997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:22.506239 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.506206    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"]
Jul 17 06:09:22.509749 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:09:22.509724    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840f3658_3063_448b_a84f_6e5a679f012a.slice/crio-9dd5de6e9cc6c4a2796d561fc0f49362b33c23e6ba4385e83a5c31901b0f30b6 WatchSource:0}: Error finding container 9dd5de6e9cc6c4a2796d561fc0f49362b33c23e6ba4385e83a5c31901b0f30b6: Status 404 returned error can't find the container with id 9dd5de6e9cc6c4a2796d561fc0f49362b33c23e6ba4385e83a5c31901b0f30b6
Jul 17 06:09:22.511978 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.511946    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:09:22.512072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.512012    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:09:22.512072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.512043    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:09:22.998806 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.998771    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" event={"ID":"840f3658-3063-448b-a84f-6e5a679f012a","Type":"ContainerStarted","Data":"a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2"}
Jul 17 06:09:22.999038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:22.998837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" event={"ID":"840f3658-3063-448b-a84f-6e5a679f012a","Type":"ContainerStarted","Data":"9dd5de6e9cc6c4a2796d561fc0f49362b33c23e6ba4385e83a5c31901b0f30b6"}
Jul 17 06:09:23.021089 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.021040    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" podStartSLOduration=1.021023692 podStartE2EDuration="1.021023692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:09:23.020522552 +0000 UTC m=+2186.195923958" watchObservedRunningTime="2026-07-17 06:09:23.021023692 +0000 UTC m=+2186.196425081"
Jul 17 06:09:23.308176 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.308141    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"]
Jul 17 06:09:23.308623 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.308590    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:23.308623 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.308604    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:23.308623 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.308612    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fffe0e4-1b11-4639-aa4a-dc7c79a2e60c" containerName="maas-api"
Jul 17 06:09:23.312031 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.312005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.314532 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.314514    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-97f0d5b3-serving-cert\""
Jul 17 06:09:23.329038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.329012    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"]
Jul 17 06:09:23.369757 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.369727    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:23.374484 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.374459    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:23.468422 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.468379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.468591 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.468477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j645m\" (UniqueName: \"kubernetes.io/projected/2e3e26c1-222a-4910-b71f-316999d9f37c-kube-api-access-j645m\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.468591 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.468576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3e26c1-222a-4910-b71f-316999d9f37c-openshift-service-ca\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.569174 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.569089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j645m\" (UniqueName: \"kubernetes.io/projected/2e3e26c1-222a-4910-b71f-316999d9f37c-kube-api-access-j645m\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.569174 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.569145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3e26c1-222a-4910-b71f-316999d9f37c-openshift-service-ca\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.569384 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.569272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.569429 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:23.569398    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-serving-cert: secret "maas-api-e2e-derive-97f0d5b3-serving-cert" not found
Jul 17 06:09:23.569487 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:23.569477    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls podName:2e3e26c1-222a-4910-b71f-316999d9f37c nodeName:}" failed. No retries permitted until 2026-07-17 06:09:24.069454336 +0000 UTC m=+2187.244855709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls") pod "maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" (UID: "2e3e26c1-222a-4910-b71f-316999d9f37c") : secret "maas-api-e2e-derive-97f0d5b3-serving-cert" not found
Jul 17 06:09:23.570060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.570039    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3e26c1-222a-4910-b71f-316999d9f37c-openshift-service-ca\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:23.598126 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:23.598094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j645m\" (UniqueName: \"kubernetes.io/projected/2e3e26c1-222a-4910-b71f-316999d9f37c-kube-api-access-j645m\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:24.011752 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:24.011666    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:24.012704 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:24.012684    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:24.074616 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:24.074582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:24.077358 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:24.077326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls\") pod \"maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:24.227325 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:24.227286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:24.587251 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:24.587227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"]
Jul 17 06:09:24.589586 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:09:24.589556    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3e26c1_222a_4910_b71f_316999d9f37c.slice/crio-764ceaeede269cca90135f248fa22abdcb7378b3ba6d7987dfd9f4fa38d0676a WatchSource:0}: Error finding container 764ceaeede269cca90135f248fa22abdcb7378b3ba6d7987dfd9f4fa38d0676a: Status 404 returned error can't find the container with id 764ceaeede269cca90135f248fa22abdcb7378b3ba6d7987dfd9f4fa38d0676a
Jul 17 06:09:25.016997 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:25.016905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerStarted","Data":"764ceaeede269cca90135f248fa22abdcb7378b3ba6d7987dfd9f4fa38d0676a"}
Jul 17 06:09:26.023782 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:26.023744    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerID="368357eab3ec1e387c67c7ef360a5bf7408ded6a5d56348f9657f60c71803405" exitCode=1
Jul 17 06:09:26.024194 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:26.023837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerDied","Data":"368357eab3ec1e387c67c7ef360a5bf7408ded6a5d56348f9657f60c71803405"}
Jul 17 06:09:26.024194 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:26.024091    2559 scope.go:117] "RemoveContainer" containerID="368357eab3ec1e387c67c7ef360a5bf7408ded6a5d56348f9657f60c71803405"
Jul 17 06:09:27.030300 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:27.030249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerStarted","Data":"464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1"}
Jul 17 06:09:27.030674 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:27.030347    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:27.049451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:27.049394    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podStartSLOduration=2.370690085 podStartE2EDuration="4.04937897s" totalImagesPullingTime="1.678688885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:09:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:09:27.046660923 +0000 UTC m=+2190.222062312" watchObservedRunningTime="2026-07-17 06:09:27.04937897 +0000 UTC m=+2190.224780358"
Jul 17 06:09:28.037055 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:28.037024    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerID="464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1" exitCode=1
Jul 17 06:09:28.037505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:28.037116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerDied","Data":"464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1"}
Jul 17 06:09:28.037505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:28.037182    2559 scope.go:117] "RemoveContainer" containerID="368357eab3ec1e387c67c7ef360a5bf7408ded6a5d56348f9657f60c71803405"
Jul 17 06:09:28.037505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:28.037338    2559 scope.go:117] "RemoveContainer" containerID="464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1"
Jul 17 06:09:28.037679 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:28.037532    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:09:29.044204 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:29.044177    2559 scope.go:117] "RemoveContainer" containerID="464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1"
Jul 17 06:09:29.044643 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:29.044408    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:09:34.228139 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:34.228096    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:34.229556 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:34.228616    2559 scope.go:117] "RemoveContainer" containerID="464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1"
Jul 17 06:09:34.229556 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:34.228811    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:09:35.077198 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:35.077164    2559 generic.go:356] "Generic (PLEG): container finished" podID="840f3658-3063-448b-a84f-6e5a679f012a" containerID="a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2" exitCode=0
Jul 17 06:09:35.077371 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:35.077218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" event={"ID":"840f3658-3063-448b-a84f-6e5a679f012a","Type":"ContainerDied","Data":"a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2"}
Jul 17 06:09:35.077597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:35.077583    2559 scope.go:117] "RemoveContainer" containerID="a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2"
Jul 17 06:09:35.078573 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:35.078546    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:09:35.078627 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:35.078613    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:09:35.078664 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:35.078653    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:09:36.085081 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:36.085046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" event={"ID":"840f3658-3063-448b-a84f-6e5a679f012a","Type":"ContainerStarted","Data":"a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448"}
Jul 17 06:09:36.370441 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:36.370401    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:36.371769 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:36.371739    2559 patch_prober.go:28] interesting pod/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 06:09:36.372000 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:36.371976    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 06:09:37.369482 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:37.369442    2559 patch_prober.go:28] interesting pod/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 06:09:37.369998 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:37.369511    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 06:09:38.369632 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:38.369594    2559 patch_prober.go:28] interesting pod/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 06:09:38.370244 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:38.370213    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 06:09:39.011953 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:39.011917    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:39.369908 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:39.369840    2559 patch_prober.go:28] interesting pod/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 06:09:39.370424 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:39.369945    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 06:09:40.373758 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:40.373724    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:40.374654 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:40.374636    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:09:44.318563 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:44.318528    2559 scope.go:117] "RemoveContainer" containerID="464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1"
Jul 17 06:09:45.138179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:45.138147    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerID="e2d2bf8081bb2953fbe5809633d5729fb8a048b76084c53b861cdf9106d582db" exitCode=1
Jul 17 06:09:45.138355 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:45.138183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerDied","Data":"e2d2bf8081bb2953fbe5809633d5729fb8a048b76084c53b861cdf9106d582db"}
Jul 17 06:09:45.138355 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:45.138239    2559 scope.go:117] "RemoveContainer" containerID="464bf4c266714b4f73f5ae82c0557656f0f1d9f08f134a6dcb35c8301c286ba1"
Jul 17 06:09:45.138667 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:45.138646    2559 scope.go:117] "RemoveContainer" containerID="e2d2bf8081bb2953fbe5809633d5729fb8a048b76084c53b861cdf9106d582db"
Jul 17 06:09:45.138938 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:45.138904    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:09:47.031455 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:47.031421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:47.031937 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:47.031790    2559 scope.go:117] "RemoveContainer" containerID="e2d2bf8081bb2953fbe5809633d5729fb8a048b76084c53b861cdf9106d582db"
Jul 17 06:09:47.032032 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:47.032013    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:09:54.227897 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:54.227815    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:09:54.228308 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:09:54.228293    2559 scope.go:117] "RemoveContainer" containerID="e2d2bf8081bb2953fbe5809633d5729fb8a048b76084c53b861cdf9106d582db"
Jul 17 06:09:54.228510 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:09:54.228490    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:10:05.318788 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:05.318754    2559 scope.go:117] "RemoveContainer" containerID="e2d2bf8081bb2953fbe5809633d5729fb8a048b76084c53b861cdf9106d582db"
Jul 17 06:10:06.256041 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:06.256008    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b" exitCode=1
Jul 17 06:10:06.256209 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:06.256080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerDied","Data":"dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"}
Jul 17 06:10:06.256209 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:06.256141    2559 scope.go:117] "RemoveContainer" containerID="e2d2bf8081bb2953fbe5809633d5729fb8a048b76084c53b861cdf9106d582db"
Jul 17 06:10:06.256505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:06.256486    2559 scope.go:117] "RemoveContainer" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"
Jul 17 06:10:06.256737 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:10:06.256703    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:10:07.031045 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:07.031012    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:10:07.262555 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:07.262526    2559 scope.go:117] "RemoveContainer" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"
Jul 17 06:10:07.262762 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:10:07.262742    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:10:14.227452 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:14.227418    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:10:14.227825 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:14.227756    2559 scope.go:117] "RemoveContainer" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"
Jul 17 06:10:14.227999 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:10:14.227977    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:10:26.318179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:26.318106    2559 scope.go:117] "RemoveContainer" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"
Jul 17 06:10:26.318608 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:10:26.318341    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:10:40.318615 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:40.318583    2559 scope.go:117] "RemoveContainer" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"
Jul 17 06:10:40.319043 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:10:40.318779    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:10:54.318081 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:54.318046    2559 scope.go:117] "RemoveContainer" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"
Jul 17 06:10:55.500595 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:55.500565    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3" exitCode=1
Jul 17 06:10:55.501111 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:55.500609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerDied","Data":"1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"}
Jul 17 06:10:55.501111 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:55.500657    2559 scope.go:117] "RemoveContainer" containerID="dd3ce02a434782760d392f4fe9bf5274d787c3f0f8bf5fdedd54541e5f30292b"
Jul 17 06:10:55.501111 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:55.501080    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:10:55.501335 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:10:55.501309    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:10:57.030652 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:57.030617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:10:57.031066 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:10:57.030974    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:10:57.031201 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:10:57.031180    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:11:04.227667 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:11:04.227625    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:11:04.228196 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:11:04.228038    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:11:04.228244 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:11:04.228202    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:11:15.319186 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:11:15.319152    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:11:15.319711 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:11:15.319350    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:11:26.319039 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:11:26.319002    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:11:26.319448 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:11:26.319172    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:11:39.319047 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:11:39.319010    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:11:39.319471 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:11:39.319227    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:11:52.319125 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:11:52.319024    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:11:52.320092 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:11:52.320058    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:12:05.318923 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:05.318887    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:12:05.319329 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:12:05.319076    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:12:18.318993 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:18.318961    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:12:18.926450 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:18.926411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerStarted","Data":"09574e21ab76d82da96ad6c648a800addcef635c379c21c919f18a51545279a0"}
Jul 17 06:12:18.926643 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:18.926625    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:12:19.932802 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:19.932766    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerID="09574e21ab76d82da96ad6c648a800addcef635c379c21c919f18a51545279a0" exitCode=1
Jul 17 06:12:19.933306 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:19.932851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerDied","Data":"09574e21ab76d82da96ad6c648a800addcef635c379c21c919f18a51545279a0"}
Jul 17 06:12:19.933306 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:19.932935    2559 scope.go:117] "RemoveContainer" containerID="1000e56275c248f1cd40b1b9628a2a5d02be680f39559386cb18a4c8fe4be6b3"
Jul 17 06:12:19.933306 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:19.933149    2559 scope.go:117] "RemoveContainer" containerID="09574e21ab76d82da96ad6c648a800addcef635c379c21c919f18a51545279a0"
Jul 17 06:12:19.933428 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:12:19.933358    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:12:20.940120 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:20.940083    2559 scope.go:117] "RemoveContainer" containerID="09574e21ab76d82da96ad6c648a800addcef635c379c21c919f18a51545279a0"
Jul 17 06:12:20.940506 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:12:20.940252    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:12:24.228063 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:24.228027    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:12:24.228459 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:24.228393    2559 scope.go:117] "RemoveContainer" containerID="09574e21ab76d82da96ad6c648a800addcef635c379c21c919f18a51545279a0"
Jul 17 06:12:24.228585 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:12:24.228565    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82_odh-ai-gateway-infra(2e3e26c1-222a-4910-b71f-316999d9f37c)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c"
Jul 17 06:12:27.791860 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:27.791824    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"]
Jul 17 06:12:27.973395 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:27.973354    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy" containerID="cri-o://a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448" gracePeriod=30
Jul 17 06:12:33.241437 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.241374    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:12:33.325224 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325196    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-credential-socket\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325248    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-certs\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325289    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59dfq\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-kube-api-access-59dfq\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325343    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-envoy\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-socket\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325390    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-data\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325413    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840f3658-3063-448b-a84f-6e5a679f012a-istiod-ca-cert\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325740 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-istio-token\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325740 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325485    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840f3658-3063-448b-a84f-6e5a679f012a-istio-podinfo\") pod \"840f3658-3063-448b-a84f-6e5a679f012a\" (UID: \"840f3658-3063-448b-a84f-6e5a679f012a\") "
Jul 17 06:12:33.325740 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:12:33.325740 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325590    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:12:33.326662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325954    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.326662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.325974    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.326662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.326046    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:12:33.326662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.326143    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840f3658-3063-448b-a84f-6e5a679f012a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:12:33.326662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.326418    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-data" (OuterVolumeSpecName: "istio-data") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:12:33.328181 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.328151    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/840f3658-3063-448b-a84f-6e5a679f012a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:12:33.328311 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.328283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:12:33.328370 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.328338    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-kube-api-access-59dfq" (OuterVolumeSpecName: "kube-api-access-59dfq") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "kube-api-access-59dfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:12:33.328447 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.328421    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-istio-token" (OuterVolumeSpecName: "istio-token") pod "840f3658-3063-448b-a84f-6e5a679f012a" (UID: "840f3658-3063-448b-a84f-6e5a679f012a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:12:33.427466 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.427433    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.427466 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.427466    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.427466 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.427481    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840f3658-3063-448b-a84f-6e5a679f012a-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.427752 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.427495    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840f3658-3063-448b-a84f-6e5a679f012a-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.427752 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.427507    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.427752 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.427520    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840f3658-3063-448b-a84f-6e5a679f012a-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.427752 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.427534    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59dfq\" (UniqueName: \"kubernetes.io/projected/840f3658-3063-448b-a84f-6e5a679f012a-kube-api-access-59dfq\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:33.750969 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.750930    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"]
Jul 17 06:12:33.889546 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.889503    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:12:33.931697 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.931662    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls\") pod \"2e3e26c1-222a-4910-b71f-316999d9f37c\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") "
Jul 17 06:12:33.931904 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.931713    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j645m\" (UniqueName: \"kubernetes.io/projected/2e3e26c1-222a-4910-b71f-316999d9f37c-kube-api-access-j645m\") pod \"2e3e26c1-222a-4910-b71f-316999d9f37c\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") "
Jul 17 06:12:33.931904 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.931762    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3e26c1-222a-4910-b71f-316999d9f37c-openshift-service-ca\") pod \"2e3e26c1-222a-4910-b71f-316999d9f37c\" (UID: \"2e3e26c1-222a-4910-b71f-316999d9f37c\") "
Jul 17 06:12:33.932225 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.932192    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e3e26c1-222a-4910-b71f-316999d9f37c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e3e26c1-222a-4910-b71f-316999d9f37c" (UID: "2e3e26c1-222a-4910-b71f-316999d9f37c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:12:33.933824 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.933799    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3e26c1-222a-4910-b71f-316999d9f37c-kube-api-access-j645m" (OuterVolumeSpecName: "kube-api-access-j645m") pod "2e3e26c1-222a-4910-b71f-316999d9f37c" (UID: "2e3e26c1-222a-4910-b71f-316999d9f37c"). InnerVolumeSpecName "kube-api-access-j645m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:12:33.933923 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:33.933844    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e3e26c1-222a-4910-b71f-316999d9f37c" (UID: "2e3e26c1-222a-4910-b71f-316999d9f37c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:12:34.004381 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.004304    2559 generic.go:356] "Generic (PLEG): container finished" podID="840f3658-3063-448b-a84f-6e5a679f012a" containerID="a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448" exitCode=0
Jul 17 06:12:34.004381 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.004354    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"
Jul 17 06:12:34.004579 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.004386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" event={"ID":"840f3658-3063-448b-a84f-6e5a679f012a","Type":"ContainerDied","Data":"a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448"}
Jul 17 06:12:34.004579 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.004444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl" event={"ID":"840f3658-3063-448b-a84f-6e5a679f012a","Type":"ContainerDied","Data":"9dd5de6e9cc6c4a2796d561fc0f49362b33c23e6ba4385e83a5c31901b0f30b6"}
Jul 17 06:12:34.004579 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.004476    2559 scope.go:117] "RemoveContainer" containerID="a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448"
Jul 17 06:12:34.005796 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.005762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82" event={"ID":"2e3e26c1-222a-4910-b71f-316999d9f37c","Type":"ContainerDied","Data":"764ceaeede269cca90135f248fa22abdcb7378b3ba6d7987dfd9f4fa38d0676a"}
Jul 17 06:12:34.005796 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.005789    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"
Jul 17 06:12:34.013730 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.013700    2559 scope.go:117] "RemoveContainer" containerID="a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2"
Jul 17 06:12:34.022049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.022028    2559 scope.go:117] "RemoveContainer" containerID="a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448"
Jul 17 06:12:34.022293 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:12:34.022277    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448\": container with ID starting with a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448 not found: ID does not exist" containerID="a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448"
Jul 17 06:12:34.022349 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.022300    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448"} err="failed to get container status \"a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448\": rpc error: code = NotFound desc = could not find container \"a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448\": container with ID starting with a34e4ea255c811473c5ddbc488e0e89873c112bccb2f322cd723d2b8b233c448 not found: ID does not exist"
Jul 17 06:12:34.022349 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.022315    2559 scope.go:117] "RemoveContainer" containerID="a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2"
Jul 17 06:12:34.022539 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:12:34.022518    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2\": container with ID starting with a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2 not found: ID does not exist" containerID="a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2"
Jul 17 06:12:34.022599 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.022550    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2"} err="failed to get container status \"a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2\": rpc error: code = NotFound desc = could not find container \"a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2\": container with ID starting with a59a122a235a32f61509ac71b47ebaf1d5fbf40a2fef4e9e0786b3a086c703a2 not found: ID does not exist"
Jul 17 06:12:34.022599 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.022574    2559 scope.go:117] "RemoveContainer" containerID="09574e21ab76d82da96ad6c648a800addcef635c379c21c919f18a51545279a0"
Jul 17 06:12:34.031862 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.031839    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"]
Jul 17 06:12:34.032785 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.032768    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3e26c1-222a-4910-b71f-316999d9f37c-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:34.032861 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.032789    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j645m\" (UniqueName: \"kubernetes.io/projected/2e3e26c1-222a-4910-b71f-316999d9f37c-kube-api-access-j645m\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:34.032861 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.032799    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3e26c1-222a-4910-b71f-316999d9f37c-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:12:34.034606 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.034588    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-97f0d5b3-7ccbbc59cd-85g82"]
Jul 17 06:12:34.045006 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.044985    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"]
Jul 17 06:12:34.051879 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:34.051849    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-97f0d5b3-openshift-default-68dd79bb67-52xzl"]
Jul 17 06:12:35.324665 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:35.324633    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" path="/var/lib/kubelet/pods/2e3e26c1-222a-4910-b71f-316999d9f37c/volumes"
Jul 17 06:12:35.325165 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:35.325151    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="840f3658-3063-448b-a84f-6e5a679f012a" path="/var/lib/kubelet/pods/840f3658-3063-448b-a84f-6e5a679f012a/volumes"
Jul 17 06:12:57.436116 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:57.436087    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:12:57.440275 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:12:57.440247    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:14:15.241496 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.241456    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"]
Jul 17 06:14:15.242102 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242052    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242102 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242067    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242102 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242080    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy"
Jul 17 06:14:15.242102 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242090    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242106    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242114    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242126    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242135    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242146    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242153    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242176    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242183    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242195    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242202    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242286    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242296    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242306    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242315    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy"
Jul 17 06:14:15.242588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242324    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.242588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.242331    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:15.245920 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.245899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.248508 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.248487    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-67214823-openshift-default-dockercfg-pn67k\""
Jul 17 06:14:15.256184 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.256158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"]
Jul 17 06:14:15.347689 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.347641    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b1b23b-7272-425a-ac46-a149fca54958-istio-podinfo\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.347689 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.347691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-credential-socket\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.347971 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.347724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-istio-token\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.347971 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.347846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-socket\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.348087 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.347974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-data\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.348087 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.348007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-certs\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.348087 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.348044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm6fd\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-kube-api-access-xm6fd\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.348259 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.348076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-envoy\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.348259 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.348194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b1b23b-7272-425a-ac46-a149fca54958-istiod-ca-cert\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449352 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-istio-token\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449542 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-socket\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449542 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-data\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449542 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-certs\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449542 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm6fd\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-kube-api-access-xm6fd\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449542 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-envoy\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449823 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b1b23b-7272-425a-ac46-a149fca54958-istiod-ca-cert\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449823 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-socket\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449823 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449784    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-data\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.449823 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b1b23b-7272-425a-ac46-a149fca54958-istio-podinfo\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.450104 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-credential-socket\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.450104 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.449899    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-certs\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.450221 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.450166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-credential-socket\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.450642 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.450614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b1b23b-7272-425a-ac46-a149fca54958-istiod-ca-cert\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.451948 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.451921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-envoy\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.452276 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.452254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b1b23b-7272-425a-ac46-a149fca54958-istio-podinfo\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.458468 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.458445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-istio-token\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.458883 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.458853    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm6fd\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-kube-api-access-xm6fd\") pod \"e2e-mt-67214823-openshift-default-674978f57f-9hg2m\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") " pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.558637 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.558608    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:15.701337 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.701308    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"]
Jul 17 06:14:15.703557 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:14:15.703529    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b1b23b_7272_425a_ac46_a149fca54958.slice/crio-487a949914a44a9e2a81fa2d7d2c338cb70cdecb022bf271670b6c86000528a9 WatchSource:0}: Error finding container 487a949914a44a9e2a81fa2d7d2c338cb70cdecb022bf271670b6c86000528a9: Status 404 returned error can't find the container with id 487a949914a44a9e2a81fa2d7d2c338cb70cdecb022bf271670b6c86000528a9
Jul 17 06:14:15.706133 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.706098    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:14:15.706208 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.706166    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:14:15.706208 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:15.706197    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:14:16.506974 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:16.506933    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" event={"ID":"41b1b23b-7272-425a-ac46-a149fca54958","Type":"ContainerStarted","Data":"a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335"}
Jul 17 06:14:16.507408 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:16.507005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" event={"ID":"41b1b23b-7272-425a-ac46-a149fca54958","Type":"ContainerStarted","Data":"487a949914a44a9e2a81fa2d7d2c338cb70cdecb022bf271670b6c86000528a9"}
Jul 17 06:14:16.530175 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:16.530120    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" podStartSLOduration=1.530101987 podStartE2EDuration="1.530101987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:16.527541467 +0000 UTC m=+2479.702942874" watchObservedRunningTime="2026-07-17 06:14:16.530101987 +0000 UTC m=+2479.705503381"
Jul 17 06:14:16.559091 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:16.559055    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:16.560721 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:16.560691    2559 patch_prober.go:28] interesting pod/e2e-mt-67214823-openshift-default-674978f57f-9hg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 17 06:14:16.560886 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:16.560740    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 17 06:14:17.563179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:17.563146    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:18.517097 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.517059    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:18.518143 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.518124    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:18.703923 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.703891    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"]
Jul 17 06:14:18.704481 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.704462    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:18.704532 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.704484    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:18.704590 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.704578    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="840f3658-3063-448b-a84f-6e5a679f012a" containerName="istio-proxy"
Jul 17 06:14:18.704625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.704597    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3e26c1-222a-4910-b71f-316999d9f37c" containerName="maas-api"
Jul 17 06:14:18.708185 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.708167    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.711146 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.711125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-67214823-serving-cert\""
Jul 17 06:14:18.735020 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.734995    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"]
Jul 17 06:14:18.786948 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.786841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f31b94-7d10-4564-a760-a617092b4eb7-maas-api-tls\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.787103 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.786929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f31b94-7d10-4564-a760-a617092b4eb7-openshift-service-ca\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.787156 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.787141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfbp\" (UniqueName: \"kubernetes.io/projected/17f31b94-7d10-4564-a760-a617092b4eb7-kube-api-access-xkfbp\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.887792 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.887757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f31b94-7d10-4564-a760-a617092b4eb7-maas-api-tls\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.888002 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.887808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f31b94-7d10-4564-a760-a617092b4eb7-openshift-service-ca\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.888002 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.887840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfbp\" (UniqueName: \"kubernetes.io/projected/17f31b94-7d10-4564-a760-a617092b4eb7-kube-api-access-xkfbp\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.888524 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.888500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f31b94-7d10-4564-a760-a617092b4eb7-openshift-service-ca\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.890205 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.890184    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f31b94-7d10-4564-a760-a617092b4eb7-maas-api-tls\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:18.896903 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:18.896848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfbp\" (UniqueName: \"kubernetes.io/projected/17f31b94-7d10-4564-a760-a617092b4eb7-kube-api-access-xkfbp\") pod \"maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:19.018309 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:19.018267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:19.157378 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:19.157350    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"]
Jul 17 06:14:19.160150 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:14:19.160125    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f31b94_7d10_4564_a760_a617092b4eb7.slice/crio-1fe831f77d01013a08912ac5bb59279f40e36af46fc620b4b695ab9d1cb5662d WatchSource:0}: Error finding container 1fe831f77d01013a08912ac5bb59279f40e36af46fc620b4b695ab9d1cb5662d: Status 404 returned error can't find the container with id 1fe831f77d01013a08912ac5bb59279f40e36af46fc620b4b695ab9d1cb5662d
Jul 17 06:14:19.163258 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:19.162124    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 06:14:19.522573 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:19.522481    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl" event={"ID":"17f31b94-7d10-4564-a760-a617092b4eb7","Type":"ContainerStarted","Data":"1fe831f77d01013a08912ac5bb59279f40e36af46fc620b4b695ab9d1cb5662d"}
Jul 17 06:14:20.528240 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:20.528203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl" event={"ID":"17f31b94-7d10-4564-a760-a617092b4eb7","Type":"ContainerStarted","Data":"3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421"}
Jul 17 06:14:20.528619 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:20.528527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:20.546611 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:20.546562    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl" podStartSLOduration=2.019760227 podStartE2EDuration="2.546546785s" totalImagesPullingTime="526.786558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:14:20.545526745 +0000 UTC m=+2483.720928133" watchObservedRunningTime="2026-07-17 06:14:20.546546785 +0000 UTC m=+2483.721948220"
Jul 17 06:14:26.539060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:26.539028    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:31.586843 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:31.586813    2559 generic.go:356] "Generic (PLEG): container finished" podID="41b1b23b-7272-425a-ac46-a149fca54958" containerID="a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335" exitCode=0
Jul 17 06:14:31.587303 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:31.586910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" event={"ID":"41b1b23b-7272-425a-ac46-a149fca54958","Type":"ContainerDied","Data":"a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335"}
Jul 17 06:14:31.587423 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:31.587407    2559 scope.go:117] "RemoveContainer" containerID="a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335"
Jul 17 06:14:31.588427 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:31.588388    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:14:31.588524 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:31.588463    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:14:31.588524 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:31.588496    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:14:32.594232 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:32.594199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" event={"ID":"41b1b23b-7272-425a-ac46-a149fca54958","Type":"ContainerStarted","Data":"98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5"}
Jul 17 06:14:33.517851 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:33.517809    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:33.559215 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:33.559179    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:33.560476 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:33.560450    2559 patch_prober.go:28] interesting pod/e2e-mt-67214823-openshift-default-674978f57f-9hg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 17 06:14:33.560579 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:33.560511    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 17 06:14:34.559778 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:34.559742    2559 patch_prober.go:28] interesting pod/e2e-mt-67214823-openshift-default-674978f57f-9hg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 17 06:14:34.560196 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:34.559806    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 17 06:14:35.559828 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:35.559797    2559 patch_prober.go:28] interesting pod/e2e-mt-67214823-openshift-default-674978f57f-9hg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 17 06:14:35.560215 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:35.559849    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 17 06:14:36.563668 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:36.563638    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:36.564833 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:36.564813    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:14:40.877371 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:40.877331    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"]
Jul 17 06:14:40.877838 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:40.877598    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl" podUID="17f31b94-7d10-4564-a760-a617092b4eb7" containerName="maas-api" containerID="cri-o://3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421" gracePeriod=30
Jul 17 06:14:41.133820 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.133758    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:41.196975 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.196941    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkfbp\" (UniqueName: \"kubernetes.io/projected/17f31b94-7d10-4564-a760-a617092b4eb7-kube-api-access-xkfbp\") pod \"17f31b94-7d10-4564-a760-a617092b4eb7\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") "
Jul 17 06:14:41.197110 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.196996    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f31b94-7d10-4564-a760-a617092b4eb7-openshift-service-ca\") pod \"17f31b94-7d10-4564-a760-a617092b4eb7\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") "
Jul 17 06:14:41.197110 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.197042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f31b94-7d10-4564-a760-a617092b4eb7-maas-api-tls\") pod \"17f31b94-7d10-4564-a760-a617092b4eb7\" (UID: \"17f31b94-7d10-4564-a760-a617092b4eb7\") "
Jul 17 06:14:41.197387 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.197350    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f31b94-7d10-4564-a760-a617092b4eb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17f31b94-7d10-4564-a760-a617092b4eb7" (UID: "17f31b94-7d10-4564-a760-a617092b4eb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:14:41.199124 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.199099    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f31b94-7d10-4564-a760-a617092b4eb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17f31b94-7d10-4564-a760-a617092b4eb7" (UID: "17f31b94-7d10-4564-a760-a617092b4eb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:14:41.199223 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.199201    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f31b94-7d10-4564-a760-a617092b4eb7-kube-api-access-xkfbp" (OuterVolumeSpecName: "kube-api-access-xkfbp") pod "17f31b94-7d10-4564-a760-a617092b4eb7" (UID: "17f31b94-7d10-4564-a760-a617092b4eb7"). InnerVolumeSpecName "kube-api-access-xkfbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:14:41.297930 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.297897    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkfbp\" (UniqueName: \"kubernetes.io/projected/17f31b94-7d10-4564-a760-a617092b4eb7-kube-api-access-xkfbp\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:14:41.297930 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.297924    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17f31b94-7d10-4564-a760-a617092b4eb7-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:14:41.297930 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.297935    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17f31b94-7d10-4564-a760-a617092b4eb7-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:14:41.641704 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.641667    2559 generic.go:356] "Generic (PLEG): container finished" podID="17f31b94-7d10-4564-a760-a617092b4eb7" containerID="3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421" exitCode=0
Jul 17 06:14:41.641898 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.641719    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"
Jul 17 06:14:41.641898 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.641754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl" event={"ID":"17f31b94-7d10-4564-a760-a617092b4eb7","Type":"ContainerDied","Data":"3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421"}
Jul 17 06:14:41.641898 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.641799    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl" event={"ID":"17f31b94-7d10-4564-a760-a617092b4eb7","Type":"ContainerDied","Data":"1fe831f77d01013a08912ac5bb59279f40e36af46fc620b4b695ab9d1cb5662d"}
Jul 17 06:14:41.641898 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.641824    2559 scope.go:117] "RemoveContainer" containerID="3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421"
Jul 17 06:14:41.652941 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.652925    2559 scope.go:117] "RemoveContainer" containerID="3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421"
Jul 17 06:14:41.653217 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:14:41.653198    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421\": container with ID starting with 3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421 not found: ID does not exist" containerID="3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421"
Jul 17 06:14:41.653279 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.653228    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421"} err="failed to get container status \"3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421\": rpc error: code = NotFound desc = could not find container \"3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421\": container with ID starting with 3b80bd0ebc86647ebf818e9c6ffe024fea8445f2d059e1bb5ade1414fda8e421 not found: ID does not exist"
Jul 17 06:14:41.661322 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.661300    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"]
Jul 17 06:14:41.665311 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:41.665288    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-67214823-6c4c7bd4bc-dhdhl"]
Jul 17 06:14:43.326586 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:43.326528    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f31b94-7d10-4564-a760-a617092b4eb7" path="/var/lib/kubelet/pods/17f31b94-7d10-4564-a760-a617092b4eb7/volumes"
Jul 17 06:14:56.084272 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:56.084189    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"]
Jul 17 06:14:56.084666 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:14:56.084526    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy" containerID="cri-o://98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5" gracePeriod=30
Jul 17 06:15:01.346510 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.346483    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:15:01.475821 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.475738    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-istio-token\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.475821 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.475800    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-envoy\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.475821 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.475820    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b1b23b-7272-425a-ac46-a149fca54958-istiod-ca-cert\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.476065 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.475879    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-certs\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.476065 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.475924    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-credential-socket\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.476065 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.475977    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-socket\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.476179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476093    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b1b23b-7272-425a-ac46-a149fca54958-istio-podinfo\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.476179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476128    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-data\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.476179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476162    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm6fd\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-kube-api-access-xm6fd\") pod \"41b1b23b-7272-425a-ac46-a149fca54958\" (UID: \"41b1b23b-7272-425a-ac46-a149fca54958\") "
Jul 17 06:15:01.476332 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476206    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:15:01.476332 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:15:01.476332 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476244    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41b1b23b-7272-425a-ac46-a149fca54958-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:15:01.476507 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476442    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:15:01.476566 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476523    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.476566 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476544    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41b1b23b-7272-425a-ac46-a149fca54958-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.476566 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476558    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.476725 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476570    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.476957 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.476936    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-data" (OuterVolumeSpecName: "istio-data") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:15:01.477962 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.477941    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-istio-token" (OuterVolumeSpecName: "istio-token") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:15:01.478192 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.478175    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41b1b23b-7272-425a-ac46-a149fca54958-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:15:01.478409 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.478382    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:15:01.478523 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.478439    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-kube-api-access-xm6fd" (OuterVolumeSpecName: "kube-api-access-xm6fd") pod "41b1b23b-7272-425a-ac46-a149fca54958" (UID: "41b1b23b-7272-425a-ac46-a149fca54958"). InnerVolumeSpecName "kube-api-access-xm6fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:15:01.577248 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.577211    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.577248 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.577243    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm6fd\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-kube-api-access-xm6fd\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.577248 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.577254    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41b1b23b-7272-425a-ac46-a149fca54958-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.577499 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.577263    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41b1b23b-7272-425a-ac46-a149fca54958-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.577499 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.577271    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41b1b23b-7272-425a-ac46-a149fca54958-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:15:01.747619 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.747533    2559 generic.go:356] "Generic (PLEG): container finished" podID="41b1b23b-7272-425a-ac46-a149fca54958" containerID="98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5" exitCode=0
Jul 17 06:15:01.747619 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.747580    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"
Jul 17 06:15:01.747619 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.747606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" event={"ID":"41b1b23b-7272-425a-ac46-a149fca54958","Type":"ContainerDied","Data":"98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5"}
Jul 17 06:15:01.747894 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.747652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m" event={"ID":"41b1b23b-7272-425a-ac46-a149fca54958","Type":"ContainerDied","Data":"487a949914a44a9e2a81fa2d7d2c338cb70cdecb022bf271670b6c86000528a9"}
Jul 17 06:15:01.747894 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.747676    2559 scope.go:117] "RemoveContainer" containerID="98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5"
Jul 17 06:15:01.756698 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.756681    2559 scope.go:117] "RemoveContainer" containerID="a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335"
Jul 17 06:15:01.765120 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.765101    2559 scope.go:117] "RemoveContainer" containerID="98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5"
Jul 17 06:15:01.765362 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:15:01.765340    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5\": container with ID starting with 98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5 not found: ID does not exist" containerID="98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5"
Jul 17 06:15:01.765417 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.765370    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5"} err="failed to get container status \"98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5\": rpc error: code = NotFound desc = could not find container \"98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5\": container with ID starting with 98dd002eb942c07c5d4285adcd05affc005fdd0964b01ca05ec358a9be201bb5 not found: ID does not exist"
Jul 17 06:15:01.765417 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.765387    2559 scope.go:117] "RemoveContainer" containerID="a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335"
Jul 17 06:15:01.765657 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:15:01.765634    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335\": container with ID starting with a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335 not found: ID does not exist" containerID="a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335"
Jul 17 06:15:01.765708 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.765663    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335"} err="failed to get container status \"a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335\": rpc error: code = NotFound desc = could not find container \"a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335\": container with ID starting with a2c397e52853ea0f792d2b1c4ce269efae06f7cc8b96a201fd2a515f42a61335 not found: ID does not exist"
Jul 17 06:15:01.769461 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.769439    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"]
Jul 17 06:15:01.775176 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:01.775153    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-67214823-openshift-default-674978f57f-9hg2m"]
Jul 17 06:15:03.324372 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:03.324335    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b1b23b-7272-425a-ac46-a149fca54958" path="/var/lib/kubelet/pods/41b1b23b-7272-425a-ac46-a149fca54958/volumes"
Jul 17 06:15:16.016403 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.016367    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"]
Jul 17 06:15:16.017211 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017187    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy"
Jul 17 06:15:16.017400 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017371    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy"
Jul 17 06:15:16.017400 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017394    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy"
Jul 17 06:15:16.017400 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017403    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy"
Jul 17 06:15:16.017655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017441    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f31b94-7d10-4564-a760-a617092b4eb7" containerName="maas-api"
Jul 17 06:15:16.017655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017447    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f31b94-7d10-4564-a760-a617092b4eb7" containerName="maas-api"
Jul 17 06:15:16.017655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017531    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy"
Jul 17 06:15:16.017655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.017542    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f31b94-7d10-4564-a760-a617092b4eb7" containerName="maas-api"
Jul 17 06:15:16.020514 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.020489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.023317 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.023294    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-603a20da-openshift-default-dockercfg-t974n\""
Jul 17 06:15:16.033773 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.033747    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"]
Jul 17 06:15:16.212799 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.212761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-credential-socket\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213089 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8bgk\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-kube-api-access-f8bgk\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-token\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-certs\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-envoy\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istiod-ca-cert\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-socket\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-data\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.213625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.213454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-podinfo\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.313981 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.313953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-credential-socket\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314164 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.313987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bgk\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-kube-api-access-f8bgk\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314164 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-token\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314164 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-certs\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314164 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-envoy\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314164 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istiod-ca-cert\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314164 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-socket\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314502 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-data\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314502 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314407    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-credential-socket\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314502 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-podinfo\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314502 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-certs\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314749 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-data\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314852 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istiod-ca-cert\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.314963 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.314938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-socket\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.316480 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.316457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-envoy\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.316723 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.316708    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-podinfo\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.321992 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.321963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-token\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.322798 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.322776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8bgk\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-kube-api-access-f8bgk\") pod \"e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") " pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.331547 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.331517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:16.480665 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.480636    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"]
Jul 17 06:15:16.482555 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:15:16.482527    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516fe712_2a8c_4eb7_a88c_83d2836c34e2.slice/crio-21302a37f1337d8787a38ea6f78a480acef0d7e5f518c052bc963d140b744b33 WatchSource:0}: Error finding container 21302a37f1337d8787a38ea6f78a480acef0d7e5f518c052bc963d140b744b33: Status 404 returned error can't find the container with id 21302a37f1337d8787a38ea6f78a480acef0d7e5f518c052bc963d140b744b33
Jul 17 06:15:16.484644 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.484616    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:15:16.484714 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.484677    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:15:16.484714 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.484705    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:15:16.827371 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.827336    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" event={"ID":"516fe712-2a8c-4eb7-a88c-83d2836c34e2","Type":"ContainerStarted","Data":"1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c"}
Jul 17 06:15:16.827516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.827390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" event={"ID":"516fe712-2a8c-4eb7-a88c-83d2836c34e2","Type":"ContainerStarted","Data":"21302a37f1337d8787a38ea6f78a480acef0d7e5f518c052bc963d140b744b33"}
Jul 17 06:15:16.850491 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:16.850437    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" podStartSLOduration=1.850420628 podStartE2EDuration="1.850420628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:15:16.848446152 +0000 UTC m=+2540.023847540" watchObservedRunningTime="2026-07-17 06:15:16.850420628 +0000 UTC m=+2540.025822095"
Jul 17 06:15:17.332657 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:17.332628    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:17.337620 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:17.337594    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:17.832830 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:17.832791    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:17.833742 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:17.833720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:18.840177 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.840144    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"]
Jul 17 06:15:18.840685 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.840667    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b1b23b-7272-425a-ac46-a149fca54958" containerName="istio-proxy"
Jul 17 06:15:18.844050 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.844027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:18.847252 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.847225    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-603a20da-serving-cert\""
Jul 17 06:15:18.857651 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.857624    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"]
Jul 17 06:15:18.938362 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.938323    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:18.938639 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.938617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-openshift-service-ca\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:18.938784 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:18.938770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6z2x\" (UniqueName: \"kubernetes.io/projected/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-kube-api-access-z6z2x\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.039629 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.039583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.039828 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.039644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-openshift-service-ca\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.039828 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.039693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6z2x\" (UniqueName: \"kubernetes.io/projected/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-kube-api-access-z6z2x\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.039828 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:15:19.039731    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-serving-cert: secret "maas-api-e2e-mt-603a20da-serving-cert" not found
Jul 17 06:15:19.039828 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:15:19.039818    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls podName:5019f5e0-552f-4b43-b8fa-a8a5d1001b79 nodeName:}" failed. No retries permitted until 2026-07-17 06:15:19.53979197 +0000 UTC m=+2542.715193336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls") pod "maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j" (UID: "5019f5e0-552f-4b43-b8fa-a8a5d1001b79") : secret "maas-api-e2e-mt-603a20da-serving-cert" not found
Jul 17 06:15:19.040422 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.040396    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-openshift-service-ca\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.050511 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.050487    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6z2x\" (UniqueName: \"kubernetes.io/projected/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-kube-api-access-z6z2x\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.544913 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.544855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.547587 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.547563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls\") pod \"maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:19.759199 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:19.759163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:20.121410 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:20.121293    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"]
Jul 17 06:15:20.124078 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:15:20.124046    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5019f5e0_552f_4b43_b8fa_a8a5d1001b79.slice/crio-0d2cfd40c5b154b74f08545e3a9c6ed448c72a72217b5eb7f59fb44471319722 WatchSource:0}: Error finding container 0d2cfd40c5b154b74f08545e3a9c6ed448c72a72217b5eb7f59fb44471319722: Status 404 returned error can't find the container with id 0d2cfd40c5b154b74f08545e3a9c6ed448c72a72217b5eb7f59fb44471319722
Jul 17 06:15:20.853421 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:20.853387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j" event={"ID":"5019f5e0-552f-4b43-b8fa-a8a5d1001b79","Type":"ContainerStarted","Data":"dcd3376112c2299481febc124dc2043729d7c6241107317712dd7fb077515193"}
Jul 17 06:15:20.853575 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:20.853440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j" event={"ID":"5019f5e0-552f-4b43-b8fa-a8a5d1001b79","Type":"ContainerStarted","Data":"0d2cfd40c5b154b74f08545e3a9c6ed448c72a72217b5eb7f59fb44471319722"}
Jul 17 06:15:20.853575 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:20.853467    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:20.870892 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:20.870818    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j" podStartSLOduration=2.367404133 podStartE2EDuration="2.87080246s" totalImagesPullingTime="503.398327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:15:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:15:20.870562253 +0000 UTC m=+2544.045963641" watchObservedRunningTime="2026-07-17 06:15:20.87080246 +0000 UTC m=+2544.046203848"
Jul 17 06:15:26.864000 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:26.863961    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:15:29.907319 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:29.907287    2559 generic.go:356] "Generic (PLEG): container finished" podID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerID="1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c" exitCode=0
Jul 17 06:15:29.907762 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:29.907361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" event={"ID":"516fe712-2a8c-4eb7-a88c-83d2836c34e2","Type":"ContainerDied","Data":"1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c"}
Jul 17 06:15:29.907837 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:29.907820    2559 scope.go:117] "RemoveContainer" containerID="1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c"
Jul 17 06:15:29.908963 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:29.908933    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:15:29.909076 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:29.909006    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:15:29.909076 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:29.909053    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:15:30.914883 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:30.914848    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" event={"ID":"516fe712-2a8c-4eb7-a88c-83d2836c34e2","Type":"ContainerStarted","Data":"0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd"}
Jul 17 06:15:31.331751 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:31.331725    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:31.332897 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:31.332861    2559 patch_prober.go:28] interesting pod/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 06:15:31.333001 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:31.332929    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 06:15:32.332544 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:32.332508    2559 patch_prober.go:28] interesting pod/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 06:15:32.332955 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:32.332562    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 06:15:32.832994 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:32.832961    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:33.332677 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:33.332644    2559 patch_prober.go:28] interesting pod/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 06:15:33.333149 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:33.332692    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 06:15:34.332277 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:34.332239    2559 patch_prober.go:28] interesting pod/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 06:15:34.332444 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:34.332300    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 06:15:35.336321 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:35.336294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:15:35.337426 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:15:35.337405    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:16:01.897971 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:01.897935    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"]
Jul 17 06:16:01.898463 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:01.898157    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j" podUID="5019f5e0-552f-4b43-b8fa-a8a5d1001b79" containerName="maas-api" containerID="cri-o://dcd3376112c2299481febc124dc2043729d7c6241107317712dd7fb077515193" gracePeriod=30
Jul 17 06:16:02.073035 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.072776    2559 generic.go:356] "Generic (PLEG): container finished" podID="5019f5e0-552f-4b43-b8fa-a8a5d1001b79" containerID="dcd3376112c2299481febc124dc2043729d7c6241107317712dd7fb077515193" exitCode=0
Jul 17 06:16:02.073035 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.072843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j" event={"ID":"5019f5e0-552f-4b43-b8fa-a8a5d1001b79","Type":"ContainerDied","Data":"dcd3376112c2299481febc124dc2043729d7c6241107317712dd7fb077515193"}
Jul 17 06:16:02.157924 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.157825    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:16:02.259099 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.259068    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6z2x\" (UniqueName: \"kubernetes.io/projected/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-kube-api-access-z6z2x\") pod \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") "
Jul 17 06:16:02.259281 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.259131    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-openshift-service-ca\") pod \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") "
Jul 17 06:16:02.259281 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.259202    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls\") pod \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\" (UID: \"5019f5e0-552f-4b43-b8fa-a8a5d1001b79\") "
Jul 17 06:16:02.259586 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.259559    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5019f5e0-552f-4b43-b8fa-a8a5d1001b79" (UID: "5019f5e0-552f-4b43-b8fa-a8a5d1001b79"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:16:02.261213 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.261190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-kube-api-access-z6z2x" (OuterVolumeSpecName: "kube-api-access-z6z2x") pod "5019f5e0-552f-4b43-b8fa-a8a5d1001b79" (UID: "5019f5e0-552f-4b43-b8fa-a8a5d1001b79"). InnerVolumeSpecName "kube-api-access-z6z2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:16:02.261322 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.261191    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5019f5e0-552f-4b43-b8fa-a8a5d1001b79" (UID: "5019f5e0-552f-4b43-b8fa-a8a5d1001b79"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:16:02.360115 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.360067    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:16:02.360115 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.360107    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6z2x\" (UniqueName: \"kubernetes.io/projected/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-kube-api-access-z6z2x\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:16:02.360115 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:02.360117    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5019f5e0-552f-4b43-b8fa-a8a5d1001b79-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:16:03.078917 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:03.078862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j" event={"ID":"5019f5e0-552f-4b43-b8fa-a8a5d1001b79","Type":"ContainerDied","Data":"0d2cfd40c5b154b74f08545e3a9c6ed448c72a72217b5eb7f59fb44471319722"}
Jul 17 06:16:03.079308 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:03.078948    2559 scope.go:117] "RemoveContainer" containerID="dcd3376112c2299481febc124dc2043729d7c6241107317712dd7fb077515193"
Jul 17 06:16:03.079308 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:03.078890    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"
Jul 17 06:16:03.101209 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:03.101185    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"]
Jul 17 06:16:03.106587 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:03.106561    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-603a20da-657fdb9b49-fnp9j"]
Jul 17 06:16:03.324501 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:16:03.324468    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5019f5e0-552f-4b43-b8fa-a8a5d1001b79" path="/var/lib/kubelet/pods/5019f5e0-552f-4b43-b8fa-a8a5d1001b79/volumes"
Jul 17 06:17:08.933284 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:08.933240    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"]
Jul 17 06:17:08.934086 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:08.934047    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy" containerID="cri-o://0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd" gracePeriod=30
Jul 17 06:17:14.216312 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.216245    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:17:14.313619 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313593    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8bgk\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-kube-api-access-f8bgk\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.313803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313647    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-credential-socket\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.313803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313685    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istiod-ca-cert\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.313803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313745    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-certs\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.313803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313773    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-token\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.313803 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313791    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-data\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.314123 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-socket\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.314123 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313846    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-podinfo\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.314123 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.313898    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-envoy\") pod \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\" (UID: \"516fe712-2a8c-4eb7-a88c-83d2836c34e2\") "
Jul 17 06:17:14.314123 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.314021    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:17:14.314123 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.314035    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:17:14.314386 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.314259    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.314386 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.314281    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.314386 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.314281    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:17:14.315179 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.315148    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:17:14.315595 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.315560    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:17:14.316070 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.316042    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-kube-api-access-f8bgk" (OuterVolumeSpecName: "kube-api-access-f8bgk") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "kube-api-access-f8bgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:17:14.316175 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.316117    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:17:14.316250 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.316236    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:17:14.316338 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.316323    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "516fe712-2a8c-4eb7-a88c-83d2836c34e2" (UID: "516fe712-2a8c-4eb7-a88c-83d2836c34e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:17:14.414909 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.414849    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.414909 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.414903    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.414909 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.414915    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.415195 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.414928    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.415195 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.414939    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.415195 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.414950    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516fe712-2a8c-4eb7-a88c-83d2836c34e2-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.415195 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.414962    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8bgk\" (UniqueName: \"kubernetes.io/projected/516fe712-2a8c-4eb7-a88c-83d2836c34e2-kube-api-access-f8bgk\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:17:14.426826 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.426795    2559 generic.go:356] "Generic (PLEG): container finished" podID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerID="0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd" exitCode=0
Jul 17 06:17:14.426987 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.426849    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"
Jul 17 06:17:14.426987 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.426907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" event={"ID":"516fe712-2a8c-4eb7-a88c-83d2836c34e2","Type":"ContainerDied","Data":"0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd"}
Jul 17 06:17:14.426987 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.426970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf" event={"ID":"516fe712-2a8c-4eb7-a88c-83d2836c34e2","Type":"ContainerDied","Data":"21302a37f1337d8787a38ea6f78a480acef0d7e5f518c052bc963d140b744b33"}
Jul 17 06:17:14.427111 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.427002    2559 scope.go:117] "RemoveContainer" containerID="0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd"
Jul 17 06:17:14.437134 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.437114    2559 scope.go:117] "RemoveContainer" containerID="1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c"
Jul 17 06:17:14.446698 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.446676    2559 scope.go:117] "RemoveContainer" containerID="0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd"
Jul 17 06:17:14.447227 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:17:14.447072    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd\": container with ID starting with 0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd not found: ID does not exist" containerID="0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd"
Jul 17 06:17:14.447227 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.447109    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd"} err="failed to get container status \"0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd\": rpc error: code = NotFound desc = could not find container \"0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd\": container with ID starting with 0a51f300fddc13f05983c32cb3fd15d6e6984063dfa189b6cd132d4a6810d4fd not found: ID does not exist"
Jul 17 06:17:14.447227 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.447149    2559 scope.go:117] "RemoveContainer" containerID="1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c"
Jul 17 06:17:14.447572 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:17:14.447485    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c\": container with ID starting with 1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c not found: ID does not exist" containerID="1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c"
Jul 17 06:17:14.447572 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.447520    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c"} err="failed to get container status \"1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c\": rpc error: code = NotFound desc = could not find container \"1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c\": container with ID starting with 1f4a8be7d7d834cfbdbd5c896a859e457d30f3045582d1eac000c36e359ef78c not found: ID does not exist"
Jul 17 06:17:14.450859 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.450834    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"]
Jul 17 06:17:14.457305 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:14.457277    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-603a20da-openshift-default-5cb4cb6ff5-bfhcf"]
Jul 17 06:17:15.324924 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:15.324891    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" path="/var/lib/kubelet/pods/516fe712-2a8c-4eb7-a88c-83d2836c34e2/volumes"
Jul 17 06:17:57.464324 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:57.464243    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:17:57.469432 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:17:57.469410    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:18:06.385970 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.385929    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"]
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386309    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386322    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386341    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386348    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386360    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5019f5e0-552f-4b43-b8fa-a8a5d1001b79" containerName="maas-api"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386366    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5019f5e0-552f-4b43-b8fa-a8a5d1001b79" containerName="maas-api"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386418    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5019f5e0-552f-4b43-b8fa-a8a5d1001b79" containerName="maas-api"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386428    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy"
Jul 17 06:18:06.386446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.386435    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="516fe712-2a8c-4eb7-a88c-83d2836c34e2" containerName="istio-proxy"
Jul 17 06:18:06.389409 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.389391    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.393366 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.393344    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c0d19a-openshift-default-dockercfg-jkktb\""
Jul 17 06:18:06.416959 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.416926    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"]
Jul 17 06:18:06.475538 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-socket\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.475720 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-envoy\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.475720 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6hmm\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-kube-api-access-j6hmm\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.475720 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10d5157-c5eb-4b80-9395-7fd792383a6e-istiod-ca-cert\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.475940 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-credential-socket\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.475940 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-token\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.476061 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-podinfo\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.476061 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.475995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-data\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.476173 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.476061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-certs\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.577522 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-socket\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.577702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-envoy\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.577702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6hmm\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-kube-api-access-j6hmm\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.577702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10d5157-c5eb-4b80-9395-7fd792383a6e-istiod-ca-cert\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.577702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-credential-socket\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.577702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-token\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.577702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-podinfo\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.578049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-data\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.578049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-certs\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.578049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.577983    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-socket\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.578209 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.578146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-credential-socket\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.578311 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.578279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-certs\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.578364 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.578332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-data\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.578402 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.578364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10d5157-c5eb-4b80-9395-7fd792383a6e-istiod-ca-cert\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.580000 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.579978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-envoy\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.580124 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.580104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-podinfo\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.595257 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.595230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-token\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.596157 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.596136    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6hmm\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-kube-api-access-j6hmm\") pod \"e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") " pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.700475 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.700388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:06.858568 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.858539    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"]
Jul 17 06:18:06.860731 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:18:06.860700    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10d5157_c5eb_4b80_9395_7fd792383a6e.slice/crio-e03a0efb4c3738738124c96cc51f345608c3614d1d650018bd1ca98f51ff924b WatchSource:0}: Error finding container e03a0efb4c3738738124c96cc51f345608c3614d1d650018bd1ca98f51ff924b: Status 404 returned error can't find the container with id e03a0efb4c3738738124c96cc51f345608c3614d1d650018bd1ca98f51ff924b
Jul 17 06:18:06.863040 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.863004    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:06.863128 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.863077    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:06.863128 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:06.863106    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:07.683224 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:07.683184    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" event={"ID":"e10d5157-c5eb-4b80-9395-7fd792383a6e","Type":"ContainerStarted","Data":"54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0"}
Jul 17 06:18:07.683726 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:07.683247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" event={"ID":"e10d5157-c5eb-4b80-9395-7fd792383a6e","Type":"ContainerStarted","Data":"e03a0efb4c3738738124c96cc51f345608c3614d1d650018bd1ca98f51ff924b"}
Jul 17 06:18:07.700937 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:07.700903    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:07.706010 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:07.705982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:07.788098 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:07.788050    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podStartSLOduration=1.7880344350000001 podStartE2EDuration="1.788034435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:18:07.739763753 +0000 UTC m=+2710.915165152" watchObservedRunningTime="2026-07-17 06:18:07.788034435 +0000 UTC m=+2710.963435822"
Jul 17 06:18:08.688593 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:08.688562    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:08.689479 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:08.689458    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:10.071863 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.071826    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"]
Jul 17 06:18:10.075925 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.075904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.081513 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.081492    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c0d19a-serving-cert\""
Jul 17 06:18:10.107648 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.107618    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"]
Jul 17 06:18:10.215190 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.215150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34be556a-4df1-45ac-937b-1a1d1db7e127-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.215370 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.215215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.215370 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.215233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmxfj\" (UniqueName: \"kubernetes.io/projected/34be556a-4df1-45ac-937b-1a1d1db7e127-kube-api-access-lmxfj\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.315956 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.315919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.315956 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.315957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmxfj\" (UniqueName: \"kubernetes.io/projected/34be556a-4df1-45ac-937b-1a1d1db7e127-kube-api-access-lmxfj\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.316217 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.316051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34be556a-4df1-45ac-937b-1a1d1db7e127-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.316217 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:18:10.316074    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-serving-cert: secret "maas-api-e2e-inf-a-c0d19a-serving-cert" not found
Jul 17 06:18:10.316217 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:18:10.316146    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls podName:34be556a-4df1-45ac-937b-1a1d1db7e127 nodeName:}" failed. No retries permitted until 2026-07-17 06:18:10.81612408 +0000 UTC m=+2713.991525461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls") pod "maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr" (UID: "34be556a-4df1-45ac-937b-1a1d1db7e127") : secret "maas-api-e2e-inf-a-c0d19a-serving-cert" not found
Jul 17 06:18:10.316689 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.316669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34be556a-4df1-45ac-937b-1a1d1db7e127-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.333895 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.333790    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmxfj\" (UniqueName: \"kubernetes.io/projected/34be556a-4df1-45ac-937b-1a1d1db7e127-kube-api-access-lmxfj\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.820043 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.820004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.822733 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.822714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls\") pod \"maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:10.986691 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:10.986650    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:11.155696 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:11.155664    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"]
Jul 17 06:18:11.157230 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:18:11.157203    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34be556a_4df1_45ac_937b_1a1d1db7e127.slice/crio-785f62e174a0b73673aa8cc7e36d61b32bd5421dc5a65e0562f7ae6ccfd781fc WatchSource:0}: Error finding container 785f62e174a0b73673aa8cc7e36d61b32bd5421dc5a65e0562f7ae6ccfd781fc: Status 404 returned error can't find the container with id 785f62e174a0b73673aa8cc7e36d61b32bd5421dc5a65e0562f7ae6ccfd781fc
Jul 17 06:18:11.705354 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:11.705322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr" event={"ID":"34be556a-4df1-45ac-937b-1a1d1db7e127","Type":"ContainerStarted","Data":"785f62e174a0b73673aa8cc7e36d61b32bd5421dc5a65e0562f7ae6ccfd781fc"}
Jul 17 06:18:12.711800 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:12.711751    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr" event={"ID":"34be556a-4df1-45ac-937b-1a1d1db7e127","Type":"ContainerStarted","Data":"e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd"}
Jul 17 06:18:12.712246 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:12.711898    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:12.745462 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:12.745405    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr" podStartSLOduration=2.248586989 podStartE2EDuration="2.745387456s" totalImagesPullingTime="496.800467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:18:12.744243725 +0000 UTC m=+2715.919645114" watchObservedRunningTime="2026-07-17 06:18:12.745387456 +0000 UTC m=+2715.920788844"
Jul 17 06:18:15.383111 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.383072    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"]
Jul 17 06:18:15.387514 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.387491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.392024 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.392004    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3483d7-openshift-default-dockercfg-qqhv4\""
Jul 17 06:18:15.444157 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.444062    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"]
Jul 17 06:18:15.461978 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.461942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istiod-ca-cert\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462151 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.461992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-data\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462151 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.462021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-envoy\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462151 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.462098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-certs\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462290 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.462155    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-credential-socket\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462290 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.462200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-token\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462290 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.462253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-podinfo\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.462297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz2dr\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-kube-api-access-pz2dr\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.462412 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.462403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-socket\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.562813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-credential-socket\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.562856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-token\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-podinfo\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz2dr\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-kube-api-access-pz2dr\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-socket\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istiod-ca-cert\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-data\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-envoy\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-credential-socket\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-certs\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.562847 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-socket\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.564343 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-certs\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.564343 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.563970    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-data\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.564454 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.564366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istiod-ca-cert\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.566142 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.566109    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-envoy\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.566597 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.566576    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-podinfo\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.578707 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.578675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz2dr\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-kube-api-access-pz2dr\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.580099 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.580074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-token\") pod \"e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") " pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.702593 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.702498    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:15.905387 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.905363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"]
Jul 17 06:18:15.910722 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:18:15.910686    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94f2e7d_331a_4e76_8a41_7fdce315bf3d.slice/crio-0636f1b2b71af244dfc572653006ce5c3acd33f2b980ca199ee8853552dfc66e WatchSource:0}: Error finding container 0636f1b2b71af244dfc572653006ce5c3acd33f2b980ca199ee8853552dfc66e: Status 404 returned error can't find the container with id 0636f1b2b71af244dfc572653006ce5c3acd33f2b980ca199ee8853552dfc66e
Jul 17 06:18:15.912838 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.912792    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:15.912947 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.912919    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:15.912993 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:15.912957    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:16.734366 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:16.734328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" event={"ID":"e94f2e7d-331a-4e76-8a41-7fdce315bf3d","Type":"ContainerStarted","Data":"c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a"}
Jul 17 06:18:16.734755 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:16.734383    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" event={"ID":"e94f2e7d-331a-4e76-8a41-7fdce315bf3d","Type":"ContainerStarted","Data":"0636f1b2b71af244dfc572653006ce5c3acd33f2b980ca199ee8853552dfc66e"}
Jul 17 06:18:16.776885 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:16.776828    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" podStartSLOduration=1.776812494 podStartE2EDuration="1.776812494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:18:16.775177463 +0000 UTC m=+2719.950578852" watchObservedRunningTime="2026-07-17 06:18:16.776812494 +0000 UTC m=+2719.952213883"
Jul 17 06:18:17.702735 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:17.702697    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:17.707815 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:17.707787    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:17.739853 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:17.739815    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:17.740759 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:17.740737    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:18.722291 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:18.722253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:18:19.116256 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.116216    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"]
Jul 17 06:18:19.120546 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.120528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.123260 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.123234    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3483d7-serving-cert\""
Jul 17 06:18:19.162891 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.162836    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"]
Jul 17 06:18:19.204763 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.204672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.205165 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.205142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8679\" (UniqueName: \"kubernetes.io/projected/2657e736-c886-4bce-9c21-0328ec88f779-kube-api-access-c8679\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.205386 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.205370    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2657e736-c886-4bce-9c21-0328ec88f779-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.307090 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.307047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.307293 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.307149    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8679\" (UniqueName: \"kubernetes.io/projected/2657e736-c886-4bce-9c21-0328ec88f779-kube-api-access-c8679\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.307293 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.307183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2657e736-c886-4bce-9c21-0328ec88f779-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.307293 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:18:19.307203    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-serving-cert: secret "maas-api-e2e-inf-b-3483d7-serving-cert" not found
Jul 17 06:18:19.307410 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:18:19.307298    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls podName:2657e736-c886-4bce-9c21-0328ec88f779 nodeName:}" failed. No retries permitted until 2026-07-17 06:18:19.807273606 +0000 UTC m=+2722.982674973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls") pod "maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x" (UID: "2657e736-c886-4bce-9c21-0328ec88f779") : secret "maas-api-e2e-inf-b-3483d7-serving-cert" not found
Jul 17 06:18:19.308078 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.308057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2657e736-c886-4bce-9c21-0328ec88f779-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.318588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.318554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8679\" (UniqueName: \"kubernetes.io/projected/2657e736-c886-4bce-9c21-0328ec88f779-kube-api-access-c8679\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.812214 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.812177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:19.814723 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:19.814694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls\") pod \"maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:20.032072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:20.032036    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:20.347730 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:20.347702    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"]
Jul 17 06:18:20.349244 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:18:20.349208    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2657e736_c886_4bce_9c21_0328ec88f779.slice/crio-6ce55a2e71efcc7e9b26bcf5df8f2a3f34381a94353c54da89800e268235a49d WatchSource:0}: Error finding container 6ce55a2e71efcc7e9b26bcf5df8f2a3f34381a94353c54da89800e268235a49d: Status 404 returned error can't find the container with id 6ce55a2e71efcc7e9b26bcf5df8f2a3f34381a94353c54da89800e268235a49d
Jul 17 06:18:20.756674 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:20.756634    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x" event={"ID":"2657e736-c886-4bce-9c21-0328ec88f779","Type":"ContainerStarted","Data":"6ce55a2e71efcc7e9b26bcf5df8f2a3f34381a94353c54da89800e268235a49d"}
Jul 17 06:18:21.762863 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:21.762822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x" event={"ID":"2657e736-c886-4bce-9c21-0328ec88f779","Type":"ContainerStarted","Data":"103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64"}
Jul 17 06:18:21.793215 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:21.793164    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x" podStartSLOduration=2.172259397 podStartE2EDuration="2.793147189s" totalImagesPullingTime="620.887792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:18:21.792810811 +0000 UTC m=+2724.968212198" watchObservedRunningTime="2026-07-17 06:18:21.793147189 +0000 UTC m=+2724.968548621"
Jul 17 06:18:22.767826 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:22.767790    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:24.730087 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:24.730048    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 06:18:24.730690 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:24.730132    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 06:18:25.788157 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:25.788034    2559 generic.go:356] "Generic (PLEG): container finished" podID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerID="54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0" exitCode=0
Jul 17 06:18:25.788157 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:25.788074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" event={"ID":"e10d5157-c5eb-4b80-9395-7fd792383a6e","Type":"ContainerDied","Data":"54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0"}
Jul 17 06:18:25.788770 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:25.788737    2559 scope.go:117] "RemoveContainer" containerID="54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0"
Jul 17 06:18:25.790806 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:25.790459    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:25.790806 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:25.790554    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:25.790806 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:25.790606    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:26.795492 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:26.795460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" event={"ID":"e10d5157-c5eb-4b80-9395-7fd792383a6e","Type":"ContainerStarted","Data":"6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42"}
Jul 17 06:18:27.701386 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:27.701346    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:27.701641 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:27.701591    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 06:18:27.702454 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:27.702420    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 06:18:28.701619 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:28.701575    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 06:18:28.702133 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:28.701680    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 06:18:28.791859 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:28.791170    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:18:29.701354 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:29.701315    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 06:18:29.701528 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:29.701379    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 06:18:30.701535 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:30.701490    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 06:18:30.702022 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:30.701561    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 06:18:31.704010 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:31.703980    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:31.704482 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:31.704326    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:31.705011 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:31.704993    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:18:32.741315 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.741231    2559 patch_prober.go:28] interesting pod/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 17 06:18:32.741315 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.741283    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 17 06:18:32.852432 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.852398    2559 generic.go:356] "Generic (PLEG): container finished" podID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerID="c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a" exitCode=0
Jul 17 06:18:32.852617 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.852465    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" event={"ID":"e94f2e7d-331a-4e76-8a41-7fdce315bf3d","Type":"ContainerDied","Data":"c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a"}
Jul 17 06:18:32.852950 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.852934    2559 scope.go:117] "RemoveContainer" containerID="c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a"
Jul 17 06:18:32.853879 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.853840    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:32.853970 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.853918    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:32.853970 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:32.853952    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:18:33.859751 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:33.859701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" event={"ID":"e94f2e7d-331a-4e76-8a41-7fdce315bf3d","Type":"ContainerStarted","Data":"b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219"}
Jul 17 06:18:34.703157 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:34.703121    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:34.703334 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:34.703279    2559 patch_prober.go:28] interesting pod/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 17 06:18:34.703378 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:34.703326    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 17 06:18:35.703733 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:35.703697    2559 patch_prober.go:28] interesting pod/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 17 06:18:35.704142 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:35.703753    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 17 06:18:36.703141 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:36.703105    2559 patch_prober.go:28] interesting pod/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 17 06:18:36.703323 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:36.703161    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 17 06:18:37.702886 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:37.702839    2559 patch_prober.go:28] interesting pod/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 17 06:18:37.703280 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:37.702928    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 17 06:18:38.707102 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:38.707072    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:38.707622 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:38.707603    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:18:38.708214 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:18:38.708198    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:19:44.341738 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.341705    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"]
Jul 17 06:19:44.342236 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.341933    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr" podUID="34be556a-4df1-45ac-937b-1a1d1db7e127" containerName="maas-api" containerID="cri-o://e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd" gracePeriod=30
Jul 17 06:19:44.600287 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.600228    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:19:44.679843 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.679807    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls\") pod \"34be556a-4df1-45ac-937b-1a1d1db7e127\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") "
Jul 17 06:19:44.680062 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.679957    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34be556a-4df1-45ac-937b-1a1d1db7e127-openshift-service-ca\") pod \"34be556a-4df1-45ac-937b-1a1d1db7e127\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") "
Jul 17 06:19:44.680062 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.680054    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmxfj\" (UniqueName: \"kubernetes.io/projected/34be556a-4df1-45ac-937b-1a1d1db7e127-kube-api-access-lmxfj\") pod \"34be556a-4df1-45ac-937b-1a1d1db7e127\" (UID: \"34be556a-4df1-45ac-937b-1a1d1db7e127\") "
Jul 17 06:19:44.680304 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.680280    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34be556a-4df1-45ac-937b-1a1d1db7e127-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34be556a-4df1-45ac-937b-1a1d1db7e127" (UID: "34be556a-4df1-45ac-937b-1a1d1db7e127"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:19:44.681854 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.681824    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34be556a-4df1-45ac-937b-1a1d1db7e127" (UID: "34be556a-4df1-45ac-937b-1a1d1db7e127"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:19:44.681993 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.681943    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34be556a-4df1-45ac-937b-1a1d1db7e127-kube-api-access-lmxfj" (OuterVolumeSpecName: "kube-api-access-lmxfj") pod "34be556a-4df1-45ac-937b-1a1d1db7e127" (UID: "34be556a-4df1-45ac-937b-1a1d1db7e127"). InnerVolumeSpecName "kube-api-access-lmxfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:19:44.781072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.781042    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34be556a-4df1-45ac-937b-1a1d1db7e127-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:19:44.781072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.781067    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmxfj\" (UniqueName: \"kubernetes.io/projected/34be556a-4df1-45ac-937b-1a1d1db7e127-kube-api-access-lmxfj\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:19:44.781072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:44.781079    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34be556a-4df1-45ac-937b-1a1d1db7e127-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:19:45.233504 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.233460    2559 generic.go:356] "Generic (PLEG): container finished" podID="34be556a-4df1-45ac-937b-1a1d1db7e127" containerID="e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd" exitCode=0
Jul 17 06:19:45.233676 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.233510    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"
Jul 17 06:19:45.233676 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.233539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr" event={"ID":"34be556a-4df1-45ac-937b-1a1d1db7e127","Type":"ContainerDied","Data":"e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd"}
Jul 17 06:19:45.233676 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.233596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr" event={"ID":"34be556a-4df1-45ac-937b-1a1d1db7e127","Type":"ContainerDied","Data":"785f62e174a0b73673aa8cc7e36d61b32bd5421dc5a65e0562f7ae6ccfd781fc"}
Jul 17 06:19:45.233676 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.233618    2559 scope.go:117] "RemoveContainer" containerID="e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd"
Jul 17 06:19:45.243146 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.243130    2559 scope.go:117] "RemoveContainer" containerID="e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd"
Jul 17 06:19:45.243408 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:19:45.243386    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd\": container with ID starting with e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd not found: ID does not exist" containerID="e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd"
Jul 17 06:19:45.243455 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.243419    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd"} err="failed to get container status \"e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd\": rpc error: code = NotFound desc = could not find container \"e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd\": container with ID starting with e84a0dd6fbe9aed4ad8f4714e409d50283251c5e40204af279beb46c367405bd not found: ID does not exist"
Jul 17 06:19:45.258639 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.258611    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"]
Jul 17 06:19:45.265160 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.265133    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c0d19a-76bd69d45b-xkwpr"]
Jul 17 06:19:45.325122 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:45.325090    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34be556a-4df1-45ac-937b-1a1d1db7e127" path="/var/lib/kubelet/pods/34be556a-4df1-45ac-937b-1a1d1db7e127/volumes"
Jul 17 06:19:59.617550 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:59.617514    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"]
Jul 17 06:19:59.618058 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:19:59.617741    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy" containerID="cri-o://6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42" gracePeriod=30
Jul 17 06:20:01.707358 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:01.707325    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 06:20:01.707734 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:01.707382    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 06:20:04.864186 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.864162    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:20:04.975259 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975180    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6hmm\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-kube-api-access-j6hmm\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975259 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975239    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-data\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975487 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-token\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975487 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975305    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-podinfo\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975487 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975356    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-socket\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975487 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975379    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10d5157-c5eb-4b80-9395-7fd792383a6e-istiod-ca-cert\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975487 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975401    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-envoy\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975487 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975445    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-credential-socket\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975487 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-certs\") pod \"e10d5157-c5eb-4b80-9395-7fd792383a6e\" (UID: \"e10d5157-c5eb-4b80-9395-7fd792383a6e\") "
Jul 17 06:20:04.975915 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975654    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:04.975915 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975794    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e10d5157-c5eb-4b80-9395-7fd792383a6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:04.975915 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975810    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:04.976093 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.975922    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:04.976093 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.976009    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:04.976657 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.976627    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:04.977612 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.977588    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:20:04.977612 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.977597    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:20:04.977774 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.977669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-kube-api-access-j6hmm" (OuterVolumeSpecName: "kube-api-access-j6hmm") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "kube-api-access-j6hmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:20:04.977925 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:04.977902    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e10d5157-c5eb-4b80-9395-7fd792383a6e" (UID: "e10d5157-c5eb-4b80-9395-7fd792383a6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:05.076569 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076530    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6hmm\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-kube-api-access-j6hmm\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.076569 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076565    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.076569 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076575    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.076569 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076582    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.076836 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076590    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10d5157-c5eb-4b80-9395-7fd792383a6e-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.076836 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076598    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.076836 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076607    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.076836 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.076615    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10d5157-c5eb-4b80-9395-7fd792383a6e-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:05.339675 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.339645    2559 generic.go:356] "Generic (PLEG): container finished" podID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerID="6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42" exitCode=0
Jul 17 06:20:05.339818 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.339684    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"
Jul 17 06:20:05.339818 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.339717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" event={"ID":"e10d5157-c5eb-4b80-9395-7fd792383a6e","Type":"ContainerDied","Data":"6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42"}
Jul 17 06:20:05.339818 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.339765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6" event={"ID":"e10d5157-c5eb-4b80-9395-7fd792383a6e","Type":"ContainerDied","Data":"e03a0efb4c3738738124c96cc51f345608c3614d1d650018bd1ca98f51ff924b"}
Jul 17 06:20:05.339818 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.339787    2559 scope.go:117] "RemoveContainer" containerID="6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42"
Jul 17 06:20:05.348808 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.348788    2559 scope.go:117] "RemoveContainer" containerID="54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0"
Jul 17 06:20:05.356681 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.356664    2559 scope.go:117] "RemoveContainer" containerID="6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42"
Jul 17 06:20:05.357080 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:20:05.357053    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42\": container with ID starting with 6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42 not found: ID does not exist" containerID="6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42"
Jul 17 06:20:05.357232 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.357088    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42"} err="failed to get container status \"6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42\": rpc error: code = NotFound desc = could not find container \"6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42\": container with ID starting with 6dc9d0fb7546cb5e79181eca4f9308143471e7b849ecc68af1fd5f33e9762d42 not found: ID does not exist"
Jul 17 06:20:05.357232 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.357112    2559 scope.go:117] "RemoveContainer" containerID="54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0"
Jul 17 06:20:05.357557 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:20:05.357537    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0\": container with ID starting with 54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0 not found: ID does not exist" containerID="54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0"
Jul 17 06:20:05.357656 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.357569    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0"} err="failed to get container status \"54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0\": rpc error: code = NotFound desc = could not find container \"54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0\": container with ID starting with 54a3304ca5bc721a139c5e616f9011533861955c458ad3df4f7b42b2807299a0 not found: ID does not exist"
Jul 17 06:20:05.360334 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.360311    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"]
Jul 17 06:20:05.368928 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:05.368568    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c0d19a-openshift-default-6f4ff74dbf-w46v6"]
Jul 17 06:20:07.326319 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:07.326271    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" path="/var/lib/kubelet/pods/e10d5157-c5eb-4b80-9395-7fd792383a6e/volumes"
Jul 17 06:20:10.502477 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.502440    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"]
Jul 17 06:20:10.502958 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.502700    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x" podUID="2657e736-c886-4bce-9c21-0328ec88f779" containerName="maas-api" containerID="cri-o://103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64" gracePeriod=30
Jul 17 06:20:10.757189 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.757129    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:20:10.829628 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.829595    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8679\" (UniqueName: \"kubernetes.io/projected/2657e736-c886-4bce-9c21-0328ec88f779-kube-api-access-c8679\") pod \"2657e736-c886-4bce-9c21-0328ec88f779\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") "
Jul 17 06:20:10.829806 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.829703    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2657e736-c886-4bce-9c21-0328ec88f779-openshift-service-ca\") pod \"2657e736-c886-4bce-9c21-0328ec88f779\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") "
Jul 17 06:20:10.829852 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.829807    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls\") pod \"2657e736-c886-4bce-9c21-0328ec88f779\" (UID: \"2657e736-c886-4bce-9c21-0328ec88f779\") "
Jul 17 06:20:10.830110 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.830086    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2657e736-c886-4bce-9c21-0328ec88f779-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2657e736-c886-4bce-9c21-0328ec88f779" (UID: "2657e736-c886-4bce-9c21-0328ec88f779"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:10.830185 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.830170    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2657e736-c886-4bce-9c21-0328ec88f779-openshift-service-ca\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:10.831885 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.831842    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2657e736-c886-4bce-9c21-0328ec88f779" (UID: "2657e736-c886-4bce-9c21-0328ec88f779"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:20:10.832002 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.831847    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2657e736-c886-4bce-9c21-0328ec88f779-kube-api-access-c8679" (OuterVolumeSpecName: "kube-api-access-c8679") pod "2657e736-c886-4bce-9c21-0328ec88f779" (UID: "2657e736-c886-4bce-9c21-0328ec88f779"). InnerVolumeSpecName "kube-api-access-c8679". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:20:10.931410 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.931354    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8679\" (UniqueName: \"kubernetes.io/projected/2657e736-c886-4bce-9c21-0328ec88f779-kube-api-access-c8679\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:10.931410 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:10.931402    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2657e736-c886-4bce-9c21-0328ec88f779-maas-api-tls\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:11.371605 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.371564    2559 generic.go:356] "Generic (PLEG): container finished" podID="2657e736-c886-4bce-9c21-0328ec88f779" containerID="103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64" exitCode=0
Jul 17 06:20:11.371754 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.371622    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"
Jul 17 06:20:11.371754 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.371638    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x" event={"ID":"2657e736-c886-4bce-9c21-0328ec88f779","Type":"ContainerDied","Data":"103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64"}
Jul 17 06:20:11.371754 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.371703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x" event={"ID":"2657e736-c886-4bce-9c21-0328ec88f779","Type":"ContainerDied","Data":"6ce55a2e71efcc7e9b26bcf5df8f2a3f34381a94353c54da89800e268235a49d"}
Jul 17 06:20:11.371754 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.371734    2559 scope.go:117] "RemoveContainer" containerID="103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64"
Jul 17 06:20:11.380316 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.380295    2559 scope.go:117] "RemoveContainer" containerID="103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64"
Jul 17 06:20:11.380631 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:20:11.380603    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64\": container with ID starting with 103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64 not found: ID does not exist" containerID="103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64"
Jul 17 06:20:11.380688 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.380639    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64"} err="failed to get container status \"103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64\": rpc error: code = NotFound desc = could not find container \"103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64\": container with ID starting with 103db57632918c64ae444530cbf7b8b2386ba12e7aa9ddc628b5a59f0439bd64 not found: ID does not exist"
Jul 17 06:20:11.388401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.388379    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"]
Jul 17 06:20:11.391834 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:11.391815    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3483d7-7dfc7f769d-x2f2x"]
Jul 17 06:20:13.324704 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:13.324659    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2657e736-c886-4bce-9c21-0328ec88f779" path="/var/lib/kubelet/pods/2657e736-c886-4bce-9c21-0328ec88f779/volumes"
Jul 17 06:20:25.808488 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:25.808452    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"]
Jul 17 06:20:25.808960 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:25.808695    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy" containerID="cri-o://b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219" gracePeriod=30
Jul 17 06:20:26.747388 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.747353    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"]
Jul 17 06:20:26.747943 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.747926    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2657e736-c886-4bce-9c21-0328ec88f779" containerName="maas-api"
Jul 17 06:20:26.747997 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.747946    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2657e736-c886-4bce-9c21-0328ec88f779" containerName="maas-api"
Jul 17 06:20:26.747997 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.747983    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy"
Jul 17 06:20:26.747997 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.747992    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy"
Jul 17 06:20:26.748098 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748006    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy"
Jul 17 06:20:26.748098 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748015    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy"
Jul 17 06:20:26.748098 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748033    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34be556a-4df1-45ac-937b-1a1d1db7e127" containerName="maas-api"
Jul 17 06:20:26.748098 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748041    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="34be556a-4df1-45ac-937b-1a1d1db7e127" containerName="maas-api"
Jul 17 06:20:26.748217 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748129    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy"
Jul 17 06:20:26.748217 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748141    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2657e736-c886-4bce-9c21-0328ec88f779" containerName="maas-api"
Jul 17 06:20:26.748217 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748152    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10d5157-c5eb-4b80-9395-7fd792383a6e" containerName="istio-proxy"
Jul 17 06:20:26.748217 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.748161    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="34be556a-4df1-45ac-937b-1a1d1db7e127" containerName="maas-api"
Jul 17 06:20:26.751488 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.751470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.754692 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.754669    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1615b7-openshift-default-dockercfg-98p2q\""
Jul 17 06:20:26.768536 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.768513    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"]
Jul 17 06:20:26.882954 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.882919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-credential-socket\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.882954 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.882959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-certs\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.883401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.883002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqff\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-kube-api-access-5vqff\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.883401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.883031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-istio-token\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.883401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.883051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81dc572f-c4be-41c4-b356-caa12073a332-istio-podinfo\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.883401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.883074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81dc572f-c4be-41c4-b356-caa12073a332-istiod-ca-cert\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.883401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.883102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-envoy\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.883401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.883127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-data\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.883401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.883187    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-socket\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.983718 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.983683    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqff\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-kube-api-access-5vqff\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.983911 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.983738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-istio-token\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.983911 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.983769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81dc572f-c4be-41c4-b356-caa12073a332-istio-podinfo\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.983911 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.983794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81dc572f-c4be-41c4-b356-caa12073a332-istiod-ca-cert\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.983911 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.983828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-envoy\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984234 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.983913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-data\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984234 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.983961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-socket\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984234 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.984032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-credential-socket\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984234 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.984063    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-certs\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984448 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.984323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-data\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984508 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.984489    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-certs\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984589 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.984567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-socket\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984656 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.984624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81dc572f-c4be-41c4-b356-caa12073a332-istiod-ca-cert\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.984656 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.984626    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-credential-socket\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.986563 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.986538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81dc572f-c4be-41c4-b356-caa12073a332-istio-podinfo\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.986648 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.986565    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-envoy\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.992075 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.992047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-istio-token\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:26.992188 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:26.992133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqff\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-kube-api-access-5vqff\") pod \"e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") " pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:27.062361 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.062329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:27.226684 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.226659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"]
Jul 17 06:20:27.228435 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:20:27.228396    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dc572f_c4be_41c4_b356_caa12073a332.slice/crio-0d88a4bdfca071f255a02c720c19c387d87bfa7f6205a95435e951b787d4e0b0 WatchSource:0}: Error finding container 0d88a4bdfca071f255a02c720c19c387d87bfa7f6205a95435e951b787d4e0b0: Status 404 returned error can't find the container with id 0d88a4bdfca071f255a02c720c19c387d87bfa7f6205a95435e951b787d4e0b0
Jul 17 06:20:27.230662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.230632    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:27.230752 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.230693    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:27.230752 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.230720    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:27.455545 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.455464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" event={"ID":"81dc572f-c4be-41c4-b356-caa12073a332","Type":"ContainerStarted","Data":"c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef"}
Jul 17 06:20:27.455545 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.455512    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" event={"ID":"81dc572f-c4be-41c4-b356-caa12073a332","Type":"ContainerStarted","Data":"0d88a4bdfca071f255a02c720c19c387d87bfa7f6205a95435e951b787d4e0b0"}
Jul 17 06:20:27.481696 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:27.481643    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podStartSLOduration=1.48162499 podStartE2EDuration="1.48162499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:20:27.478404608 +0000 UTC m=+2850.653805997" watchObservedRunningTime="2026-07-17 06:20:27.48162499 +0000 UTC m=+2850.657026378"
Jul 17 06:20:28.062697 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:28.062658    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:28.068099 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:28.068073    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:28.460777 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:28.460690    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:28.461600 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:28.461580    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:31.073013 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.072949    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:20:31.125857 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.125816    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz2dr\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-kube-api-access-pz2dr\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.126060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.125938    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-data\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.126060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.125968    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-socket\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.126060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.125996    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-certs\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.126060 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126039    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-podinfo\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.126302 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126085    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-credential-socket\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.126390 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126350    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:31.126390 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126362    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:31.126715 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126123    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-envoy\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.126715 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126678    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:31.126715 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126676    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istiod-ca-cert\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.127062 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-token\") pod \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\" (UID: \"e94f2e7d-331a-4e76-8a41-7fdce315bf3d\") "
Jul 17 06:20:31.127062 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.126824    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:31.127062 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.127045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:20:31.127245 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.127209    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.127245 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.127231    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.127360 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.127245    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.127360 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.127260    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.127360 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.127275    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.128242 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.128217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-kube-api-access-pz2dr" (OuterVolumeSpecName: "kube-api-access-pz2dr") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "kube-api-access-pz2dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:20:31.128429 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.128401    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:20:31.128615 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.128596    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:20:31.128941 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.128919    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e94f2e7d-331a-4e76-8a41-7fdce315bf3d" (UID: "e94f2e7d-331a-4e76-8a41-7fdce315bf3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:20:31.228593 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.228558    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz2dr\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-kube-api-access-pz2dr\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.228593 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.228589    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.228593 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.228600    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.228802 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.228608    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e94f2e7d-331a-4e76-8a41-7fdce315bf3d-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:20:31.477855 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.477819    2559 generic.go:356] "Generic (PLEG): container finished" podID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerID="b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219" exitCode=0
Jul 17 06:20:31.478049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.477890    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"
Jul 17 06:20:31.478049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.477900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" event={"ID":"e94f2e7d-331a-4e76-8a41-7fdce315bf3d","Type":"ContainerDied","Data":"b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219"}
Jul 17 06:20:31.478049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.477959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf" event={"ID":"e94f2e7d-331a-4e76-8a41-7fdce315bf3d","Type":"ContainerDied","Data":"0636f1b2b71af244dfc572653006ce5c3acd33f2b980ca199ee8853552dfc66e"}
Jul 17 06:20:31.478049 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.477983    2559 scope.go:117] "RemoveContainer" containerID="b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219"
Jul 17 06:20:31.487273 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.487251    2559 scope.go:117] "RemoveContainer" containerID="c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a"
Jul 17 06:20:31.495789 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.495766    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"]
Jul 17 06:20:31.496083 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.496059    2559 scope.go:117] "RemoveContainer" containerID="b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219"
Jul 17 06:20:31.496334 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:20:31.496318    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219\": container with ID starting with b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219 not found: ID does not exist" containerID="b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219"
Jul 17 06:20:31.496403 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.496343    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219"} err="failed to get container status \"b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219\": rpc error: code = NotFound desc = could not find container \"b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219\": container with ID starting with b9d5bcb407b7378f79a740934f5d99a977f4f168f3d72aad777f7d7f3b38d219 not found: ID does not exist"
Jul 17 06:20:31.496403 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.496362    2559 scope.go:117] "RemoveContainer" containerID="c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a"
Jul 17 06:20:31.496618 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:20:31.496600    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a\": container with ID starting with c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a not found: ID does not exist" containerID="c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a"
Jul 17 06:20:31.496716 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.496624    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a"} err="failed to get container status \"c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a\": rpc error: code = NotFound desc = could not find container \"c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a\": container with ID starting with c93b58b48cd6b1f7fac9e14cadc82e3a32ae2f6db294ca63423d60b44da1f33a not found: ID does not exist"
Jul 17 06:20:31.499338 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:31.499306    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3483d7-openshift-default-7dfcb6898f-2qrmf"]
Jul 17 06:20:33.324204 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:33.324169    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" path="/var/lib/kubelet/pods/e94f2e7d-331a-4e76-8a41-7fdce315bf3d/volumes"
Jul 17 06:20:34.799642 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.799606    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"]
Jul 17 06:20:34.800146 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.800127    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy"
Jul 17 06:20:34.800231 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.800150    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy"
Jul 17 06:20:34.800231 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.800164    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy"
Jul 17 06:20:34.800231 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.800173    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy"
Jul 17 06:20:34.800400 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.800282    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy"
Jul 17 06:20:34.800400 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.800298    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e94f2e7d-331a-4e76-8a41-7fdce315bf3d" containerName="istio-proxy"
Jul 17 06:20:34.805238 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.805217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.808022 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.808002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6c5dba-openshift-default-dockercfg-pncw4\""
Jul 17 06:20:34.817525 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.817501    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"]
Jul 17 06:20:34.864620 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.864584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-credential-socket\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.864620 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.864619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-istio-token\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.864852 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.864653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c1557b-72b9-4548-9608-990a0f043566-istiod-ca-cert\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.864852 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.864736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-socket\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.864852 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.864786    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-data\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.864852 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.864830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c1557b-72b9-4548-9608-990a0f043566-istio-podinfo\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.865089 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.864928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-envoy\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.865089 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.865001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq7zx\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-kube-api-access-nq7zx\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.865089 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.865047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-certs\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966091 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-credential-socket\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966091 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-istio-token\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966353 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c1557b-72b9-4548-9608-990a0f043566-istiod-ca-cert\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966353 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-socket\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966353 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-data\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966530 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966508    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-data\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c1557b-72b9-4548-9608-990a0f043566-istio-podinfo\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966646 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-envoy\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966715 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7zx\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-kube-api-access-nq7zx\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966774 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-socket\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966774 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-certs\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.966966 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.966946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c1557b-72b9-4548-9608-990a0f043566-istiod-ca-cert\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.967065 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.967047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-certs\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.967200 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.967184    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-credential-socket\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.969526 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.969501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-envoy\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.969662 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.969644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c1557b-72b9-4548-9608-990a0f043566-istio-podinfo\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.975168 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.975145    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-istio-token\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:34.975354 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:34.975336    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq7zx\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-kube-api-access-nq7zx\") pod \"e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") " pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:35.117576 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.117475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:35.265909 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.265856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"]
Jul 17 06:20:35.268646 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:20:35.268612    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c1557b_72b9_4548_9608_990a0f043566.slice/crio-c18bc3165fe9852276c058bab203e943b0d41cae5a91eb7a9b5f09c3ec7b9b5f WatchSource:0}: Error finding container c18bc3165fe9852276c058bab203e943b0d41cae5a91eb7a9b5f09c3ec7b9b5f: Status 404 returned error can't find the container with id c18bc3165fe9852276c058bab203e943b0d41cae5a91eb7a9b5f09c3ec7b9b5f
Jul 17 06:20:35.271254 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.271221    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:35.271359 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.271301    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:35.271359 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.271349    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:35.502447 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.502352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" event={"ID":"b6c1557b-72b9-4548-9608-990a0f043566","Type":"ContainerStarted","Data":"eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4"}
Jul 17 06:20:35.502447 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.502419    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" event={"ID":"b6c1557b-72b9-4548-9608-990a0f043566","Type":"ContainerStarted","Data":"c18bc3165fe9852276c058bab203e943b0d41cae5a91eb7a9b5f09c3ec7b9b5f"}
Jul 17 06:20:35.524316 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:35.524255    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podStartSLOduration=1.5242328459999999 podStartE2EDuration="1.524232846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:20:35.521183656 +0000 UTC m=+2858.696585048" watchObservedRunningTime="2026-07-17 06:20:35.524232846 +0000 UTC m=+2858.699634235"
Jul 17 06:20:36.118236 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:36.118204    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:36.123754 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:36.123723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:36.507705 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:36.507616    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:36.508702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:36.508674    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:43.462986 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.462946    2559 patch_prober.go:28] interesting pod/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 17 06:20:43.463479 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.463021    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 17 06:20:43.546544 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.546512    2559 generic.go:356] "Generic (PLEG): container finished" podID="81dc572f-c4be-41c4-b356-caa12073a332" containerID="c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef" exitCode=0
Jul 17 06:20:43.546728 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.546559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" event={"ID":"81dc572f-c4be-41c4-b356-caa12073a332","Type":"ContainerDied","Data":"c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef"}
Jul 17 06:20:43.546974 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.546960    2559 scope.go:117] "RemoveContainer" containerID="c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef"
Jul 17 06:20:43.548021 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.547993    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:43.548086 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.548061    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:43.548137 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:43.548093    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:44.553083 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:44.553049    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" event={"ID":"81dc572f-c4be-41c4-b356-caa12073a332","Type":"ContainerStarted","Data":"c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98"}
Jul 17 06:20:45.062535 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:45.062507    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:45.062779 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:45.062758    2559 patch_prober.go:28] interesting pod/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 17 06:20:45.062826 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:45.062807    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 17 06:20:46.062735 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:46.062698    2559 patch_prober.go:28] interesting pod/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 17 06:20:46.063215 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:46.062758    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 17 06:20:47.063306 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:47.063268    2559 patch_prober.go:28] interesting pod/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 17 06:20:47.063914 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:47.063860    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 17 06:20:48.063541 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:48.063047    2559 patch_prober.go:28] interesting pod/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 17 06:20:48.063541 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:48.063118    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 17 06:20:49.079541 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:49.079506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:49.081585 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:49.081561    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:49.086328 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:49.086286    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:20:52.549089 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:52.549042    2559 patch_prober.go:28] interesting pod/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 06:20:52.549625 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:52.549127    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 06:20:54.613580 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:54.613546    2559 generic.go:356] "Generic (PLEG): container finished" podID="b6c1557b-72b9-4548-9608-990a0f043566" containerID="eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4" exitCode=0
Jul 17 06:20:54.614018 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:54.613620    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" event={"ID":"b6c1557b-72b9-4548-9608-990a0f043566","Type":"ContainerDied","Data":"eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4"}
Jul 17 06:20:54.614066 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:54.614043    2559 scope.go:117] "RemoveContainer" containerID="eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4"
Jul 17 06:20:54.615100 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:54.615075    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:54.615160 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:54.615147    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:54.615199 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:54.615189    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:20:55.620448 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:55.620410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" event={"ID":"b6c1557b-72b9-4548-9608-990a0f043566","Type":"ContainerStarted","Data":"4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7"}
Jul 17 06:20:56.118018 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:56.117986    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:20:56.118323 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:56.118287    2559 patch_prober.go:28] interesting pod/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 17 06:20:56.118443 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:56.118347    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 17 06:20:57.118575 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:57.118539    2559 patch_prober.go:28] interesting pod/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 17 06:20:57.119033 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:57.118596    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 17 06:20:58.118416 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:58.118377    2559 patch_prober.go:28] interesting pod/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 17 06:20:58.118593 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:58.118446    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 17 06:20:59.118515 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:59.118478    2559 patch_prober.go:28] interesting pod/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 17 06:20:59.118925 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:20:59.118551    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 17 06:21:00.121761 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:00.121733    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:21:00.122222 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:00.122209    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:21:00.122973 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:00.122955    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:21:15.843038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:15.843004    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"]
Jul 17 06:21:15.843621 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:15.843284    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy" containerID="cri-o://c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98" gracePeriod=30
Jul 17 06:21:19.083911 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:19.083861    2559 patch_prober.go:28] interesting pod/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 06:21:19.084285 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:19.083946    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 06:21:21.095682 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.095657    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:21:21.123125 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123037    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-credential-socket\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123125 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123078    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-certs\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123125 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123099    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vqff\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-kube-api-access-5vqff\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123125 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123126    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81dc572f-c4be-41c4-b356-caa12073a332-istiod-ca-cert\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123449 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123160    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-istio-token\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123449 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-data\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123449 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123270    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-socket\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123449 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123306    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81dc572f-c4be-41c4-b356-caa12073a332-istio-podinfo\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123449 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123346    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:21.123449 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123375    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-envoy\") pod \"81dc572f-c4be-41c4-b356-caa12073a332\" (UID: \"81dc572f-c4be-41c4-b356-caa12073a332\") "
Jul 17 06:21:21.123758 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123544    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:21.123758 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123732    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.123758 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.123750    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.124072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.124015    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:21.124380 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.124292    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81dc572f-c4be-41c4-b356-caa12073a332-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:21:21.124801 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.124777    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-data" (OuterVolumeSpecName: "istio-data") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:21.125940 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.125905    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:21.126278 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.126244    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-kube-api-access-5vqff" (OuterVolumeSpecName: "kube-api-access-5vqff") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "kube-api-access-5vqff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:21:21.126433 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.126409    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81dc572f-c4be-41c4-b356-caa12073a332-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:21:21.126539 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.126517    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-istio-token" (OuterVolumeSpecName: "istio-token") pod "81dc572f-c4be-41c4-b356-caa12073a332" (UID: "81dc572f-c4be-41c4-b356-caa12073a332"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:21:21.224265 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.224234    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.224265 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.224259    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.224265 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.224269    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vqff\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-kube-api-access-5vqff\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.224475 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.224280    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81dc572f-c4be-41c4-b356-caa12073a332-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.224475 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.224289    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81dc572f-c4be-41c4-b356-caa12073a332-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.224475 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.224297    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81dc572f-c4be-41c4-b356-caa12073a332-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.224475 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.224304    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81dc572f-c4be-41c4-b356-caa12073a332-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:21.747326 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.747288    2559 generic.go:356] "Generic (PLEG): container finished" podID="81dc572f-c4be-41c4-b356-caa12073a332" containerID="c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98" exitCode=0
Jul 17 06:21:21.747326 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.747329    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"
Jul 17 06:21:21.747505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.747357    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" event={"ID":"81dc572f-c4be-41c4-b356-caa12073a332","Type":"ContainerDied","Data":"c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98"}
Jul 17 06:21:21.747505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.747415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2" event={"ID":"81dc572f-c4be-41c4-b356-caa12073a332","Type":"ContainerDied","Data":"0d88a4bdfca071f255a02c720c19c387d87bfa7f6205a95435e951b787d4e0b0"}
Jul 17 06:21:21.747505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.747445    2559 scope.go:117] "RemoveContainer" containerID="c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98"
Jul 17 06:21:21.756823 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.756806    2559 scope.go:117] "RemoveContainer" containerID="c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef"
Jul 17 06:21:21.765071 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.765001    2559 scope.go:117] "RemoveContainer" containerID="c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98"
Jul 17 06:21:21.765387 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:21:21.765365    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98\": container with ID starting with c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98 not found: ID does not exist" containerID="c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98"
Jul 17 06:21:21.765474 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.765395    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98"} err="failed to get container status \"c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98\": rpc error: code = NotFound desc = could not find container \"c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98\": container with ID starting with c37106c8fe1d1c65c6ad7675b9d142eab6f83e76e7ac142c15e6ff6ef9924b98 not found: ID does not exist"
Jul 17 06:21:21.765474 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.765412    2559 scope.go:117] "RemoveContainer" containerID="c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef"
Jul 17 06:21:21.765648 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:21:21.765633    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef\": container with ID starting with c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef not found: ID does not exist" containerID="c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef"
Jul 17 06:21:21.765713 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.765650    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef"} err="failed to get container status \"c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef\": rpc error: code = NotFound desc = could not find container \"c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef\": container with ID starting with c3f6849d4fe8521083b00d28c6e44423ede3250610853669dbe67f96e7f301ef not found: ID does not exist"
Jul 17 06:21:21.767354 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.767332    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"]
Jul 17 06:21:21.772448 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:21.772425    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1615b7-openshift-default-df79965bc-bbfx2"]
Jul 17 06:21:23.324096 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:23.324064    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81dc572f-c4be-41c4-b356-caa12073a332" path="/var/lib/kubelet/pods/81dc572f-c4be-41c4-b356-caa12073a332/volumes"
Jul 17 06:21:41.971340 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:41.971305    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"]
Jul 17 06:21:41.971822 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:41.971586    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy" containerID="cri-o://4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7" gracePeriod=30
Jul 17 06:21:42.863036 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.863004    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"]
Jul 17 06:21:42.863530 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.863509    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy"
Jul 17 06:21:42.863530 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.863532    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy"
Jul 17 06:21:42.863691 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.863577    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy"
Jul 17 06:21:42.863691 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.863587    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy"
Jul 17 06:21:42.863797 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.863692    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy"
Jul 17 06:21:42.863797 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.863705    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81dc572f-c4be-41c4-b356-caa12073a332" containerName="istio-proxy"
Jul 17 06:21:42.866987 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.866966    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.869706 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.869684    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e9bcaa-openshift-default-dockercfg-cqlg9\""
Jul 17 06:21:42.877916 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.877892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"]
Jul 17 06:21:42.924187 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-token\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924355 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-socket\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924355 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-credential-socket\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924355 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-envoy\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924355 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-certs\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924492 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-data\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924492 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6c7356-da98-4bff-bd6b-8621efc040f5-istiod-ca-cert\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924555 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjlff\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-kube-api-access-fjlff\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:42.924555 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:42.924515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-podinfo\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.025610 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-data\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6c7356-da98-4bff-bd6b-8621efc040f5-istiod-ca-cert\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjlff\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-kube-api-access-fjlff\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-podinfo\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-token\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-socket\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-credential-socket\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-envoy\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026082 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.025976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-certs\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026519 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.026293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-credential-socket\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026519 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.026422    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-data\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026519 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.026469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6c7356-da98-4bff-bd6b-8621efc040f5-istiod-ca-cert\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026684 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.026644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-socket\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.026684 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.026665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-certs\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.028274 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.028242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-envoy\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.028457 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.028438    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-podinfo\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.034636 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.034609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjlff\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-kube-api-access-fjlff\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.034777 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.034761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-token\") pod \"e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") " pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.178741 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.178657    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:43.347615 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.347578    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"]
Jul 17 06:21:43.352392 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:21:43.352364    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6c7356_da98_4bff_bd6b_8621efc040f5.slice/crio-94e69018cf888b1e364b2cff26425d533bd33b73a096e56596c06a8a3cd7e2a1 WatchSource:0}: Error finding container 94e69018cf888b1e364b2cff26425d533bd33b73a096e56596c06a8a3cd7e2a1: Status 404 returned error can't find the container with id 94e69018cf888b1e364b2cff26425d533bd33b73a096e56596c06a8a3cd7e2a1
Jul 17 06:21:43.354514 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.354484    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:43.354594 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.354551    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:43.354594 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.354580    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:43.864457 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.864419    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" event={"ID":"6e6c7356-da98-4bff-bd6b-8621efc040f5","Type":"ContainerStarted","Data":"d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b"}
Jul 17 06:21:43.864654 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.864474    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" event={"ID":"6e6c7356-da98-4bff-bd6b-8621efc040f5","Type":"ContainerStarted","Data":"94e69018cf888b1e364b2cff26425d533bd33b73a096e56596c06a8a3cd7e2a1"}
Jul 17 06:21:43.888446 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:43.888385    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" podStartSLOduration=1.888368624 podStartE2EDuration="1.888368624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:21:43.886442563 +0000 UTC m=+2927.061843951" watchObservedRunningTime="2026-07-17 06:21:43.888368624 +0000 UTC m=+2927.063770011"
Jul 17 06:21:44.179341 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:44.179263    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:44.184306 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:44.184281    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:44.870018 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:44.869989    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:44.871038 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:44.871023    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:45.124837 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:45.124755    2559 patch_prober.go:28] interesting pod/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 06:21:45.124995 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:45.124841    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 06:21:47.224997 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.224971    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:21:47.368030 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.367988    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq7zx\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-kube-api-access-nq7zx\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368193 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368083    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c1557b-72b9-4548-9608-990a0f043566-istio-podinfo\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368193 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368115    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-credential-socket\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368193 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368160    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c1557b-72b9-4548-9608-990a0f043566-istiod-ca-cert\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368193 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368190    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-envoy\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368419 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368220    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-istio-token\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368419 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368254    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-data\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368419 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368288    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-certs\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368419 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368317    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-socket\") pod \"b6c1557b-72b9-4548-9608-990a0f043566\" (UID: \"b6c1557b-72b9-4548-9608-990a0f043566\") "
Jul 17 06:21:47.368694 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368463    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:47.368694 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368546    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6c1557b-72b9-4548-9608-990a0f043566-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:21:47.368694 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368688    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:47.368861 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368815    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.368861 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368836    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c1557b-72b9-4548-9608-990a0f043566-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.368861 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368850    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.369063 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.368854    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:47.369459 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.369431    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:47.370376 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.370354    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6c1557b-72b9-4548-9608-990a0f043566-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:21:47.370615 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.370593    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-kube-api-access-nq7zx" (OuterVolumeSpecName: "kube-api-access-nq7zx") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "kube-api-access-nq7zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:21:47.370811 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.370791    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:21:47.371005 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.370982    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6c1557b-72b9-4548-9608-990a0f043566" (UID: "b6c1557b-72b9-4548-9608-990a0f043566"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:21:47.469688 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.469652    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq7zx\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-kube-api-access-nq7zx\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.469688 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.469682    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c1557b-72b9-4548-9608-990a0f043566-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.469688 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.469692    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.469934 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.469700    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c1557b-72b9-4548-9608-990a0f043566-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.469934 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.469708    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.469934 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.469716    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c1557b-72b9-4548-9608-990a0f043566-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:21:47.888658 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.888620    2559 generic.go:356] "Generic (PLEG): container finished" podID="b6c1557b-72b9-4548-9608-990a0f043566" containerID="4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7" exitCode=0
Jul 17 06:21:47.888937 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.888663    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"
Jul 17 06:21:47.888937 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.888692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" event={"ID":"b6c1557b-72b9-4548-9608-990a0f043566","Type":"ContainerDied","Data":"4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7"}
Jul 17 06:21:47.888937 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.888743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72" event={"ID":"b6c1557b-72b9-4548-9608-990a0f043566","Type":"ContainerDied","Data":"c18bc3165fe9852276c058bab203e943b0d41cae5a91eb7a9b5f09c3ec7b9b5f"}
Jul 17 06:21:47.888937 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.888770    2559 scope.go:117] "RemoveContainer" containerID="4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7"
Jul 17 06:21:47.898226 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.898205    2559 scope.go:117] "RemoveContainer" containerID="eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4"
Jul 17 06:21:47.906189 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.906171    2559 scope.go:117] "RemoveContainer" containerID="4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7"
Jul 17 06:21:47.906474 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:21:47.906455    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7\": container with ID starting with 4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7 not found: ID does not exist" containerID="4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7"
Jul 17 06:21:47.906524 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.906485    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7"} err="failed to get container status \"4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7\": rpc error: code = NotFound desc = could not find container \"4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7\": container with ID starting with 4842ac7a3ace0b091c6069e615adb71076455481cabf49e322f0378d996000d7 not found: ID does not exist"
Jul 17 06:21:47.906524 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.906503    2559 scope.go:117] "RemoveContainer" containerID="eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4"
Jul 17 06:21:47.906745 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:21:47.906727    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4\": container with ID starting with eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4 not found: ID does not exist" containerID="eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4"
Jul 17 06:21:47.906800 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.906756    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4"} err="failed to get container status \"eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4\": rpc error: code = NotFound desc = could not find container \"eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4\": container with ID starting with eb45a639cae32bc72e4de4039427a722f48b2fd95edcb01e1f15f911999912e4 not found: ID does not exist"
Jul 17 06:21:47.910399 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.910377    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"]
Jul 17 06:21:47.915957 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:47.915927    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6c5dba-openshift-default-6b47b945dc-6gk72"]
Jul 17 06:21:49.324543 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:49.324508    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c1557b-72b9-4548-9608-990a0f043566" path="/var/lib/kubelet/pods/b6c1557b-72b9-4548-9608-990a0f043566/volumes"
Jul 17 06:21:50.911161 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.911129    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"]
Jul 17 06:21:50.911665 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.911645    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy"
Jul 17 06:21:50.911712 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.911669    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy"
Jul 17 06:21:50.911777 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.911767    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy"
Jul 17 06:21:50.911813 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.911782    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy"
Jul 17 06:21:50.916313 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.916292    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:50.918795 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.918772    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-efbd92-openshift-default-dockercfg-cf4rw\""
Jul 17 06:21:50.928251 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:50.928227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"]
Jul 17 06:21:51.002351 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-certs\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-data\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qbl5\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-kube-api-access-6qbl5\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-podinfo\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002516 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf75741-a395-494f-bd8b-8ee1eeae582f-istiod-ca-cert\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-socket\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-credential-socket\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-envoy\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.002749 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.002703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-token\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.103568 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-token\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.103724 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-certs\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.103724 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103711    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-data\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.103804 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qbl5\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-kube-api-access-6qbl5\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.103804 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103772    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-podinfo\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.103910 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf75741-a395-494f-bd8b-8ee1eeae582f-istiod-ca-cert\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.103967 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-socket\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.104021 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.103967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-credential-socket\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.104021 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.104001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-certs\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.104021 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.104008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-envoy\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.104178 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.104099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-data\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.104313 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.104291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-socket\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.104401 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.104384    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-credential-socket\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.104522 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.104506    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf75741-a395-494f-bd8b-8ee1eeae582f-istiod-ca-cert\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.106095 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.106073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-envoy\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.106391 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.106367    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-podinfo\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.112211 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.112192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-token\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.112305 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.112267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qbl5\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-kube-api-access-6qbl5\") pod \"e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") " pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.227934 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.227823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:51.374304 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.374265    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"]
Jul 17 06:21:51.378056 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:21:51.378027    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf75741_a395_494f_bd8b_8ee1eeae582f.slice/crio-732bd04898997e11d9eaa2d42c05bad26f67a52a13208e9dd0f05d5ec765a9b4 WatchSource:0}: Error finding container 732bd04898997e11d9eaa2d42c05bad26f67a52a13208e9dd0f05d5ec765a9b4: Status 404 returned error can't find the container with id 732bd04898997e11d9eaa2d42c05bad26f67a52a13208e9dd0f05d5ec765a9b4
Jul 17 06:21:51.380365 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.380333    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:51.380454 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.380415    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:51.380454 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.380442    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:51.911229 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.911192    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" event={"ID":"fdf75741-a395-494f-bd8b-8ee1eeae582f","Type":"ContainerStarted","Data":"3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6"}
Jul 17 06:21:51.911622 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.911282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" event={"ID":"fdf75741-a395-494f-bd8b-8ee1eeae582f","Type":"ContainerStarted","Data":"732bd04898997e11d9eaa2d42c05bad26f67a52a13208e9dd0f05d5ec765a9b4"}
Jul 17 06:21:51.932898 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:51.932837    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" podStartSLOduration=1.9328233030000002 podStartE2EDuration="1.932823303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:21:51.930199195 +0000 UTC m=+2935.105600585" watchObservedRunningTime="2026-07-17 06:21:51.932823303 +0000 UTC m=+2935.108224691"
Jul 17 06:21:52.228069 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:52.227982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:52.233068 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:52.233041    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:52.916011 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:52.915980    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:52.917044 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:52.917022    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:21:58.947648 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:58.947568    2559 generic.go:356] "Generic (PLEG): container finished" podID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerID="d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b" exitCode=0
Jul 17 06:21:58.948065 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:58.947645    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" event={"ID":"6e6c7356-da98-4bff-bd6b-8621efc040f5","Type":"ContainerDied","Data":"d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b"}
Jul 17 06:21:58.948137 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:58.948121    2559 scope.go:117] "RemoveContainer" containerID="d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b"
Jul 17 06:21:58.949180 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:58.949154    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:58.949280 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:58.949222    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:58.949280 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:58.949256    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:21:59.870236 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:59.870177    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:21:59.954086 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:21:59.954050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" event={"ID":"6e6c7356-da98-4bff-bd6b-8621efc040f5","Type":"ContainerStarted","Data":"749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4"}
Jul 17 06:22:00.179222 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:00.179122    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:22:00.180575 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:00.180539    2559 patch_prober.go:28] interesting pod/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 17 06:22:00.180725 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:00.180617    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 17 06:22:01.179748 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:01.179712    2559 patch_prober.go:28] interesting pod/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 17 06:22:01.180456 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:01.180429    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 17 06:22:02.180146 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:02.179650    2559 patch_prober.go:28] interesting pod/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 17 06:22:02.180146 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:02.179725    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 17 06:22:03.179785 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:03.179741    2559 patch_prober.go:28] interesting pod/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 17 06:22:03.180021 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:03.179816    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 17 06:22:04.190164 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:04.190129    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:22:04.190677 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:04.190477    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:22:04.191515 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:04.191490    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:22:08.958053 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:08.958007    2559 patch_prober.go:28] interesting pod/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 06:22:08.958455 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:08.958087    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 06:22:11.019226 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:11.019194    2559 generic.go:356] "Generic (PLEG): container finished" podID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerID="3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6" exitCode=0
Jul 17 06:22:11.019686 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:11.019269    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" event={"ID":"fdf75741-a395-494f-bd8b-8ee1eeae582f","Type":"ContainerDied","Data":"3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6"}
Jul 17 06:22:11.019686 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:11.019655    2559 scope.go:117] "RemoveContainer" containerID="3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6"
Jul 17 06:22:11.020696 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:11.020670    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:22:11.020762 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:11.020746    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:22:11.020799 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:11.020784    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 17 06:22:12.027834 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:12.027797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" event={"ID":"fdf75741-a395-494f-bd8b-8ee1eeae582f","Type":"ContainerStarted","Data":"403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36"}
Jul 17 06:22:12.228477 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:12.228440    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:22:12.228779 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:12.228756    2559 patch_prober.go:28] interesting pod/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 17 06:22:12.228829 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:12.228810    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 17 06:22:13.229051 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:13.229017    2559 patch_prober.go:28] interesting pod/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 17 06:22:13.229417 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:13.229075    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 17 06:22:14.228711 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:14.228676    2559 patch_prober.go:28] interesting pod/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 17 06:22:14.228899 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:14.228730    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 17 06:22:15.228194 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:15.228159    2559 patch_prober.go:28] interesting pod/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 17 06:22:15.228613 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:15.228213    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 17 06:22:16.233135 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:16.233104    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:22:16.233508 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:16.233379    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:22:16.234014 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:16.233996    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:22:57.493037 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:57.493008    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:22:57.499445 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:22:57.499425    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:25:54.036724 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.036685    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"]
Jul 17 06:25:54.037181 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.037112    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy"
Jul 17 06:25:54.037181 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.037125    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c1557b-72b9-4548-9608-990a0f043566" containerName="istio-proxy"
Jul 17 06:25:54.040276 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.040260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.044392 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.044366    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"openshift-service-ca.crt\""
Jul 17 06:25:54.044392 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.044382    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"sub-test-model-efbd92-kserve-self-signed-certs\""
Jul 17 06:25:54.044608 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.044370    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"kube-root-ca.crt\""
Jul 17 06:25:54.044608 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.044416    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"default-dockercfg-vs94t\""
Jul 17 06:25:54.050940 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.050914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"]
Jul 17 06:25:54.090858 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.090820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-dshm\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.091057 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.090959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-model-cache\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.091057 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.090995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nhdf\" (UniqueName: \"kubernetes.io/projected/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-kube-api-access-6nhdf\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.091057 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.091024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-home\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.091057 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.091045    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tls-certs\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.091230 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.091155    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tmp-dir\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.191830 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.191801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-model-cache\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192031 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.191834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nhdf\" (UniqueName: \"kubernetes.io/projected/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-kube-api-access-6nhdf\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192031 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.191860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-home\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192031 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.191995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tls-certs\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192202 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.192094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tmp-dir\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192202 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.192147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-dshm\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192285 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.192242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-model-cache\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192285 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.192258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-home\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.192472 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.192440    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tmp-dir\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.194212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.194192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-dshm\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.194409 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.194389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tls-certs\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.200588 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.200565    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nhdf\" (UniqueName: \"kubernetes.io/projected/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-kube-api-access-6nhdf\") pod \"sub-test-model-efbd92-kserve-59c686b875-x9qc9\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") " pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.351156 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.351122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:25:54.490073 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:54.490047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"]
Jul 17 06:25:54.491532 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:25:54.491499    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c5b8b8f_bbd3_43d8_b9d1_f99b49e88e5d.slice/crio-c6f45571adb373789d97bd6324c4a0bed4a3b9710a8a11d96535a04236608bc6 WatchSource:0}: Error finding container c6f45571adb373789d97bd6324c4a0bed4a3b9710a8a11d96535a04236608bc6: Status 404 returned error can't find the container with id c6f45571adb373789d97bd6324c4a0bed4a3b9710a8a11d96535a04236608bc6
Jul 17 06:25:55.129151 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:55.129111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9" event={"ID":"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d","Type":"ContainerStarted","Data":"6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1"}
Jul 17 06:25:55.129517 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:55.129163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9" event={"ID":"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d","Type":"ContainerStarted","Data":"c6f45571adb373789d97bd6324c4a0bed4a3b9710a8a11d96535a04236608bc6"}
Jul 17 06:25:55.152788 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:25:55.152738    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9" podStartSLOduration=1.1527235710000001 podStartE2EDuration="1.152723571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:25:55.151242013 +0000 UTC m=+3178.326643404" watchObservedRunningTime="2026-07-17 06:25:55.152723571 +0000 UTC m=+3178.328124958"
Jul 17 06:26:04.351288 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:26:04.351251    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:26:04.351680 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:26:04.351299    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:26:04.363647 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:26:04.363620    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:26:05.189697 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:26:05.189672    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:26:47.455623 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:26:47.455581    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"]
Jul 17 06:27:02.476142 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.476036    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9" podUID="1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" containerName="main" containerID="cri-o://6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1" gracePeriod=45
Jul 17 06:27:02.730708 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.730640    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:27:02.851443 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851391    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nhdf\" (UniqueName: \"kubernetes.io/projected/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-kube-api-access-6nhdf\") pod \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") "
Jul 17 06:27:02.851655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851487    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-model-cache\") pod \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") "
Jul 17 06:27:02.851655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851521    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tls-certs\") pod \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") "
Jul 17 06:27:02.851655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-home\") pod \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") "
Jul 17 06:27:02.851655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851589    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tmp-dir\") pod \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") "
Jul 17 06:27:02.851655 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-dshm\") pod \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\" (UID: \"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d\") "
Jul 17 06:27:02.851970 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851829    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-model-cache" (OuterVolumeSpecName: "model-cache") pod "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" (UID: "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:27:02.851970 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851859    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-home" (OuterVolumeSpecName: "home") pod "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" (UID: "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:27:02.851970 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.851909    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" (UID: "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:27:02.852085 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.852061    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-model-cache\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:27:02.852132 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.852087    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-home\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:27:02.852132 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.852101    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tmp-dir\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:27:02.853743 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.853711    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-dshm" (OuterVolumeSpecName: "dshm") pod "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" (UID: "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:27:02.853855 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.853778    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-kube-api-access-6nhdf" (OuterVolumeSpecName: "kube-api-access-6nhdf") pod "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" (UID: "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d"). InnerVolumeSpecName "kube-api-access-6nhdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:27:02.853855 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.853840    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" (UID: "1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:27:02.953385 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.953345    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-dshm\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:27:02.953385 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.953379    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nhdf\" (UniqueName: \"kubernetes.io/projected/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-kube-api-access-6nhdf\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:27:02.953385 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:02.953389    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d-tls-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:27:03.468189 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.468157    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" containerID="6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1" exitCode=0
Jul 17 06:27:03.468349 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.468205    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"
Jul 17 06:27:03.468349 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.468230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9" event={"ID":"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d","Type":"ContainerDied","Data":"6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1"}
Jul 17 06:27:03.468349 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.468261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9" event={"ID":"1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d","Type":"ContainerDied","Data":"c6f45571adb373789d97bd6324c4a0bed4a3b9710a8a11d96535a04236608bc6"}
Jul 17 06:27:03.468349 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.468276    2559 scope.go:117] "RemoveContainer" containerID="6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1"
Jul 17 06:27:03.477316 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.477182    2559 scope.go:117] "RemoveContainer" containerID="6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1"
Jul 17 06:27:03.477521 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:27:03.477441    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1\": container with ID starting with 6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1 not found: ID does not exist" containerID="6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1"
Jul 17 06:27:03.477521 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.477472    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1"} err="failed to get container status \"6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1\": rpc error: code = NotFound desc = could not find container \"6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1\": container with ID starting with 6429cf17851ca4d481fd77ccc0e6197227ad25a57740ee72f9220b8549b539f1 not found: ID does not exist"
Jul 17 06:27:03.485053 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.485032    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"]
Jul 17 06:27:03.493462 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:03.493436    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/sub-test-model-efbd92-kserve-59c686b875-x9qc9"]
Jul 17 06:27:05.325070 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:05.325031    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" path="/var/lib/kubelet/pods/1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d/volumes"
Jul 17 06:27:30.142004 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.141971    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"]
Jul 17 06:27:30.144398 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.142377    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" containerName="main"
Jul 17 06:27:30.144398 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.142389    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" containerName="main"
Jul 17 06:27:30.144398 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.142487    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5b8b8f-bbd3-43d8-b9d1-f99b49e88e5d" containerName="main"
Jul 17 06:27:30.145176 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.145160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.148045 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.148023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"kube-root-ca.crt\""
Jul 17 06:27:30.149353 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.149332    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"rate-test-model-efbd92-kserve-self-signed-certs\""
Jul 17 06:27:30.149444 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.149408    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"default-dockercfg-vs94t\""
Jul 17 06:27:30.149444 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.149424    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-efbd92\"/\"openshift-service-ca.crt\""
Jul 17 06:27:30.155615 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.155591    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"]
Jul 17 06:27:30.196592 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.196562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tls-certs\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.196702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.196604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-model-cache\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.196702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.196637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tmp-dir\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.196702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.196668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-dshm\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.196810 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.196722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-home\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.196810 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.196763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctnxn\" (UniqueName: \"kubernetes.io/projected/3f34fb6a-b914-48f3-bc7a-db2acade68ea-kube-api-access-ctnxn\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.297523 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.297492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-home\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.297696 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.297553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctnxn\" (UniqueName: \"kubernetes.io/projected/3f34fb6a-b914-48f3-bc7a-db2acade68ea-kube-api-access-ctnxn\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.297696 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.297621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tls-certs\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.297696 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.297653    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-model-cache\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.297696 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.297688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tmp-dir\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.297854 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.297722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-dshm\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.297980 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.297959    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-home\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.298058 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.298040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-model-cache\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.298104 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.298091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tmp-dir\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.299990 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.299969    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-dshm\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.300151 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.300135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tls-certs\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.305811 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.305786    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctnxn\" (UniqueName: \"kubernetes.io/projected/3f34fb6a-b914-48f3-bc7a-db2acade68ea-kube-api-access-ctnxn\") pod \"rate-test-model-efbd92-kserve-7cb57548f9-xs97v\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") " pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.454540 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.454457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:30.594451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.594420    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"]
Jul 17 06:27:30.597091 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:27:30.597065    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f34fb6a_b914_48f3_bc7a_db2acade68ea.slice/crio-d997cfaf52e1f814ef5f7ff815a109c5afdc79f6b287ccdd14a742e054a2f3c8 WatchSource:0}: Error finding container d997cfaf52e1f814ef5f7ff815a109c5afdc79f6b287ccdd14a742e054a2f3c8: Status 404 returned error can't find the container with id d997cfaf52e1f814ef5f7ff815a109c5afdc79f6b287ccdd14a742e054a2f3c8
Jul 17 06:27:30.604413 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:30.604370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v" event={"ID":"3f34fb6a-b914-48f3-bc7a-db2acade68ea","Type":"ContainerStarted","Data":"d997cfaf52e1f814ef5f7ff815a109c5afdc79f6b287ccdd14a742e054a2f3c8"}
Jul 17 06:27:31.611196 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:31.611159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v" event={"ID":"3f34fb6a-b914-48f3-bc7a-db2acade68ea","Type":"ContainerStarted","Data":"e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977"}
Jul 17 06:27:31.630980 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:31.630933    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v" podStartSLOduration=1.630917312 podStartE2EDuration="1.630917312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:27:31.629771463 +0000 UTC m=+3274.805172851" watchObservedRunningTime="2026-07-17 06:27:31.630917312 +0000 UTC m=+3274.806318697"
Jul 17 06:27:40.455394 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:40.455358    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:40.455816 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:40.455439    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:40.468177 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:40.468153    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:40.667757 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:40.667723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:27:57.524714 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:57.524677    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:27:57.535991 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:27:57.535962    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:28:25.907017 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:25.906927    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"]
Jul 17 06:28:40.928641 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:40.928605    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v" podUID="3f34fb6a-b914-48f3-bc7a-db2acade68ea" containerName="main" containerID="cri-o://e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977" gracePeriod=45
Jul 17 06:28:41.186434 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.186371    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:28:41.280970 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.280935    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tmp-dir\") pod \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") "
Jul 17 06:28:41.281138 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.280978    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-model-cache\") pod \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") "
Jul 17 06:28:41.281138 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281051    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-home\") pod \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") "
Jul 17 06:28:41.281138 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281080    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tls-certs\") pod \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") "
Jul 17 06:28:41.281138 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281099    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctnxn\" (UniqueName: \"kubernetes.io/projected/3f34fb6a-b914-48f3-bc7a-db2acade68ea-kube-api-access-ctnxn\") pod \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") "
Jul 17 06:28:41.281357 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281187    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-dshm\") pod \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\" (UID: \"3f34fb6a-b914-48f3-bc7a-db2acade68ea\") "
Jul 17 06:28:41.281357 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281235    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f34fb6a-b914-48f3-bc7a-db2acade68ea" (UID: "3f34fb6a-b914-48f3-bc7a-db2acade68ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:28:41.281357 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f34fb6a-b914-48f3-bc7a-db2acade68ea" (UID: "3f34fb6a-b914-48f3-bc7a-db2acade68ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:28:41.281357 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281301    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-home" (OuterVolumeSpecName: "home") pod "3f34fb6a-b914-48f3-bc7a-db2acade68ea" (UID: "3f34fb6a-b914-48f3-bc7a-db2acade68ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:28:41.281560 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281468    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-home\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:28:41.281560 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281484    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tmp-dir\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:28:41.281560 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.281493    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-model-cache\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:28:41.283256 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.283230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-dshm" (OuterVolumeSpecName: "dshm") pod "3f34fb6a-b914-48f3-bc7a-db2acade68ea" (UID: "3f34fb6a-b914-48f3-bc7a-db2acade68ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:28:41.283256 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.283245    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f34fb6a-b914-48f3-bc7a-db2acade68ea" (UID: "3f34fb6a-b914-48f3-bc7a-db2acade68ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 06:28:41.283380 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.283271    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f34fb6a-b914-48f3-bc7a-db2acade68ea-kube-api-access-ctnxn" (OuterVolumeSpecName: "kube-api-access-ctnxn") pod "3f34fb6a-b914-48f3-bc7a-db2acade68ea" (UID: "3f34fb6a-b914-48f3-bc7a-db2acade68ea"). InnerVolumeSpecName "kube-api-access-ctnxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:28:41.382983 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.382705    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f34fb6a-b914-48f3-bc7a-db2acade68ea-tls-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:28:41.382983 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.382738    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctnxn\" (UniqueName: \"kubernetes.io/projected/3f34fb6a-b914-48f3-bc7a-db2acade68ea-kube-api-access-ctnxn\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:28:41.382983 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.382752    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f34fb6a-b914-48f3-bc7a-db2acade68ea-dshm\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:28:41.964721 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.964685    2559 generic.go:356] "Generic (PLEG): container finished" podID="3f34fb6a-b914-48f3-bc7a-db2acade68ea" containerID="e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977" exitCode=0
Jul 17 06:28:41.965220 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.964740    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"
Jul 17 06:28:41.965220 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.964763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v" event={"ID":"3f34fb6a-b914-48f3-bc7a-db2acade68ea","Type":"ContainerDied","Data":"e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977"}
Jul 17 06:28:41.965220 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.964795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v" event={"ID":"3f34fb6a-b914-48f3-bc7a-db2acade68ea","Type":"ContainerDied","Data":"d997cfaf52e1f814ef5f7ff815a109c5afdc79f6b287ccdd14a742e054a2f3c8"}
Jul 17 06:28:41.965220 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.964811    2559 scope.go:117] "RemoveContainer" containerID="e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977"
Jul 17 06:28:41.973495 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.973477    2559 scope.go:117] "RemoveContainer" containerID="e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977"
Jul 17 06:28:41.973761 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:28:41.973740    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977\": container with ID starting with e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977 not found: ID does not exist" containerID="e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977"
Jul 17 06:28:41.973826 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.973769    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977"} err="failed to get container status \"e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977\": rpc error: code = NotFound desc = could not find container \"e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977\": container with ID starting with e0800d1a18396fbef0865d9916aa99c55f8b50e655ef0ac19843491e26986977 not found: ID does not exist"
Jul 17 06:28:41.984320 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.984298    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"]
Jul 17 06:28:41.987481 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:41.987460    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-efbd92/rate-test-model-efbd92-kserve-7cb57548f9-xs97v"]
Jul 17 06:28:43.325123 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:28:43.325092    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f34fb6a-b914-48f3-bc7a-db2acade68ea" path="/var/lib/kubelet/pods/3f34fb6a-b914-48f3-bc7a-db2acade68ea/volumes"
Jul 17 06:29:09.732505 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:09.732466    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"]
Jul 17 06:29:09.733022 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:09.732753    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy" containerID="cri-o://749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4" gracePeriod=30
Jul 17 06:29:14.993832 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:14.993803    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:29:15.003565 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003515    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjlff\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-kube-api-access-fjlff\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003565 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003549    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-socket\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003571    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-data\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003596    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-podinfo\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003633    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-envoy\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003653    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6c7356-da98-4bff-bd6b-8621efc040f5-istiod-ca-cert\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003702 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-certs\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003961 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003718    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-token\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003961 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003771    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-credential-socket\") pod \"6e6c7356-da98-4bff-bd6b-8621efc040f5\" (UID: \"6e6c7356-da98-4bff-bd6b-8621efc040f5\") "
Jul 17 06:29:15.003961 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.003814    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:15.004354 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.004134    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.004354 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.004168    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:15.004468 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.004346    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:15.004468 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.004410    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e6c7356-da98-4bff-bd6b-8621efc040f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:29:15.004633 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.004610    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:15.005826 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.005804    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:29:15.005989 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.005958    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:29:15.006187 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.006168    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:15.006250 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.006208    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-kube-api-access-fjlff" (OuterVolumeSpecName: "kube-api-access-fjlff") pod "6e6c7356-da98-4bff-bd6b-8621efc040f5" (UID: "6e6c7356-da98-4bff-bd6b-8621efc040f5"). InnerVolumeSpecName "kube-api-access-fjlff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:29:15.104944 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104909    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjlff\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-kube-api-access-fjlff\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.104944 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104940    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.104944 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104949    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.104944 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104957    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.105302 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104965    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e6c7356-da98-4bff-bd6b-8621efc040f5-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.105302 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104973    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.105302 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104988    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e6c7356-da98-4bff-bd6b-8621efc040f5-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.105302 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.104997    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e6c7356-da98-4bff-bd6b-8621efc040f5-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:15.134886 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.134845    2559 generic.go:356] "Generic (PLEG): container finished" podID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerID="749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4" exitCode=0
Jul 17 06:29:15.135054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.134933    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"
Jul 17 06:29:15.135054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.134937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" event={"ID":"6e6c7356-da98-4bff-bd6b-8621efc040f5","Type":"ContainerDied","Data":"749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4"}
Jul 17 06:29:15.135054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.134997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn" event={"ID":"6e6c7356-da98-4bff-bd6b-8621efc040f5","Type":"ContainerDied","Data":"94e69018cf888b1e364b2cff26425d533bd33b73a096e56596c06a8a3cd7e2a1"}
Jul 17 06:29:15.135054 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.135026    2559 scope.go:117] "RemoveContainer" containerID="749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4"
Jul 17 06:29:15.144089 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.144074    2559 scope.go:117] "RemoveContainer" containerID="d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b"
Jul 17 06:29:15.151796 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.151776    2559 scope.go:117] "RemoveContainer" containerID="749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4"
Jul 17 06:29:15.152073 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:29:15.152055    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4\": container with ID starting with 749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4 not found: ID does not exist" containerID="749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4"
Jul 17 06:29:15.152157 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.152080    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4"} err="failed to get container status \"749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4\": rpc error: code = NotFound desc = could not find container \"749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4\": container with ID starting with 749cc4a7dc6917461288cccee367faee172991e88ea3ed2fd1fc8b6cb2e7bfc4 not found: ID does not exist"
Jul 17 06:29:15.152157 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.152099    2559 scope.go:117] "RemoveContainer" containerID="d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b"
Jul 17 06:29:15.152394 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:29:15.152368    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b\": container with ID starting with d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b not found: ID does not exist" containerID="d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b"
Jul 17 06:29:15.152450 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.152404    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b"} err="failed to get container status \"d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b\": rpc error: code = NotFound desc = could not find container \"d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b\": container with ID starting with d99d5ac08f76b583a5985401f08ea1e9982f929c41bd1df9ac980afe37ce861b not found: ID does not exist"
Jul 17 06:29:15.158228 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.158206    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"]
Jul 17 06:29:15.164240 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.164221    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e9bcaa-openshift-default-65fb6d857f-xs5jn"]
Jul 17 06:29:15.324722 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:15.324678    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" path="/var/lib/kubelet/pods/6e6c7356-da98-4bff-bd6b-8621efc040f5/volumes"
Jul 17 06:29:35.841773 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:35.841722    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"]
Jul 17 06:29:35.842414 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:35.841986    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy" containerID="cri-o://403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36" gracePeriod=30
Jul 17 06:29:36.542230 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:36.542193    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65cf699f86-ndt5s_53f59a22-f577-41a7-b7c0-65058d47b613/authorino/0.log"
Jul 17 06:29:41.105108 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.105083    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:29:41.256131 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256054    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-certs\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256131 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256120    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qbl5\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-kube-api-access-6qbl5\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256145    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-credential-socket\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256167    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-data\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256205    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-envoy\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256244    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf75741-a395-494f-bd8b-8ee1eeae582f-istiod-ca-cert\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256296    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-socket\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256334    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-token\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256360    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-podinfo\") pod \"fdf75741-a395-494f-bd8b-8ee1eeae582f\" (UID: \"fdf75741-a395-494f-bd8b-8ee1eeae582f\") "
Jul 17 06:29:41.256451 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256401    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:41.256885 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256517    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:41.256885 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256728    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-certs\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.256885 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256745    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-credential-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.256885 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.256838    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdf75741-a395-494f-bd8b-8ee1eeae582f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 06:29:41.257242 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.257209    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:41.257331 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.257295    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:41.258739 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.258671    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 06:29:41.258927 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.258786    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:29:41.258927 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.258839    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 06:29:41.259399 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.259372    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-kube-api-access-6qbl5" (OuterVolumeSpecName: "kube-api-access-6qbl5") pod "fdf75741-a395-494f-bd8b-8ee1eeae582f" (UID: "fdf75741-a395-494f-bd8b-8ee1eeae582f"). InnerVolumeSpecName "kube-api-access-6qbl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 06:29:41.264692 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.264667    2559 generic.go:356] "Generic (PLEG): container finished" podID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerID="403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36" exitCode=0
Jul 17 06:29:41.264799 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.264717    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"
Jul 17 06:29:41.264799 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.264754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" event={"ID":"fdf75741-a395-494f-bd8b-8ee1eeae582f","Type":"ContainerDied","Data":"403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36"}
Jul 17 06:29:41.264940 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.264813    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk" event={"ID":"fdf75741-a395-494f-bd8b-8ee1eeae582f","Type":"ContainerDied","Data":"732bd04898997e11d9eaa2d42c05bad26f67a52a13208e9dd0f05d5ec765a9b4"}
Jul 17 06:29:41.264940 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.264837    2559 scope.go:117] "RemoveContainer" containerID="403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36"
Jul 17 06:29:41.278485 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.278468    2559 scope.go:117] "RemoveContainer" containerID="3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6"
Jul 17 06:29:41.285996 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.285978    2559 scope.go:117] "RemoveContainer" containerID="403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36"
Jul 17 06:29:41.286240 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:29:41.286221    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36\": container with ID starting with 403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36 not found: ID does not exist" containerID="403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36"
Jul 17 06:29:41.286291 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.286248    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36"} err="failed to get container status \"403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36\": rpc error: code = NotFound desc = could not find container \"403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36\": container with ID starting with 403b5b2759199b8da63e4a608788b0c3f80d3b4fed9df85525684c940bdb2a36 not found: ID does not exist"
Jul 17 06:29:41.286291 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.286264    2559 scope.go:117] "RemoveContainer" containerID="3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6"
Jul 17 06:29:41.286480 ip-10-0-128-37 kubenswrapper[2559]: E0717 06:29:41.286466    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6\": container with ID starting with 3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6 not found: ID does not exist" containerID="3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6"
Jul 17 06:29:41.286524 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.286483    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6"} err="failed to get container status \"3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6\": rpc error: code = NotFound desc = could not find container \"3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6\": container with ID starting with 3a27c20c5bf447d40febad25aefe31fd692a9d2fe1c362343cf08f685bcfcaa6 not found: ID does not exist"
Jul 17 06:29:41.291829 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.291807    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"]
Jul 17 06:29:41.296161 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.296139    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-efbd92-openshift-default-6c5c44766c-kkkmk"]
Jul 17 06:29:41.324314 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.324288    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" path="/var/lib/kubelet/pods/fdf75741-a395-494f-bd8b-8ee1eeae582f/volumes"
Jul 17 06:29:41.357758 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.357722    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-data\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.357758 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.357753    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-envoy\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.357758 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.357762    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf75741-a395-494f-bd8b-8ee1eeae582f-istiod-ca-cert\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.357953 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.357772    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf75741-a395-494f-bd8b-8ee1eeae582f-workload-socket\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.357953 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.357779    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-token\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.357953 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.357788    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf75741-a395-494f-bd8b-8ee1eeae582f-istio-podinfo\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.357953 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.357796    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qbl5\" (UniqueName: \"kubernetes.io/projected/fdf75741-a395-494f-bd8b-8ee1eeae582f-kube-api-access-6qbl5\") on node \"ip-10-0-128-37.ec2.internal\" DevicePath \"\""
Jul 17 06:29:41.990141 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:41.990121    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-84ttf_45813893-dd1c-42a4-a350-ffb044f3d45f/manager/0.log"
Jul 17 06:29:42.127624 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:42.127590    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9t6sb_9239ed6b-953f-445b-9e10-f77d6dc73be8/manager/0.log"
Jul 17 06:29:42.369283 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:42.369259    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4l7br_5958dbc5-f465-416c-b096-868621218b09/server/0.log"
Jul 17 06:29:42.491709 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:42.491677    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6m5pc_83df0755-9289-48d7-9b50-ab2b63b6dc95/manager/0.log"
Jul 17 06:29:42.732250 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:42.732165    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-rn4bn_97936e50-b1a3-49e6-a534-52a99c7cecfa/manager/0.log"
Jul 17 06:29:42.737902 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:42.737880    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-rn4bn_97936e50-b1a3-49e6-a534-52a99c7cecfa/copy-manifests/0.log"
Jul 17 06:29:43.272518 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:43.272486    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d6d9dd47b-s29nk_2d5230b5-f55a-426b-a977-e10ae169411e/maas-api/0.log"
Jul 17 06:29:44.764050 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:44.764017    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cj6bg_d1bbeda8-2c0d-40c0-8d51-2a609d297667/postgres/0.log"
Jul 17 06:29:46.097051 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:46.097021    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65cf699f86-ndt5s_53f59a22-f577-41a7-b7c0-65058d47b613/authorino/0.log"
Jul 17 06:29:46.223856 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:46.223826    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kslt4_a666c0ad-5e26-46c7-90f0-f8af79603ad3/manager/0.log"
Jul 17 06:29:46.343706 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:46.343671    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dm6h5_574cd401-7aa1-4d41-b463-dcacc16e5e15/manager/0.log"
Jul 17 06:29:46.591656 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:46.591624    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vpkh_302d1ba0-4bff-4c28-b4cd-ac271a24e254/registry-server/0.log"
Jul 17 06:29:46.967815 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:46.967714    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tlprh_3b6ee091-f7d2-4706-8246-40d3eca922c8/manager/0.log"
Jul 17 06:29:47.335791 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:47.335752    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n69bx_270b2f72-a236-42e5-9c9b-2cb58d952317/istio-proxy/0.log"
Jul 17 06:29:47.570593 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:47.570563    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f645db4-6d879_5bed2dfe-2036-4c3f-9abd-cd701858d6ae/kube-auth-proxy/0.log"
Jul 17 06:29:47.814377 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:47.814340    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nzjms_216d117f-cbc9-437b-a3ca-382748a4994e/istio-proxy/1.log"
Jul 17 06:29:47.937594 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:47.937554    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qzclq_469f8e54-8905-4476-adb0-55df63351219/payload-pre-processing/0.log"
Jul 17 06:29:48.063267 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:48.063227    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5xhml_ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16/payload-processing/0.log"
Jul 17 06:29:48.184739 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:48.184662    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-999d548-ds5gd_8c95ac39-9776-4d2e-9fd6-f605c6968bf1/router/0.log"
Jul 17 06:29:48.867901 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:48.867855    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db9lk8v_3000844f-7011-472d-b5b4-8959aef4a4b8/main/0.log"
Jul 17 06:29:49.091270 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:49.091231    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-w9vjr_1a6a1204-39a6-4994-aa09-f0fc52b15b4d/main/0.log"
Jul 17 06:29:54.474229 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474138    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6jcf/must-gather-6ggxk"]
Jul 17 06:29:54.474771 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474736    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy"
Jul 17 06:29:54.474771 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474757    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy"
Jul 17 06:29:54.474936 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474777    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy"
Jul 17 06:29:54.474936 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474785    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy"
Jul 17 06:29:54.474936 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474814    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f34fb6a-b914-48f3-bc7a-db2acade68ea" containerName="main"
Jul 17 06:29:54.474936 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474824    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f34fb6a-b914-48f3-bc7a-db2acade68ea" containerName="main"
Jul 17 06:29:54.474936 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474932    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474947    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474957    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474967    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.474976    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f34fb6a-b914-48f3-bc7a-db2acade68ea" containerName="main"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.475063    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.475073    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6c7356-da98-4bff-bd6b-8621efc040f5" containerName="istio-proxy"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.475111    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy"
Jul 17 06:29:54.475212 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.475120    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf75741-a395-494f-bd8b-8ee1eeae582f" containerName="istio-proxy"
Jul 17 06:29:54.480030 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.480008    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.482812 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.482791    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6jcf\"/\"kube-root-ca.crt\""
Jul 17 06:29:54.482944 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.482857    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6jcf\"/\"openshift-service-ca.crt\""
Jul 17 06:29:54.484051 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.484034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6jcf\"/\"default-dockercfg-jcjq2\""
Jul 17 06:29:54.488328 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.488309    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6jcf/must-gather-6ggxk"]
Jul 17 06:29:54.575173 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.575138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/234b6287-2261-4503-92f8-6dbf294b7898-must-gather-output\") pod \"must-gather-6ggxk\" (UID: \"234b6287-2261-4503-92f8-6dbf294b7898\") " pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.575331 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.575194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j26m\" (UniqueName: \"kubernetes.io/projected/234b6287-2261-4503-92f8-6dbf294b7898-kube-api-access-9j26m\") pod \"must-gather-6ggxk\" (UID: \"234b6287-2261-4503-92f8-6dbf294b7898\") " pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.675624 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.675590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/234b6287-2261-4503-92f8-6dbf294b7898-must-gather-output\") pod \"must-gather-6ggxk\" (UID: \"234b6287-2261-4503-92f8-6dbf294b7898\") " pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.675810 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.675643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j26m\" (UniqueName: \"kubernetes.io/projected/234b6287-2261-4503-92f8-6dbf294b7898-kube-api-access-9j26m\") pod \"must-gather-6ggxk\" (UID: \"234b6287-2261-4503-92f8-6dbf294b7898\") " pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.676031 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.676009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/234b6287-2261-4503-92f8-6dbf294b7898-must-gather-output\") pod \"must-gather-6ggxk\" (UID: \"234b6287-2261-4503-92f8-6dbf294b7898\") " pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.684063 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.684039    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j26m\" (UniqueName: \"kubernetes.io/projected/234b6287-2261-4503-92f8-6dbf294b7898-kube-api-access-9j26m\") pod \"must-gather-6ggxk\" (UID: \"234b6287-2261-4503-92f8-6dbf294b7898\") " pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.790942 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.790815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6jcf/must-gather-6ggxk"
Jul 17 06:29:54.943856 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.943789    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6jcf/must-gather-6ggxk"]
Jul 17 06:29:54.947433 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:29:54.947406    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod234b6287_2261_4503_92f8_6dbf294b7898.slice/crio-fac5774022e5a9f089b5bc38977de58caf164e90c5e851fea49fb17516c88c58 WatchSource:0}: Error finding container fac5774022e5a9f089b5bc38977de58caf164e90c5e851fea49fb17516c88c58: Status 404 returned error can't find the container with id fac5774022e5a9f089b5bc38977de58caf164e90c5e851fea49fb17516c88c58
Jul 17 06:29:54.949683 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:54.949658    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 06:29:55.332998 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:55.332967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6jcf/must-gather-6ggxk" event={"ID":"234b6287-2261-4503-92f8-6dbf294b7898","Type":"ContainerStarted","Data":"fac5774022e5a9f089b5bc38977de58caf164e90c5e851fea49fb17516c88c58"}
Jul 17 06:29:56.343579 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:56.342745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6jcf/must-gather-6ggxk" event={"ID":"234b6287-2261-4503-92f8-6dbf294b7898","Type":"ContainerStarted","Data":"9db1cef446b24dd4a859d3429cf57f60d0f0b7e5197e2313282fdda7ee13258e"}
Jul 17 06:29:56.343579 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:56.342800    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6jcf/must-gather-6ggxk" event={"ID":"234b6287-2261-4503-92f8-6dbf294b7898","Type":"ContainerStarted","Data":"4610f31434774f7b3e11fcabf62488ac9a390ad50824dab109a8ce4fba643955"}
Jul 17 06:29:56.362295 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:56.362222    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6jcf/must-gather-6ggxk" podStartSLOduration=1.540160002 podStartE2EDuration="2.362202646s" totalImagesPullingTime="822.042644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 06:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:29:56.359190222 +0000 UTC m=+3419.534591613" watchObservedRunningTime="2026-07-17 06:29:56.362202646 +0000 UTC m=+3419.537604037"
Jul 17 06:29:57.356904 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:57.356848    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hhp4p_5ee7f2dc-b515-4443-923d-edb1d64e60a9/global-pull-secret-syncer/0.log"
Jul 17 06:29:57.522167 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:57.522131    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zt787_d2f05b64-72be-45d5-be32-1e7134069982/konnectivity-agent/0.log"
Jul 17 06:29:57.569198 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:29:57.569167    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-37.ec2.internal_98d72d9d45ac482575befdda6714665b/haproxy/0.log"
Jul 17 06:30:02.352894 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:02.349371    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65cf699f86-ndt5s_53f59a22-f577-41a7-b7c0-65058d47b613/authorino/0.log"
Jul 17 06:30:02.386642 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:02.386608    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kslt4_a666c0ad-5e26-46c7-90f0-f8af79603ad3/manager/0.log"
Jul 17 06:30:02.410643 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:02.410601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dm6h5_574cd401-7aa1-4d41-b463-dcacc16e5e15/manager/0.log"
Jul 17 06:30:02.502252 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:02.502218    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vpkh_302d1ba0-4bff-4c28-b4cd-ac271a24e254/registry-server/0.log"
Jul 17 06:30:02.700190 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:02.700111    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tlprh_3b6ee091-f7d2-4706-8246-40d3eca922c8/manager/0.log"
Jul 17 06:30:04.556489 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:04.556451    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8ph7z_e0734f07-d4a1-4b18-ad79-7095148f7d53/kube-state-metrics/0.log"
Jul 17 06:30:04.579009 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:04.578975    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8ph7z_e0734f07-d4a1-4b18-ad79-7095148f7d53/kube-rbac-proxy-main/0.log"
Jul 17 06:30:04.598159 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:04.598124    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8ph7z_e0734f07-d4a1-4b18-ad79-7095148f7d53/kube-rbac-proxy-self/0.log"
Jul 17 06:30:04.774317 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:04.774275    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtrfw_94049aed-9ae3-4b0d-a0ec-51db3526fb51/node-exporter/0.log"
Jul 17 06:30:04.808377 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:04.808262    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtrfw_94049aed-9ae3-4b0d-a0ec-51db3526fb51/kube-rbac-proxy/0.log"
Jul 17 06:30:04.838727 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:04.838699    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtrfw_94049aed-9ae3-4b0d-a0ec-51db3526fb51/init-textfile/0.log"
Jul 17 06:30:07.479787 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:07.479748    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/2.log"
Jul 17 06:30:07.487533 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:07.487504    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xkx2c_6f7a8c66-33dc-43b1-ac92-a195b436d925/console-operator/3.log"
Jul 17 06:30:08.025146 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.025109    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-564b5cdc49-j7b2m_f8dddc16-2358-46d4-842f-f894d9131c27/console/0.log"
Jul 17 06:30:08.074729 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.074689    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"]
Jul 17 06:30:08.079916 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.079890    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.089393 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.089363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"]
Jul 17 06:30:08.150658 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.150617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-podres\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.151084 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.151059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-lib-modules\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.151253 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.151238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-proc\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.151387 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.151372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4dv\" (UniqueName: \"kubernetes.io/projected/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-kube-api-access-vv4dv\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.151528 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.151513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-sys\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253058 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-sys\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253230 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-podres\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253230 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-sys\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253230 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-lib-modules\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253230 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-proc\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253436 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253261    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-podres\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253436 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4dv\" (UniqueName: \"kubernetes.io/projected/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-kube-api-access-vv4dv\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253436 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-proc\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.253436 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.253367    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-lib-modules\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.262295 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.262259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4dv\" (UniqueName: \"kubernetes.io/projected/fc5d1ead-d875-499c-a60a-32a92a6d6ed1-kube-api-access-vv4dv\") pod \"perf-node-gather-daemonset-vxs5d\" (UID: \"fc5d1ead-d875-499c-a60a-32a92a6d6ed1\") " pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.397223 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.397177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:08.574991 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:08.574941    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"]
Jul 17 06:30:08.578245 ip-10-0-128-37 kubenswrapper[2559]: W0717 06:30:08.578211    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc5d1ead_d875_499c_a60a_32a92a6d6ed1.slice/crio-1d70ce788a205a20d7bc2d4ddfb2f3eabd3c2f161bca412753b795d7604395fc WatchSource:0}: Error finding container 1d70ce788a205a20d7bc2d4ddfb2f3eabd3c2f161bca412753b795d7604395fc: Status 404 returned error can't find the container with id 1d70ce788a205a20d7bc2d4ddfb2f3eabd3c2f161bca412753b795d7604395fc
Jul 17 06:30:09.437577 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:09.437541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d" event={"ID":"fc5d1ead-d875-499c-a60a-32a92a6d6ed1","Type":"ContainerStarted","Data":"f9fa0e042c2255859c5190bef117086c1a3896d1afd2a126f8a528063d0a2107"}
Jul 17 06:30:09.437755 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:09.437602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d" event={"ID":"fc5d1ead-d875-499c-a60a-32a92a6d6ed1","Type":"ContainerStarted","Data":"1d70ce788a205a20d7bc2d4ddfb2f3eabd3c2f161bca412753b795d7604395fc"}
Jul 17 06:30:09.437755 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:09.437634    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:09.452786 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:09.452731    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d" podStartSLOduration=1.452709283 podStartE2EDuration="1.452709283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 06:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 06:30:09.452606833 +0000 UTC m=+3432.628008222" watchObservedRunningTime="2026-07-17 06:30:09.452709283 +0000 UTC m=+3432.628110673"
Jul 17 06:30:09.692969 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:09.692856    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zkxm_b0b8d226-7352-4df1-a5f3-715ee151d5f7/dns/0.log"
Jul 17 06:30:09.709976 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:09.709941    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zkxm_b0b8d226-7352-4df1-a5f3-715ee151d5f7/kube-rbac-proxy/0.log"
Jul 17 06:30:09.827072 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:09.827043    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjr76_f444dc08-a6cc-404b-95c1-cfaab0130659/dns-node-resolver/0.log"
Jul 17 06:30:10.411948 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:10.411920    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ggq6n_ee44366a-3dc2-42a0-81b8-7a8b0dbac2fe/node-ca/0.log"
Jul 17 06:30:11.312935 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:11.312905    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n69bx_270b2f72-a236-42e5-9c9b-2cb58d952317/istio-proxy/0.log"
Jul 17 06:30:11.448124 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:11.448093    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f645db4-6d879_5bed2dfe-2036-4c3f-9abd-cd701858d6ae/kube-auth-proxy/0.log"
Jul 17 06:30:11.500651 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:11.500625    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nzjms_216d117f-cbc9-437b-a3ca-382748a4994e/istio-proxy/0.log"
Jul 17 06:30:11.569939 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:11.569531    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nzjms_216d117f-cbc9-437b-a3ca-382748a4994e/istio-proxy/1.log"
Jul 17 06:30:11.607161 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:11.605342    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qzclq_469f8e54-8905-4476-adb0-55df63351219/payload-pre-processing/0.log"
Jul 17 06:30:11.647841 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:11.647808    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5xhml_ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16/payload-processing/0.log"
Jul 17 06:30:11.668814 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:11.668741    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-999d548-ds5gd_8c95ac39-9776-4d2e-9fd6-f605c6968bf1/router/0.log"
Jul 17 06:30:12.317623 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:12.317587    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gjlv_858ebc79-e49c-48c2-9987-d078ad1cc57c/serve-healthcheck-canary/0.log"
Jul 17 06:30:12.854619 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:12.854581    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hfz44_c32e9683-e7dd-4dbc-9376-23730806bffe/kube-rbac-proxy/0.log"
Jul 17 06:30:12.871896 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:12.871856    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hfz44_c32e9683-e7dd-4dbc-9376-23730806bffe/exporter/0.log"
Jul 17 06:30:12.894184 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:12.894156    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hfz44_c32e9683-e7dd-4dbc-9376-23730806bffe/extractor/0.log"
Jul 17 06:30:15.198131 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:15.198093    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-84ttf_45813893-dd1c-42a4-a350-ffb044f3d45f/manager/0.log"
Jul 17 06:30:15.456440 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:15.456369    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9t6sb_9239ed6b-953f-445b-9e10-f77d6dc73be8/manager/0.log"
Jul 17 06:30:15.456440 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:15.456419    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6jcf/perf-node-gather-daemonset-vxs5d"
Jul 17 06:30:15.569026 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:15.568997    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4l7br_5958dbc5-f465-416c-b096-868621218b09/server/0.log"
Jul 17 06:30:15.679707 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:15.679676    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6m5pc_83df0755-9289-48d7-9b50-ab2b63b6dc95/manager/0.log"
Jul 17 06:30:15.747951 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:15.747841    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-rn4bn_97936e50-b1a3-49e6-a534-52a99c7cecfa/manager/0.log"
Jul 17 06:30:15.764636 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:15.764607    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d7869b5-rn4bn_97936e50-b1a3-49e6-a534-52a99c7cecfa/copy-manifests/0.log"
Jul 17 06:30:17.793961 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:17.793860    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n69bx_270b2f72-a236-42e5-9c9b-2cb58d952317/istio-proxy/0.log"
Jul 17 06:30:17.910396 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:17.910359    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f645db4-6d879_5bed2dfe-2036-4c3f-9abd-cd701858d6ae/kube-auth-proxy/0.log"
Jul 17 06:30:17.959010 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:17.958920    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nzjms_216d117f-cbc9-437b-a3ca-382748a4994e/istio-proxy/0.log"
Jul 17 06:30:18.033335 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:18.033301    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nzjms_216d117f-cbc9-437b-a3ca-382748a4994e/istio-proxy/1.log"
Jul 17 06:30:18.071756 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:18.071650    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qzclq_469f8e54-8905-4476-adb0-55df63351219/payload-pre-processing/0.log"
Jul 17 06:30:18.103819 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:18.103789    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5xhml_ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16/payload-processing/0.log"
Jul 17 06:30:18.120116 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:18.120078    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-999d548-ds5gd_8c95ac39-9776-4d2e-9fd6-f605c6968bf1/router/0.log"
Jul 17 06:30:19.254426 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:19.254389    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n69bx_270b2f72-a236-42e5-9c9b-2cb58d952317/istio-proxy/0.log"
Jul 17 06:30:19.381110 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:19.381074    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f645db4-6d879_5bed2dfe-2036-4c3f-9abd-cd701858d6ae/kube-auth-proxy/0.log"
Jul 17 06:30:19.417243 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:19.417211    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nzjms_216d117f-cbc9-437b-a3ca-382748a4994e/istio-proxy/0.log"
Jul 17 06:30:19.476530 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:19.476495    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nzjms_216d117f-cbc9-437b-a3ca-382748a4994e/istio-proxy/1.log"
Jul 17 06:30:19.502819 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:19.502736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qzclq_469f8e54-8905-4476-adb0-55df63351219/payload-pre-processing/0.log"
Jul 17 06:30:19.530138 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:19.530067    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5xhml_ad3d2ea1-186c-4dfa-bc0b-8a3207d53a16/payload-processing/0.log"
Jul 17 06:30:19.550178 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:19.550152    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-999d548-ds5gd_8c95ac39-9776-4d2e-9fd6-f605c6968bf1/router/0.log"
Jul 17 06:30:22.710156 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:22.710121    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9x7k9_970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc/kube-storage-version-migrator-operator/1.log"
Jul 17 06:30:22.711971 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:22.711943    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9x7k9_970ad0c6-b7a0-4adb-ba9d-4593a5eb81cc/kube-storage-version-migrator-operator/0.log"
Jul 17 06:30:23.938660 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:23.938631    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxkd2_8d92e4ea-3d22-4a60-ac6d-1bcf46784842/kube-multus-additional-cni-plugins/0.log"
Jul 17 06:30:23.957524 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:23.957439    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxkd2_8d92e4ea-3d22-4a60-ac6d-1bcf46784842/egress-router-binary-copy/0.log"
Jul 17 06:30:23.973884 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:23.973841    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxkd2_8d92e4ea-3d22-4a60-ac6d-1bcf46784842/cni-plugins/0.log"
Jul 17 06:30:23.992841 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:23.992813    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxkd2_8d92e4ea-3d22-4a60-ac6d-1bcf46784842/bond-cni-plugin/0.log"
Jul 17 06:30:24.011805 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:24.011781    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxkd2_8d92e4ea-3d22-4a60-ac6d-1bcf46784842/routeoverride-cni/0.log"
Jul 17 06:30:24.030857 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:24.030827    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxkd2_8d92e4ea-3d22-4a60-ac6d-1bcf46784842/whereabouts-cni-bincopy/0.log"
Jul 17 06:30:24.051425 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:24.051404    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sxkd2_8d92e4ea-3d22-4a60-ac6d-1bcf46784842/whereabouts-cni/0.log"
Jul 17 06:30:24.192939 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:24.192844    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mhjxz_c72a1140-528a-48eb-b3c6-5e4eac4c5a9d/kube-multus/0.log"
Jul 17 06:30:24.333946 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:24.333913    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rzfdl_718090ad-0b69-4d76-bcf4-4697ef0f81f7/network-metrics-daemon/0.log"
Jul 17 06:30:24.346589 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:24.346560    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rzfdl_718090ad-0b69-4d76-bcf4-4697ef0f81f7/kube-rbac-proxy/0.log"
Jul 17 06:30:25.426153 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:25.426114    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkn9n_058e5b3f-02a2-4af0-b5ea-66bc043c4c9d/ovn-controller/0.log"
Jul 17 06:30:25.441632 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:25.441605    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkn9n_058e5b3f-02a2-4af0-b5ea-66bc043c4c9d/ovn-acl-logging/0.log"
Jul 17 06:30:25.467132 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:25.467096    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkn9n_058e5b3f-02a2-4af0-b5ea-66bc043c4c9d/kube-rbac-proxy-node/0.log"
Jul 17 06:30:25.484294 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:25.484263    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkn9n_058e5b3f-02a2-4af0-b5ea-66bc043c4c9d/kube-rbac-proxy-ovn-metrics/0.log"
Jul 17 06:30:25.501942 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:25.501911    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkn9n_058e5b3f-02a2-4af0-b5ea-66bc043c4c9d/northd/0.log"
Jul 17 06:30:25.519499 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:25.519472    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkn9n_058e5b3f-02a2-4af0-b5ea-66bc043c4c9d/nbdb/0.log"
Jul 17 06:30:25.537235 ip-10-0-128-37 kubenswrapper[2559]: I0717 06:30:25.537210    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fkn9n_058e5b3f-02a2-4af0-b5ea-66bc043c4c9d/sbdb/0.log"