Sep 17 21:41:04.730646 ip-10-0-138-7 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 21:41:05.223320 ip-10-0-138-7 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 21:41:05.223320 ip-10-0-138-7 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 21:41:05.223320 ip-10-0-138-7 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 21:41:05.223320 ip-10-0-138-7 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 21:41:05.223320 ip-10-0-138-7 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 21:41:05.225710 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.225625    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 21:41:05.229539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229522    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:41:05.229539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229540    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229543    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229547    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229550    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229552    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229556    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229559    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229562    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229565    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229567    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229570    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229572    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229575    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229578    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229580    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229583    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229585    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229589    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229592    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:41:05.229610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229595    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229598    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229601    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229603    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229606    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229608    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229613    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229617    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229620    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229623    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229626    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229629    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229631    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229635    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229638    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229641    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229643    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229646    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229686    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:41:05.230055 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229690    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229693    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229696    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229699    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229702    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229704    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229707    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229709    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229711    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229714    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229716    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229719    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229721    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229724    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229726    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229730    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229733    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229736    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229738    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229741    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:41:05.230551 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229743    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229746    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229748    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229751    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229753    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229755    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229758    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229760    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229762    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229765    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229767    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229770    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229773    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229776    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229778    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229781    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229784    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229786    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229788    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229791    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:41:05.231049 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229793    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229796    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229798    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229801    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229803    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229807    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229811    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229815    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229819    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229822    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229825    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229827    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229829    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229832    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229835    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229837    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229840    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229842    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229845    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:41:05.231539 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.229847    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230577    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230585    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230588    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230591    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230593    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230597    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230599    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230602    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230604    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230607    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230609    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230612    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230615    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230617    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230621    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230623    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230626    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230628    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:41:05.231997 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230631    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230636    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230640    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230644    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230646    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230649    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230652    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230654    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230657    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230659    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230662    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230664    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230667    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230669    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230672    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230674    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230677    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230680    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230684    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:41:05.232512 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230687    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230691    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230694    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230697    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230699    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230702    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230704    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230707    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230709    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230711    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230714    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230717    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230719    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230722    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230726    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230728    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230731    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230733    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230736    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230738    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:41:05.232992 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230741    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230743    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230746    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230748    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230751    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230753    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230756    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230758    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230760    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230763    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230765    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230768    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230770    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230772    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230775    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230778    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230781    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230783    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230786    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230788    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:41:05.233495 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230791    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230793    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230796    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230799    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230801    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230804    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230807    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230809    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230812    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230815    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230817    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230820    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230824    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230827    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230830    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230832    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230835    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230837    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230840    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230842    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:41:05.233998 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230845    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.230847    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231227    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231232    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231234    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231237    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231245    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231248    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231251    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231253    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231256    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231259    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231261    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231264    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231267    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231269    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231272    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231274    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231277    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231280    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:41:05.234522 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231282    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231285    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231287    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231290    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231293    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231295    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231297    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231318    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231322    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231326    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231329    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231332    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231335    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231338    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231340    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231343    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231346    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231350    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231353    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:41:05.234996 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231356    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231359    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231363    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231365    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231369    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231372    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231379    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231382    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231385    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231388    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231391    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231393    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231396    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231398    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231401    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231403    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231406    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231408    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231411    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:41:05.235465 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231414    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231417    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231421    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231423    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231425    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231428    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231430    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231433    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231435    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231437    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231440    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231442    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231445    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231447    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231450    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231454    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231457    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231459    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231461    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231466    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:41:05.235924 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231468    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231471    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231473    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231475    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231478    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231481    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231483    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231485    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231488    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231490    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231493    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231495    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231500    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231502    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231505    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231507    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231510    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231512    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231515    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:41:05.236407 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231517    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231520    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.231522    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231607    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231653    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231661    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231665    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231671    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231675    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231679    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231683    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231688    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231691    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231695    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231698    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231701    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231704    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231707    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231710    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231712    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231715    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231719    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231722    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231725    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 21:41:05.236878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231728    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231731    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231735    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231738    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231741    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231744    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231747    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231750    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231753    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231756    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231759    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231763    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231766    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231769    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231771    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231776    2580 flags.go:64] FLAG: --enable-server="true"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231780    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231785    2580 flags.go:64] FLAG: --event-burst="100"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231788    2580 flags.go:64] FLAG: --event-qps="50"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231793    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231795    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231798    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231802    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231805    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231808    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 21:41:05.237499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231811    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231814    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231817    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231820    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231822    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231825    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231828    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231831    2580 flags.go:64] FLAG: --feature-gates=""
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231838    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231841    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231844    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231847    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231850    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231853    2580 flags.go:64] FLAG: --help="false"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231855    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231859    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231861    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231864    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231867    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231871    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231874    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231876    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231881    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 21:41:05.238117 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231883    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231887    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231891    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231895    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231898    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231901    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231904    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231907    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231909    2580 flags.go:64] FLAG: --lock-file=""
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231912    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231915    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231918    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231928    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231932    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231935    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231938    2580 flags.go:64] FLAG: --logging-format="text"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231941    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231944    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231947    2580 flags.go:64] FLAG: --manifest-url=""
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231950    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231954    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231957    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231961    2580 flags.go:64] FLAG: --max-pods="110"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231964    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231967    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 21:41:05.238836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231970    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231973    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231976    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231979    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231981    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231988    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231992    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231995    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.231998    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232003    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232009    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232013    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232016    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232019    2580 flags.go:64] FLAG: --port="10250"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232022    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232025    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e1a2b784f7c54ce3"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232028    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232030    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232034    2580 flags.go:64] FLAG: --register-node="true"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232036    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232040    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232043    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232046    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232048    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232052    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 21:41:05.239478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232055    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232058    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232060    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232063    2580 flags.go:64] FLAG: --runonce="false"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232066    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232069    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232071    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232074    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232077    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232080    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232083    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232085    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232088    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232092    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232094    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232097    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232100    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232103    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232106    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232112    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232115    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232118    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232121    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232124    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232126    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 21:41:05.240093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232129    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232132    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232136    2580 flags.go:64] FLAG: --v="2"
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232140    2580 flags.go:64] FLAG: --version="false"
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232143    2580 flags.go:64] FLAG: --vmodule=""
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232147    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232150    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232261    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232264    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232267    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232269    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232272    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232275    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232278    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232280    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232284    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232288    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232290    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232293    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232295    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232298    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:41:05.240713 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232314    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232317    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232320    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232322    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232326    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232329    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232331    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232335    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232337    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232339    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232342    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232345    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232347    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232350    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232353    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232355    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232358    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232360    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232363    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232365    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:41:05.241220 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232368    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232370    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232373    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232375    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232377    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232380    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232382    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232385    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232387    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232390    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232392    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232395    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232397    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232400    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232402    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232405    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232408    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232411    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232413    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232416    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:41:05.241722 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232418    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232421    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232423    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232425    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232428    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232430    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232433    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232435    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232438    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232440    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232442    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232445    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232448    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232450    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232452    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232455    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232458    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232460    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232463    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232465    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:41:05.242224 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232467    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232470    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232472    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232475    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232478    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232480    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232483    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232485    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232490    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232493    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232503    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232507    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232511    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232515    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232518    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232521    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232523    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232526    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232529    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:41:05.242787 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232531    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232534    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232537    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232541    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232544    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.232547    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.232552    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.239865    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.239881    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.240787    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.240795    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240852    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240857    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240861    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:41:05.243243 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240864    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240867    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240870    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240873    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240876    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240879    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240881    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240884    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240886    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240889    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240892    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240894    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240897    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240900    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240902    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240905    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240908    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240911    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240913    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240916    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:41:05.243732 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240918    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240921    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240925    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240929    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240932    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240934    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240939    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240942    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240945    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240948    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240951    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240953    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240956    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240959    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240962    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240964    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240967    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240969    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240972    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:41:05.244373 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240974    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240977    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240980    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240982    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240985    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240987    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240990    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240992    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240995    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.240998    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241001    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241004    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241007    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241009    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241011    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241014    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241016    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241018    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241021    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241024    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:41:05.244994 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241027    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241030    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241033    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241035    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241038    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241040    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241043    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241045    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241048    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241050    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241052    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241055    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241057    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241060    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241062    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241064    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241067    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241069    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241072    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241075    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:41:05.245517 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241078    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241080    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241083    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241085    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241089    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241092    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241096    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241099    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241101    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241104    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241106    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241109    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241112    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241115    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241118    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241122    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:41:05.246048 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241125    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.241130    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241242    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241248    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241250    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241253    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241256    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241258    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241261    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241263    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241266    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241269    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241273    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241276    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:41:05.246509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241279    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241282    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241285    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241288    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241290    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241293    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241295    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241298    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241316    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241319    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241321    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241324    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241326    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241329    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241331    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241334    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241337    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241340    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241343    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:41:05.246872 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241345    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241348    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241350    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241352    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241355    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241357    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241360    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241362    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241364    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241367    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241369    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241372    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241374    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241376    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241379    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241381    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241384    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241387    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241389    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241392    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:41:05.247349 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241394    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241396    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241399    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241401    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241404    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241406    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241409    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241411    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241414    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241417    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241420    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241422    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241425    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241427    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241430    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241432    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241434    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241438    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241441    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:41:05.247952 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241444    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241447    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241450    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241453    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241456    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241459    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241462    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241464    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241467    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241470    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241472    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241475    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241478    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241481    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241483    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241486    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241488    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241491    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241494    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241496    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:41:05.248608 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241499    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241502    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241504    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241507    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241510    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241512    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241514    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241517    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:05.241519    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.241524    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.241652    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 21:41:05.249136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.243777    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 21:41:05.250166 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.250149    2580 server.go:1019] "Starting client certificate rotation"
Sep 17 21:41:05.250271 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.250253    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 21:41:05.250381 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.250296    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 21:41:05.252957 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.252942    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 21:41:05.254064 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.254046    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 21:41:05.264259 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.264243    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 17 21:41:05.265838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.265824    2580 log.go:25] "Validated CRI v1 image API"
Sep 17 21:41:05.266608 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.266594    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 21:41:05.272178 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.272159    2580 fs.go:135] Filesystem UUIDs: map[137ec887-4808-4cc7-b6d0-9cb1750c05a3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f011521e-604e-40b1-9a86-315049638520:/dev/nvme0n1p3]
Sep 17 21:41:05.272256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.272178    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 21:41:05.278722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.278610    2580 manager.go:216] Machine: {Timestamp:2026-09-17 21:41:05.277258364 +0000 UTC m=+0.359175904 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096456 MemoryCapacity:32812146688 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec293fc67a022e17b824f79b6e8778df SystemUUID:ec293fc6-7a02-2e17-b824-f79b6e8778df BootID:f6c9d4a0-cc97-4caa-9040-71f6252b6952 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c5:ef:ac:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c5:ef:ac:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:4a:61:cf:4d:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812146688 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 21:41:05.278722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.278713    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 21:41:05.278845 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.278791    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 21:41:05.282363 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.282337    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 21:41:05.282456 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.282440    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 21:41:05.282560 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.282371    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 21:41:05.283180 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.283168    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 21:41:05.283232 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.283188    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 21:41:05.283232 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.283200    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 21:41:05.284806 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.284794    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 21:41:05.284899 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.284888    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 21:41:05.288689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.288674    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 21:41:05.288820 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.288809    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 21:41:05.288874 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.288848    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 21:41:05.288874 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.288862    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 21:41:05.288969 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.288877    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 21:41:05.288969 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.288892    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 17 21:41:05.288969 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.288907    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 21:41:05.289269 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.289255    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 21:41:05.289357 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.289280    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 21:41:05.293511 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.293479    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 21:41:05.295914 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.295901    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 21:41:05.295971 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.295931    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 21:41:05.297882 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297870    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 21:41:05.297926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297887    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 21:41:05.297926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297893    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 21:41:05.297926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297899    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 21:41:05.297926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297907    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 21:41:05.297926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297913    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 21:41:05.297926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297926    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 21:41:05.298100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297932    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 21:41:05.298100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297940    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 21:41:05.298100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297945    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 21:41:05.298100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297953    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 21:41:05.298100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.297958    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 21:41:05.298781 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.298770    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 21:41:05.298818 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.298781    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 21:41:05.302735 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.302721    2580 server.go:1268] "Started kubelet"
Sep 17 21:41:05.302866 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.302816    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 21:41:05.302959 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.302852    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 21:41:05.302959 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.302917    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 21:41:05.303697 ip-10-0-138-7 systemd[1]: Started Kubernetes Kubelet.
Sep 17 21:41:05.304213 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.304182    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 21:41:05.304529 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.304503    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 21:41:05.304606 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.304546    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 21:41:05.304843 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.304811    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 21:41:05.305401 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.305388    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 21:41:05.307296 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.307268    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 21:41:05.310638 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.310618    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 21:41:05.311340 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.311322    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 21:41:05.311494 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.311464    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:05.312022 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312004    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 21:41:05.312022 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312006    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 21:41:05.312166 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312031    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 21:41:05.312166 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312135    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 21:41:05.312166 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312144    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 21:41:05.312326 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312252    2580 factory.go:55] Registering systemd factory
Sep 17 21:41:05.312326 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312268    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 17 21:41:05.312499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312486    2580 factory.go:153] Registering CRI-O factory
Sep 17 21:41:05.312499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312499    2580 factory.go:223] Registration of the crio container factory successfully
Sep 17 21:41:05.312609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312544    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 21:41:05.312609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312559    2580 factory.go:103] Registering Raw factory
Sep 17 21:41:05.312609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312571    2580 manager.go:1196] Started watching for new ooms in manager
Sep 17 21:41:05.312879 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.312867    2580 manager.go:349] Starting recovery of all containers
Sep 17 21:41:05.312948 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.311800    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-7.ec2.internal.18d639a0ef89e25d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-7.ec2.internal,UID:ip-10-0-138-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-7.ec2.internal,},FirstTimestamp:2026-09-17 21:41:05.302692445 +0000 UTC m=+0.384609970,LastTimestamp:2026-09-17 21:41:05.302692445 +0000 UTC m=+0.384609970,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-7.ec2.internal,}"
Sep 17 21:41:05.320099 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.320064    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 21:41:05.320207 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.320186    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 21:41:05.323168 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.323018    2580 manager.go:354] Recovery completed
Sep 17 21:41:05.325371 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.325332    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 17 21:41:05.328291 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.328277    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:41:05.330169 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.330143    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:41:05.330236 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.330186    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:41:05.330236 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.330199    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:41:05.330787 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.330775    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 21:41:05.330787 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.330786    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:41:05.330850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.330788    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 21:41:05.330850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.330807    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 21:41:05.331479 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.331462    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:41:05.331530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.331492    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:41:05.331530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.331504    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:41:05.332108 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.332040    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-7.ec2.internal.18d639a0f12d2888  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-7.ec2.internal,UID:ip-10-0-138-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-7.ec2.internal,},FirstTimestamp:2026-09-17 21:41:05.330169992 +0000 UTC m=+0.412087524,LastTimestamp:2026-09-17 21:41:05.330169992 +0000 UTC m=+0.412087524,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-7.ec2.internal,}"
Sep 17 21:41:05.332806 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.332793    2580 policy_none.go:49] "None policy: Start"
Sep 17 21:41:05.332856 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.332811    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 21:41:05.332856 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.332821    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 21:41:05.334697 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.334685    2580 policy_none.go:47] "Start"
Sep 17 21:41:05.344321 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.344236    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-7.ec2.internal.18d639a0f12d8313  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-7.ec2.internal,UID:ip-10-0-138-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-7.ec2.internal,},FirstTimestamp:2026-09-17 21:41:05.330193171 +0000 UTC m=+0.412110695,LastTimestamp:2026-09-17 21:41:05.330193171 +0000 UTC m=+0.412110695,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-7.ec2.internal,}"
Sep 17 21:41:05.349399 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.349383    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2fgh7"
Sep 17 21:41:05.356574 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.356509    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-7.ec2.internal.18d639a0f12da7e2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-7.ec2.internal,UID:ip-10-0-138-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-7.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-7.ec2.internal,},FirstTimestamp:2026-09-17 21:41:05.330202594 +0000 UTC m=+0.412120119,LastTimestamp:2026-09-17 21:41:05.330202594 +0000 UTC m=+0.412120119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-7.ec2.internal,}"
Sep 17 21:41:05.358626 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.358608    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2fgh7"
Sep 17 21:41:05.380877 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.380862    2580 manager.go:337] "Starting Device Plugin manager"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.380904    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.380914    2580 server.go:87] "Starting device plugin registration server"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.381226    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.381238    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.381375    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.381452    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.381460    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.382003    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 21:41:05.395838 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.382052    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:05.455902 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.455870    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 21:41:05.457259 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.457239    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 21:41:05.457391 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.457289    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 21:41:05.457391 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.457330    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 21:41:05.457487 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.457430    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 21:41:05.459627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.459604    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:41:05.481529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.481511    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:41:05.482388 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.482373    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:41:05.482476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.482406    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:41:05.482476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.482420    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:41:05.482476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.482448    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.493279 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.493262    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.493354 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.493282    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-7.ec2.internal\": node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:05.526250 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.526226    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:05.558440 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.558416    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"]
Sep 17 21:41:05.558530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.558481    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:41:05.560203 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.560188    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:41:05.560323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.560220    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:41:05.560323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.560236    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:41:05.562373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.562359    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:41:05.562511 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.562498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.562561 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.562524    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:41:05.563055 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.563043    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:41:05.563101 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.563067    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:41:05.563101 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.563074    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:41:05.563101 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.563085    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:41:05.563212 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.563085    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:41:05.563245 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.563227    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:41:05.565091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.565078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.565157 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.565101    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:41:05.565794 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.565775    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:41:05.565865 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.565807    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:41:05.565865 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.565821    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:41:05.589948 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.589922    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-7.ec2.internal\" not found" node="ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.594185 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.594169    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-7.ec2.internal\" not found" node="ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.614237 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.614216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.614320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.614240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.614320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.614259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/638288756fad3699123da181b4a12476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-7.ec2.internal\" (UID: \"638288756fad3699123da181b4a12476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.627107 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.627085    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:05.715063 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.714972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.715063 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.715005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.715063 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.715020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/638288756fad3699123da181b4a12476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-7.ec2.internal\" (UID: \"638288756fad3699123da181b4a12476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.715063 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.715066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/638288756fad3699123da181b4a12476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-7.ec2.internal\" (UID: \"638288756fad3699123da181b4a12476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.715340 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.715088    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.715340 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.715111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b445265b170965646453a6817cb35d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal\" (UID: \"8b445265b170965646453a6817cb35d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.728099 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.728076    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:05.828597 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.828555    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:05.893780 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.893734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.897770 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:05.897750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:05.929202 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:05.929174    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:06.029738 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:06.029654    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:06.130215 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:06.130185    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:06.230728 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:06.230696    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-7.ec2.internal\" not found"
Sep 17 21:41:06.249876 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.249840    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 21:41:06.250022 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.249995    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 21:41:06.291549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.291483    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:41:06.294766 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.294749    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:41:06.311623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.311601    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 21:41:06.311623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.311609    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:06.322457 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.322441    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:41:06.322886 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.322872    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 21:41:06.323924 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.323913    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal"
Sep 17 21:41:06.326857 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.326840    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 21:41:06.338222 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.338199    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 21:41:06.354448 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.354425    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qv4sj"
Sep 17 21:41:06.363543 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.363507    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 21:36:06 +0000 UTC" deadline="2028-02-11 02:13:37.773748483 +0000 UTC"
Sep 17 21:41:06.363543 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.363541    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12268h32m31.410210797s"
Sep 17 21:41:06.365598 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.365582    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qv4sj"
Sep 17 21:41:06.517995 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:06.517956    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b445265b170965646453a6817cb35d0.slice/crio-b84261ff7f225d8b346d84584457d33b02444c4c4fb9faed21a7f14b01d5714d WatchSource:0}: Error finding container b84261ff7f225d8b346d84584457d33b02444c4c4fb9faed21a7f14b01d5714d: Status 404 returned error can't find the container with id b84261ff7f225d8b346d84584457d33b02444c4c4fb9faed21a7f14b01d5714d
Sep 17 21:41:06.518715 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:06.518694    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638288756fad3699123da181b4a12476.slice/crio-56a7eff1db38ff72fa2cfd3c211b0b22073e61f5fe6ffc6bc3d58a0a7acdb2a1 WatchSource:0}: Error finding container 56a7eff1db38ff72fa2cfd3c211b0b22073e61f5fe6ffc6bc3d58a0a7acdb2a1: Status 404 returned error can't find the container with id 56a7eff1db38ff72fa2cfd3c211b0b22073e61f5fe6ffc6bc3d58a0a7acdb2a1
Sep 17 21:41:06.523897 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:06.523877    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 21:41:08.849951 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.849861    2580 apiserver.go:52] "Watching apiserver"
Sep 17 21:41:08.859265 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.858344    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 21:41:08.859265 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.858875    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-6vtqc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal","openshift-multus/multus-additional-cni-plugins-mf8hp","openshift-multus/network-metrics-daemon-r7mr2","kube-system/konnectivity-agent-7jscq","openshift-cluster-node-tuning-operator/tuned-b2k8z","openshift-multus/multus-wktlp","openshift-network-diagnostics/network-check-target-8wzrt","openshift-network-operator/iptables-alerter-rbrcl","openshift-ovn-kubernetes/ovnkube-node-9dcq8","kube-system/global-pull-secret-syncer-vmmb9","kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc","openshift-dns/node-resolver-fc96h"]
Sep 17 21:41:08.862529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.861417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.865146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.864399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.865146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.864568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bpgs5\""
Sep 17 21:41:08.865146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.864875    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 21:41:08.865146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.865132    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 21:41:08.865396 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.865159    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 21:41:08.866275 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.866256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:08.866371 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:08.866353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:08.869070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.868262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 21:41:08.869070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.868646    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hn5gq\""
Sep 17 21:41:08.869070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.868692    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 21:41:08.869070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.868779    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 21:41:08.869070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.868651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 21:41:08.869070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.868899    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 21:41:08.869070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.868937    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:08.870576 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.870556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.872083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.871435    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 21:41:08.872083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.871704    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 21:41:08.872083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.871926    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4kz2f\""
Sep 17 21:41:08.873262 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.873242    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:41:08.873389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.873242    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j6cpg\""
Sep 17 21:41:08.873451 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.873440    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 21:41:08.873988 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.873972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.875115 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.875098    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:41:08.877083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.877062    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 21:41:08.877338 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.877319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xcdzn\""
Sep 17 21:41:08.877638 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.877620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:08.877731 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:08.877710    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:08.879563 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.879546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:08.882468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.882398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.882468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.882455    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 21:41:08.882676 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.882644    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 21:41:08.882858 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.882843    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9mql7\""
Sep 17 21:41:08.883053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:41:08.883308 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-hostroot\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.883387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsnfz\" (UniqueName: \"kubernetes.io/projected/204f844e-14fa-43ab-8665-c53539aa4965-kube-api-access-nsnfz\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.883387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.883387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:08.883533 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfnkz\" (UniqueName: \"kubernetes.io/projected/837d276f-336d-4a93-a1fc-60e128025b09-kube-api-access-gfnkz\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:08.883533 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-modprobe-d\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883533 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-conf-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.883533 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-kubernetes\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883533 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-lib-modules\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883533 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-tmp\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysctl-conf\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-sys\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-k8s-cni-cncf-io\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-netns\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-kubelet\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c3eb950-75a4-4355-9115-d2c7b4b850af-konnectivity-ca\") pod \"konnectivity-agent-7jscq\" (UID: \"2c3eb950-75a4-4355-9115-d2c7b4b850af\") " pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-systemd\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-run\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.883843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-system-cni-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.884256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39a60f66-fe68-4a15-a9b2-52634dbe9def-cni-binary-copy\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.884256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-daemon-config\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.884256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204f844e-14fa-43ab-8665-c53539aa4965-host\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.884256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.884256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88p9\" (UniqueName: \"kubernetes.io/projected/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-kube-api-access-z88p9\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.884256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.883985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-host\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.884581 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:08.884581 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:08.884318    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:08.884709 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-multus-certs\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.884709 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.884788 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c3eb950-75a4-4355-9115-d2c7b4b850af-agent-certs\") pod \"konnectivity-agent-7jscq\" (UID: \"2c3eb950-75a4-4355-9115-d2c7b4b850af\") " pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:08.884788 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysconfig\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.884788 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysctl-d\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.884904 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-tuned\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.884904 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sx49\" (UniqueName: \"kubernetes.io/projected/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-kube-api-access-2sx49\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.884904 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-socket-dir-parent\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.884904 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-cni-bin\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.884904 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-cni-multus\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db2rj\" (UniqueName: \"kubernetes.io/projected/39a60f66-fe68-4a15-a9b2-52634dbe9def-kube-api-access-db2rj\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cni-binary-copy\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-var-lib-kubelet\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.884979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-etc-kubernetes\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.885009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/204f844e-14fa-43ab-8665-c53539aa4965-serviceca\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.885035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-system-cni-dir\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.885059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cnibin\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.885083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-cni-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.885103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.885104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-cnibin\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.887796 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.887342    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 21:41:08.887994 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.887981    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 21:41:08.888449 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.888430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.888524 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.888500    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 21:41:08.890917 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.888996    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 21:41:08.890917 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.889119    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 21:41:08.890917 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.889749    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 21:41:08.890917 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.889903    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7j2c4\""
Sep 17 21:41:08.891428 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.891406    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 21:41:08.891988 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.891968    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n8xcc\""
Sep 17 21:41:08.892496 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.892479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 21:41:08.893136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.892622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:08.893330 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.893315    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 21:41:08.895307 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.895289    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 21:41:08.895985 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.895965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 21:41:08.896179 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.896164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k8cqt\""
Sep 17 21:41:08.929839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.929786    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 21:36:07 +0000 UTC" deadline="2028-06-22 00:37:46.916846996 +0000 UTC"
Sep 17 21:41:08.929839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.929839    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15434h56m37.987011514s"
Sep 17 21:41:08.974401 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.974377    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39a60f66-fe68-4a15-a9b2-52634dbe9def-cni-binary-copy\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-daemon-config\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88p9\" (UniqueName: \"kubernetes.io/projected/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-kube-api-access-z88p9\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-ovnkube-script-lib\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp4st\" (UniqueName: \"kubernetes.io/projected/a9b52476-6d75-4647-a250-c4e7d79449c6-kube-api-access-wp4st\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-etc-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-ovn\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysctl-d\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-tuned\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sx49\" (UniqueName: \"kubernetes.io/projected/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-kube-api-access-2sx49\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-kubelet\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-socket-dir-parent\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-cni-bin\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-cni-multus\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cni-binary-copy\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.987649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-host-slash\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e608f059-87f0-4200-b697-b41ce99eca5d-dbus\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-system-cni-dir\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-var-lib-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-cnibin\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-modprobe-d\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-systemd\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-cni-bin\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-env-overrides\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-registration-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysctl-d\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c038c15-9493-4572-b0ee-9554027db12f-ovn-node-metrics-cert\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.986990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e608f059-87f0-4200-b697-b41ce99eca5d-kubelet-config\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-k8s-cni-cncf-io\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.988555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-run\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-system-cni-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204f844e-14fa-43ab-8665-c53539aa4965-host\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-host\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-multus-certs\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c3eb950-75a4-4355-9115-d2c7b4b850af-agent-certs\") pod \"konnectivity-agent-7jscq\" (UID: \"2c3eb950-75a4-4355-9115-d2c7b4b850af\") " pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysconfig\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987355    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-slash\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db2rj\" (UniqueName: \"kubernetes.io/projected/39a60f66-fe68-4a15-a9b2-52634dbe9def-kube-api-access-db2rj\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-var-lib-kubelet\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-log-socket\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-cni-netd\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.989389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-iptables-alerter-script\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6517784b-d8d3-4498-804f-cd472685bdee-hosts-file\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-etc-kubernetes\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/204f844e-14fa-43ab-8665-c53539aa4965-serviceca\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cnibin\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-ovnkube-config\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-device-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-sys-fs\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srwh4\" (UniqueName: \"kubernetes.io/projected/6517784b-d8d3-4498-804f-cd472685bdee-kube-api-access-srwh4\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-cni-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-hostroot\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsnfz\" (UniqueName: \"kubernetes.io/projected/204f844e-14fa-43ab-8665-c53539aa4965-kube-api-access-nsnfz\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfnkz\" (UniqueName: \"kubernetes.io/projected/837d276f-336d-4a93-a1fc-60e128025b09-kube-api-access-gfnkz\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-tmp\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39a60f66-fe68-4a15-a9b2-52634dbe9def-cni-binary-copy\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.990231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-systemd-units\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.987978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-run-netns\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-conf-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-kubernetes\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-lib-modules\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-node-log\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzv9f\" (UniqueName: \"kubernetes.io/projected/0c038c15-9493-4572-b0ee-9554027db12f-kube-api-access-nzv9f\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-socket-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrkkt\" (UniqueName: \"kubernetes.io/projected/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-kube-api-access-xrkkt\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysctl-conf\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-sys\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6517784b-d8d3-4498-804f-cd472685bdee-tmp-dir\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-netns\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-kubelet\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c3eb950-75a4-4355-9115-d2c7b4b850af-konnectivity-ca\") pod \"konnectivity-agent-7jscq\" (UID: \"2c3eb950-75a4-4355-9115-d2c7b4b850af\") " pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-daemon-config\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-systemd\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-k8s-cni-cncf-io\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-run\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-socket-dir-parent\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-system-cni-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-cnibin\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/204f844e-14fa-43ab-8665-c53539aa4965-host\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:08.988882    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:08.988939    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:09.488919504 +0000 UTC m=+3.010484416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-modprobe-d\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-conf-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-kubernetes\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-lib-modules\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-host\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-hostroot\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-multus-certs\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.989518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.991896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysctl-conf\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-sysconfig\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-sys\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-run-netns\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-kubelet\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.988374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-systemd\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-cni-multus\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-var-lib-kubelet\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-etc-kubernetes\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c3eb950-75a4-4355-9115-d2c7b4b850af-konnectivity-ca\") pod \"konnectivity-agent-7jscq\" (UID: \"2c3eb950-75a4-4355-9115-d2c7b4b850af\") " pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-host-var-lib-cni-bin\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990913    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cnibin\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.990970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-system-cni-dir\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.991023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-cni-binary-copy\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.991089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/204f844e-14fa-43ab-8665-c53539aa4965-serviceca\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.991124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39a60f66-fe68-4a15-a9b2-52634dbe9def-multus-cni-dir\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.991230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-etc-tuned\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.992718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.992368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c3eb950-75a4-4355-9115-d2c7b4b850af-agent-certs\") pod \"konnectivity-agent-7jscq\" (UID: \"2c3eb950-75a4-4355-9115-d2c7b4b850af\") " pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:08.993358 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.992773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-tmp\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:08.995792 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:08.995675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sx49\" (UniqueName: \"kubernetes.io/projected/178e90cd-7a73-45ce-b6ab-a28b0b753ae3-kube-api-access-2sx49\") pod \"tuned-b2k8z\" (UID: \"178e90cd-7a73-45ce-b6ab-a28b0b753ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:09.000134 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.000107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsnfz\" (UniqueName: \"kubernetes.io/projected/204f844e-14fa-43ab-8665-c53539aa4965-kube-api-access-nsnfz\") pod \"node-ca-6vtqc\" (UID: \"204f844e-14fa-43ab-8665-c53539aa4965\") " pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:09.000239 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.000117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db2rj\" (UniqueName: \"kubernetes.io/projected/39a60f66-fe68-4a15-a9b2-52634dbe9def-kube-api-access-db2rj\") pod \"multus-wktlp\" (UID: \"39a60f66-fe68-4a15-a9b2-52634dbe9def\") " pod="openshift-multus/multus-wktlp"
Sep 17 21:41:09.000450 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.000429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88p9\" (UniqueName: \"kubernetes.io/projected/b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95-kube-api-access-z88p9\") pod \"multus-additional-cni-plugins-mf8hp\" (UID: \"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95\") " pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:09.000703 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.000684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfnkz\" (UniqueName: \"kubernetes.io/projected/837d276f-336d-4a93-a1fc-60e128025b09-kube-api-access-gfnkz\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:09.023056 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.023001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal" event={"ID":"638288756fad3699123da181b4a12476","Type":"ContainerStarted","Data":"56a7eff1db38ff72fa2cfd3c211b0b22073e61f5fe6ffc6bc3d58a0a7acdb2a1"}
Sep 17 21:41:09.024363 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.024336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" event={"ID":"8b445265b170965646453a6817cb35d0","Type":"ContainerStarted","Data":"b84261ff7f225d8b346d84584457d33b02444c4c4fb9faed21a7f14b01d5714d"}
Sep 17 21:41:09.091246 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-systemd-units\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-run-netns\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-node-log\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzv9f\" (UniqueName: \"kubernetes.io/projected/0c038c15-9493-4572-b0ee-9554027db12f-kube-api-access-nzv9f\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-systemd-units\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-socket-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-run-netns\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrkkt\" (UniqueName: \"kubernetes.io/projected/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-kube-api-access-xrkkt\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-node-log\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6517784b-d8d3-4498-804f-cd472685bdee-tmp-dir\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:09.091430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-ovnkube-script-lib\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp4st\" (UniqueName: \"kubernetes.io/projected/a9b52476-6d75-4647-a250-c4e7d79449c6-kube-api-access-wp4st\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-etc-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-ovn\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-kubelet\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-host-slash\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e608f059-87f0-4200-b697-b41ce99eca5d-dbus\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-var-lib-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-systemd\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-cni-bin\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-env-overrides\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-registration-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c038c15-9493-4572-b0ee-9554027db12f-ovn-node-metrics-cert\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.091979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e608f059-87f0-4200-b697-b41ce99eca5d-kubelet-config\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-socket-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6517784b-d8d3-4498-804f-cd472685bdee-tmp-dir\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e608f059-87f0-4200-b697-b41ce99eca5d-kubelet-config\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091979    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-var-lib-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.091990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-cni-bin\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-kubelet\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e608f059-87f0-4200-b697-b41ce99eca5d-dbus\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-host-slash\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.092064    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-systemd\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-ovn\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-etc-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.092139    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret podName:e608f059-87f0-4200-b697-b41ce99eca5d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:09.592119918 +0000 UTC m=+3.113684827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret") pod "global-pull-secret-syncer-vmmb9" (UID: "e608f059-87f0-4200-b697-b41ce99eca5d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092170    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-registration-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.092725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-slash\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-log-socket\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-env-overrides\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-ovnkube-script-lib\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-slash\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-log-socket\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-cni-netd\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-iptables-alerter-script\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6517784b-d8d3-4498-804f-cd472685bdee-hosts-file\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6517784b-d8d3-4498-804f-cd472685bdee-hosts-file\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-ovnkube-config\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-run-openvswitch\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-device-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.093335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c038c15-9493-4572-b0ee-9554027db12f-host-cni-netd\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.094003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-sys-fs\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.094003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-device-dir\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.094003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srwh4\" (UniqueName: \"kubernetes.io/projected/6517784b-d8d3-4498-804f-cd472685bdee-kube-api-access-srwh4\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:09.094003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9b52476-6d75-4647-a250-c4e7d79449c6-sys-fs\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.094003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-iptables-alerter-script\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:09.094003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.092912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c038c15-9493-4572-b0ee-9554027db12f-ovnkube-config\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.094757 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.094736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c038c15-9493-4572-b0ee-9554027db12f-ovn-node-metrics-cert\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.099764 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.099746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzv9f\" (UniqueName: \"kubernetes.io/projected/0c038c15-9493-4572-b0ee-9554027db12f-kube-api-access-nzv9f\") pod \"ovnkube-node-9dcq8\" (UID: \"0c038c15-9493-4572-b0ee-9554027db12f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.104347 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.104288    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:41:09.104347 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.104316    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:41:09.104347 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.104329    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5zkkj for pod openshift-network-diagnostics/network-check-target-8wzrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:09.104545 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.104404    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj podName:f9463e70-7329-4e4c-bc47-3c863e79aa19 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:09.604386482 +0000 UTC m=+3.125951407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5zkkj" (UniqueName: "kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj") pod "network-check-target-8wzrt" (UID: "f9463e70-7329-4e4c-bc47-3c863e79aa19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:09.106627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.106599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp4st\" (UniqueName: \"kubernetes.io/projected/a9b52476-6d75-4647-a250-c4e7d79449c6-kube-api-access-wp4st\") pod \"aws-ebs-csi-driver-node-5zfgc\" (UID: \"a9b52476-6d75-4647-a250-c4e7d79449c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.107434 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.107397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srwh4\" (UniqueName: \"kubernetes.io/projected/6517784b-d8d3-4498-804f-cd472685bdee-kube-api-access-srwh4\") pod \"node-resolver-fc96h\" (UID: \"6517784b-d8d3-4498-804f-cd472685bdee\") " pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:09.108061 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.108025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrkkt\" (UniqueName: \"kubernetes.io/projected/6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f-kube-api-access-xrkkt\") pod \"iptables-alerter-rbrcl\" (UID: \"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f\") " pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:09.177398 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.177366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6vtqc"
Sep 17 21:41:09.188102 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.188074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mf8hp"
Sep 17 21:41:09.199053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.199031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:09.205697 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.205677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b2k8z"
Sep 17 21:41:09.214288 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.214267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wktlp"
Sep 17 21:41:09.229024 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.228997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbrcl"
Sep 17 21:41:09.236910 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.236889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:09.244787 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.244765    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc"
Sep 17 21:41:09.252590 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.252552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fc96h"
Sep 17 21:41:09.495167 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.495083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:09.495292 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.495239    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:09.495329 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.495305    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:10.495291007 +0000 UTC m=+4.016855920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:09.596118 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.596078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:09.596324 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.596241    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:09.596324 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.596319    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret podName:e608f059-87f0-4200-b697-b41ce99eca5d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:10.596300297 +0000 UTC m=+4.117865224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret") pod "global-pull-secret-syncer-vmmb9" (UID: "e608f059-87f0-4200-b697-b41ce99eca5d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:09.696993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.696951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:09.697198 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.697151    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:41:09.697198 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.697177    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:41:09.697198 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.697190    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5zkkj for pod openshift-network-diagnostics/network-check-target-8wzrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:09.697366 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:09.697253    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj podName:f9463e70-7329-4e4c-bc47-3c863e79aa19 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:10.697236005 +0000 UTC m=+4.218800913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zkkj" (UniqueName: "kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj") pod "network-check-target-8wzrt" (UID: "f9463e70-7329-4e4c-bc47-3c863e79aa19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:09.930704 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.930586    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 21:36:07 +0000 UTC" deadline="2028-05-04 22:50:00.017990571 +0000 UTC"
Sep 17 21:41:09.930704 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:09.930639    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14281h8m50.087355379s"
Sep 17 21:41:10.162330 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:10.162145    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c038c15_9493_4572_b0ee_9554027db12f.slice/crio-79c17d56ca49715cc7a120a1c8e690f4c52812d78fc59f62b15809501befbebb WatchSource:0}: Error finding container 79c17d56ca49715cc7a120a1c8e690f4c52812d78fc59f62b15809501befbebb: Status 404 returned error can't find the container with id 79c17d56ca49715cc7a120a1c8e690f4c52812d78fc59f62b15809501befbebb
Sep 17 21:41:10.162828 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:10.162803    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f844e_14fa_43ab_8665_c53539aa4965.slice/crio-96c5ee086d6de5aa7912219b01d4715378d6fb1f08188cf305e8a5054b9e8021 WatchSource:0}: Error finding container 96c5ee086d6de5aa7912219b01d4715378d6fb1f08188cf305e8a5054b9e8021: Status 404 returned error can't find the container with id 96c5ee086d6de5aa7912219b01d4715378d6fb1f08188cf305e8a5054b9e8021
Sep 17 21:41:10.502098 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:10.502061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:10.502279 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.502251    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:10.502359 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.502346    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:12.502323672 +0000 UTC m=+6.023888596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:10.603536 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:10.602897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:10.603536 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.603166    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:10.603536 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.603272    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret podName:e608f059-87f0-4200-b697-b41ce99eca5d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:12.603251195 +0000 UTC m=+6.124816111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret") pod "global-pull-secret-syncer-vmmb9" (UID: "e608f059-87f0-4200-b697-b41ce99eca5d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:10.703855 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:10.703759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:10.704006 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.703991    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:41:10.704075 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.704013    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:41:10.704075 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.704025    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5zkkj for pod openshift-network-diagnostics/network-check-target-8wzrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:10.704190 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:10.704086    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj podName:f9463e70-7329-4e4c-bc47-3c863e79aa19 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:12.704068143 +0000 UTC m=+6.225633073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zkkj" (UniqueName: "kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj") pod "network-check-target-8wzrt" (UID: "f9463e70-7329-4e4c-bc47-3c863e79aa19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:11.018973 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.018471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:11.018973 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:11.018609    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:11.018973 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.018770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:11.018973 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:11.018868    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:11.020753 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.020004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:11.020753 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:11.020096    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:11.042499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.042429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal" event={"ID":"638288756fad3699123da181b4a12476","Type":"ContainerStarted","Data":"6c7061bd3f0b58d3608a8f9d929c8871fe769edc1eaebcfd244256250630bea9"}
Sep 17 21:41:11.071593 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.070716    2580 generic.go:356] "Generic (PLEG): container finished" podID="8b445265b170965646453a6817cb35d0" containerID="fc9e84793977ca4892ede2eaa6d467067efe4b44089c20409340a7edf324539c" exitCode=0
Sep 17 21:41:11.071593 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.070825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" event={"ID":"8b445265b170965646453a6817cb35d0","Type":"ContainerDied","Data":"fc9e84793977ca4892ede2eaa6d467067efe4b44089c20409340a7edf324539c"}
Sep 17 21:41:11.082844 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.082768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc" event={"ID":"a9b52476-6d75-4647-a250-c4e7d79449c6","Type":"ContainerStarted","Data":"a75ec9089c70b7cea482c11656ece4ba902d38b957b9bc5b3fa0fc9eb347d968"}
Sep 17 21:41:11.088035 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.087988    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-7.ec2.internal" podStartSLOduration=4.087972639 podStartE2EDuration="4.087972639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:11.058886208 +0000 UTC m=+4.580451139" watchObservedRunningTime="2026-09-17 21:41:11.087972639 +0000 UTC m=+4.609537569"
Sep 17 21:41:11.092823 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.092747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wktlp" event={"ID":"39a60f66-fe68-4a15-a9b2-52634dbe9def","Type":"ContainerStarted","Data":"03ad6a9ca7f143246ff29e57b545b83d2ce149ed55113114aa74362ed836a00a"}
Sep 17 21:41:11.100956 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.100877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7jscq" event={"ID":"2c3eb950-75a4-4355-9115-d2c7b4b850af","Type":"ContainerStarted","Data":"df666a4a0b062cd8852e976a9ad5c6c9ad23cf8aaf3af8de15b7e0c4e97d15bc"}
Sep 17 21:41:11.111584 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.111505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fc96h" event={"ID":"6517784b-d8d3-4498-804f-cd472685bdee","Type":"ContainerStarted","Data":"09385063ef8286f221cc2b17bb6ed2682a6bb85545a6cf9f93f5cff2461251e5"}
Sep 17 21:41:11.125172 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.125134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b2k8z" event={"ID":"178e90cd-7a73-45ce-b6ab-a28b0b753ae3","Type":"ContainerStarted","Data":"9681e609250d0c3300b6a7d392a7f587b9007c8513af571048e4f108286815fc"}
Sep 17 21:41:11.127210 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.127133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerStarted","Data":"5cbe89ac44b47e0e8a55c4a5190d3d06f916c89c7bbff8ec4855b6063413df78"}
Sep 17 21:41:11.129331 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.129261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbrcl" event={"ID":"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f","Type":"ContainerStarted","Data":"dd1b3d1dae7888c1a6e2083ac0f5895b62abcaeba56f5fc7f9410d6ef74a3eda"}
Sep 17 21:41:11.139535 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.139457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6vtqc" event={"ID":"204f844e-14fa-43ab-8665-c53539aa4965","Type":"ContainerStarted","Data":"96c5ee086d6de5aa7912219b01d4715378d6fb1f08188cf305e8a5054b9e8021"}
Sep 17 21:41:11.146858 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:11.146751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"79c17d56ca49715cc7a120a1c8e690f4c52812d78fc59f62b15809501befbebb"}
Sep 17 21:41:12.167559 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:12.167515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" event={"ID":"8b445265b170965646453a6817cb35d0","Type":"ContainerStarted","Data":"67712939ada78e4a7a9c0f258aded8b2baf7ff4dba9407444becdedfda13d4f9"}
Sep 17 21:41:12.184053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:12.183994    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-7.ec2.internal" podStartSLOduration=5.183973471 podStartE2EDuration="5.183973471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:12.183039907 +0000 UTC m=+5.704604864" watchObservedRunningTime="2026-09-17 21:41:12.183973471 +0000 UTC m=+5.705538403"
Sep 17 21:41:12.521365 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:12.520613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:12.521365 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.520788    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:12.521365 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.520850    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:16.520833096 +0000 UTC m=+10.042398010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:12.621769 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:12.621730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:12.621955 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.621917    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:12.622015 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.621982    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret podName:e608f059-87f0-4200-b697-b41ce99eca5d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:16.621963925 +0000 UTC m=+10.143528837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret") pod "global-pull-secret-syncer-vmmb9" (UID: "e608f059-87f0-4200-b697-b41ce99eca5d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:12.723061 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:12.723022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:12.723255 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.723201    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:41:12.723255 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.723224    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:41:12.723255 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.723236    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5zkkj for pod openshift-network-diagnostics/network-check-target-8wzrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:12.723409 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:12.723293    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj podName:f9463e70-7329-4e4c-bc47-3c863e79aa19 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:16.723275689 +0000 UTC m=+10.244840611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zkkj" (UniqueName: "kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj") pod "network-check-target-8wzrt" (UID: "f9463e70-7329-4e4c-bc47-3c863e79aa19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:13.018845 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:13.018757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:13.019003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:13.018765    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:13.019059 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:13.018889    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:13.019059 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:13.019022    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:13.019059 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:13.019035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:13.019205 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:13.019134    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:15.022053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:15.022005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:15.022512 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:15.022128    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:15.022512 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:15.022498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:15.022718 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:15.022588    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:15.022718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:15.022651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:15.022819 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:15.022757    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:16.554578 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:16.554540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:16.555024 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.554732    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:16.555024 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.554790    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:24.554773252 +0000 UTC m=+18.076338177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:16.655287 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:16.655248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:16.655462 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.655409    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:16.655526 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.655467    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret podName:e608f059-87f0-4200-b697-b41ce99eca5d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:24.655450928 +0000 UTC m=+18.177015850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret") pod "global-pull-secret-syncer-vmmb9" (UID: "e608f059-87f0-4200-b697-b41ce99eca5d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:16.756679 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:16.756626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:16.756877 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.756861    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:41:16.756953 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.756908    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:41:16.756953 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.756920    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5zkkj for pod openshift-network-diagnostics/network-check-target-8wzrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:16.757054 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:16.756986    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj podName:f9463e70-7329-4e4c-bc47-3c863e79aa19 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:24.756966701 +0000 UTC m=+18.278531614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zkkj" (UniqueName: "kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj") pod "network-check-target-8wzrt" (UID: "f9463e70-7329-4e4c-bc47-3c863e79aa19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:17.019939 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:17.019789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:17.019939 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:17.019910    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:17.020250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:17.020226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:17.020349 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:17.020322    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:17.020419 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:17.020400    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:17.020508 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:17.020490    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:19.022125 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:19.022095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:19.022501 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:19.022193    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:19.022501 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:19.022492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:19.022586 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:19.022562    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:19.022629 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:19.022616    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:19.022730 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:19.022715    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:21.018555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:21.018470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:21.018996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:21.018471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:21.018996 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:21.018619    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:21.018996 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:21.018726    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:21.018996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:21.018476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:21.018996 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:21.018853    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:23.022831 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:23.022584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:23.023242 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:23.022626    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:23.023242 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:23.022926    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:23.023242 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:23.022635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:23.023242 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:23.023017    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:23.023242 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:23.023088    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:24.619277 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:24.619241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:24.619712 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.619392    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:24.619712 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.619457    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:40.619437534 +0000 UTC m=+34.141002444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:24.720627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:24.720591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:24.720832 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.720751    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:24.720832 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.720814    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret podName:e608f059-87f0-4200-b697-b41ce99eca5d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:40.720794492 +0000 UTC m=+34.242359415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret") pod "global-pull-secret-syncer-vmmb9" (UID: "e608f059-87f0-4200-b697-b41ce99eca5d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:24.821506 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:24.821397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:24.821693 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.821564    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:41:24.821693 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.821585    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:41:24.821693 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.821598    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5zkkj for pod openshift-network-diagnostics/network-check-target-8wzrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:24.821693 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:24.821672    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj podName:f9463e70-7329-4e4c-bc47-3c863e79aa19 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:40.821637269 +0000 UTC m=+34.343202177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zkkj" (UniqueName: "kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj") pod "network-check-target-8wzrt" (UID: "f9463e70-7329-4e4c-bc47-3c863e79aa19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:25.019135 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:25.018624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:25.019135 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:25.018649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:25.019135 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:25.018760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:25.019135 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:25.018780    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:25.019135 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:25.018853    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:25.019135 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:25.018935    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:27.019351 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:27.019310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:27.019759 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:27.019394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:27.019759 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:27.019405    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:27.019759 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:27.019512    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:27.019759 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:27.019545    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:27.019759 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:27.019609    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:29.018532 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.018261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:29.019041 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.018264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:29.019041 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:29.018607    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:29.019041 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.018264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:29.019041 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:29.018645    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:29.019041 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:29.018720    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:29.213732 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.213690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc" event={"ID":"a9b52476-6d75-4647-a250-c4e7d79449c6","Type":"ContainerStarted","Data":"65508e41b26086b35d10cce28978be3a88cc84edadac8008bd4d614ec26fd694"}
Sep 17 21:41:29.215462 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.215433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wktlp" event={"ID":"39a60f66-fe68-4a15-a9b2-52634dbe9def","Type":"ContainerStarted","Data":"69d126479b8759d19239f03ad83b4de46ba97d599312007dd97e9a88a724a6c8"}
Sep 17 21:41:29.217017 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.216992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7jscq" event={"ID":"2c3eb950-75a4-4355-9115-d2c7b4b850af","Type":"ContainerStarted","Data":"d06e3d6d1c985a3a442ca2dae4fae5b1917f47256fd45c844a344a5afd8902e9"}
Sep 17 21:41:29.218769 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.218526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fc96h" event={"ID":"6517784b-d8d3-4498-804f-cd472685bdee","Type":"ContainerStarted","Data":"27bfaaa12e93f3e2a3618cb074c8bbb08c05e61411d17110dbf95bbd47221f66"}
Sep 17 21:41:29.220345 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.220306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b2k8z" event={"ID":"178e90cd-7a73-45ce-b6ab-a28b0b753ae3","Type":"ContainerStarted","Data":"65805cb5bcae2f2f6d2fe0bb9901b4b9846be9b0d983c0c326e6f46fe397bee0"}
Sep 17 21:41:29.221986 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.221962    2580 generic.go:356] "Generic (PLEG): container finished" podID="b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95" containerID="87a09b45537e428cc09b33399c66f43f24ff7cdf14fecdfb8f3fb9be2886587d" exitCode=0
Sep 17 21:41:29.222092 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.222049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerDied","Data":"87a09b45537e428cc09b33399c66f43f24ff7cdf14fecdfb8f3fb9be2886587d"}
Sep 17 21:41:29.224472 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.224430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6vtqc" event={"ID":"204f844e-14fa-43ab-8665-c53539aa4965","Type":"ContainerStarted","Data":"905bea61a8e46c88be3217312bfd42efb96c8fd14febee9627deac4f5915c37a"}
Sep 17 21:41:29.227804 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.227787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"498113febbde0dde37a1fd451d9730ac41f13fd9b991a5a528bd97f18f381977"}
Sep 17 21:41:29.227888 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.227842    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"ccf150b306fade30d6a85e551ec8e597d7d424ad669ab632a0aa86782e78fd55"}
Sep 17 21:41:29.227888 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.227872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"7682629dcf5826e173456d69afbf243165f154bf091b5eee07137c82954c0700"}
Sep 17 21:41:29.227968 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.227901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"d1f3a889f72d4dbe9e861e2c40f6227e6441d613b5ec91528d76e13518e1153f"}
Sep 17 21:41:29.227968 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.227929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"88a70880d562baf8c2333d1854d3919aa9af328886e8598273ba480321c78de8"}
Sep 17 21:41:29.227968 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.227955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"a71563c36903cfa36d11df30c265aea5ab5286a971ca13cb72c92a49dbe66859"}
Sep 17 21:41:29.236425 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.236390    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wktlp" podStartSLOduration=4.120495763 podStartE2EDuration="22.236378649s" totalImagesPullingTime="18.115882886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:29.235591736 +0000 UTC m=+22.757156666" watchObservedRunningTime="2026-09-17 21:41:29.236378649 +0000 UTC m=+22.757943579"
Sep 17 21:41:29.254500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.254464    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fc96h" podStartSLOduration=4.235730982 podStartE2EDuration="22.254453107s" totalImagesPullingTime="18.018722125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:29.254243383 +0000 UTC m=+22.775808311" watchObservedRunningTime="2026-09-17 21:41:29.254453107 +0000 UTC m=+22.776018036"
Sep 17 21:41:29.270199 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.270134    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6vtqc" podStartSLOduration=4.238530697 podStartE2EDuration="22.27012274s" totalImagesPullingTime="18.031592043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:29.270019568 +0000 UTC m=+22.791584509" watchObservedRunningTime="2026-09-17 21:41:29.27012274 +0000 UTC m=+22.791687686"
Sep 17 21:41:29.316676 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.316594    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b2k8z" podStartSLOduration=4.243380932 podStartE2EDuration="22.316579664s" totalImagesPullingTime="18.073198732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:29.316547074 +0000 UTC m=+22.838112007" watchObservedRunningTime="2026-09-17 21:41:29.316579664 +0000 UTC m=+22.838144594"
Sep 17 21:41:29.980397 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.980370    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 21:41:29.982446 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.982426    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:29.983015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:29.982996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:30.002223 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:30.002182    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7jscq" podStartSLOduration=8.662997777 podStartE2EDuration="23.002164612s" totalImagesPullingTime="14.339166835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:29.33879366 +0000 UTC m=+22.860358589" watchObservedRunningTime="2026-09-17 21:41:30.002164612 +0000 UTC m=+23.523729542"
Sep 17 21:41:30.232685 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:30.232587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbrcl" event={"ID":"6e125d4d-f945-4f2f-ad8c-9fc4bf4ae05f","Type":"ContainerStarted","Data":"0f78f720a5826f7455b7a4b81b0baf4537b99ec44b161602ed2f28067c540f32"}
Sep 17 21:41:30.234742 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:30.234713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc" event={"ID":"a9b52476-6d75-4647-a250-c4e7d79449c6","Type":"ContainerStarted","Data":"a0015c9a4595ea66ac6922a0cf596f5a8d265bc09c2a6d26e5c2ce9b2007ef7f"}
Sep 17 21:41:30.247340 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:30.247292    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rbrcl" podStartSLOduration=5.228047603 podStartE2EDuration="23.247277866s" totalImagesPullingTime="18.019230263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:30.247145145 +0000 UTC m=+23.768710106" watchObservedRunningTime="2026-09-17 21:41:30.247277866 +0000 UTC m=+23.768842795"
Sep 17 21:41:30.962471 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:30.962366    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T21:41:29.980392506Z","UUID":"dc3d4b0b-d862-409b-95ce-910346df4dfe","Handler":null,"Name":"","Endpoint":""}
Sep 17 21:41:30.964108 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:30.964086    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 21:41:30.964220 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:30.964135    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 21:41:31.018585 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:31.018491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:31.018585 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:31.018529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:31.018585 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:31.018537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:31.018874 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:31.018612    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:31.018874 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:31.018744    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:31.018874 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:31.018856    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:31.239164 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:31.239091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc" event={"ID":"a9b52476-6d75-4647-a250-c4e7d79449c6","Type":"ContainerStarted","Data":"f44f0d9850889bc305368b1124af8653bd35bcf93648082baed4401b487439a4"}
Sep 17 21:41:31.243840 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:31.243819    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 21:41:31.243993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:31.243819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"09333a6d2e9f138c53a66a81b3b8029e307663a34215da783fbca44ab8878a09"}
Sep 17 21:41:31.259498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:31.259448    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zfgc" podStartSLOduration=3.738932391 podStartE2EDuration="24.259433219s" totalImagesPullingTime="20.520500828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:31.258718567 +0000 UTC m=+24.780283518" watchObservedRunningTime="2026-09-17 21:41:31.259433219 +0000 UTC m=+24.780998149"
Sep 17 21:41:33.018911 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:33.018688    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:33.019389 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:33.018996    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:33.019389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:33.018737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:33.019389 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:33.019089    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:33.019389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:33.018687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:33.019389 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:33.019142    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:34.252083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.252047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerStarted","Data":"68d54140c202cd70414ca4caa6220ce0e28bce3388c1f22815e246fbc723caeb"}
Sep 17 21:41:34.255906 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.255866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" event={"ID":"0c038c15-9493-4572-b0ee-9554027db12f","Type":"ContainerStarted","Data":"61ba3cf43b7b296a8ac3685ffb2886599eb294bf0252e56bf1693968ffd571a3"}
Sep 17 21:41:34.256361 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.256182    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:34.256361 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.256250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:34.256361 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.256328    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:34.272044 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.271898    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:34.272137 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.272127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:41:34.313649 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:34.313602    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8" podStartSLOduration=9.222926739 podStartE2EDuration="27.313587237s" totalImagesPullingTime="18.090660498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:34.304952249 +0000 UTC m=+27.826517192" watchObservedRunningTime="2026-09-17 21:41:34.313587237 +0000 UTC m=+27.835152167"
Sep 17 21:41:35.018023 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:35.017985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:35.018325 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:35.017989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:35.018325 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:35.017998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:35.018459 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:35.018433    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:35.018532 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:35.018505    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:35.018674 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:35.018642    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:35.259443 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:35.259406    2580 generic.go:356] "Generic (PLEG): container finished" podID="b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95" containerID="68d54140c202cd70414ca4caa6220ce0e28bce3388c1f22815e246fbc723caeb" exitCode=0
Sep 17 21:41:35.259795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:35.259473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerDied","Data":"68d54140c202cd70414ca4caa6220ce0e28bce3388c1f22815e246fbc723caeb"}
Sep 17 21:41:36.255751 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:36.255715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmmb9"]
Sep 17 21:41:36.255905 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:36.255838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:36.255965 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:36.255931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:36.259101 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:36.259075    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8wzrt"]
Sep 17 21:41:36.259233 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:36.259180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:36.259272 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:36.259256    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:36.269514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:36.269485    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r7mr2"]
Sep 17 21:41:36.270079 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:36.269599    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:36.270079 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:36.269716    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:37.267193 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:37.266888    2580 generic.go:356] "Generic (PLEG): container finished" podID="b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95" containerID="e84cb843ab2310e6063850b52541920a81ad839e1b3cc4e09de3074014c3a22f" exitCode=0
Sep 17 21:41:37.267273 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:37.266944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerDied","Data":"e84cb843ab2310e6063850b52541920a81ad839e1b3cc4e09de3074014c3a22f"}
Sep 17 21:41:38.006470 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.006300    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:38.006902 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.006582    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 21:41:38.007992 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.007969    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7jscq"
Sep 17 21:41:38.017863 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.017843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:38.017976 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.017862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:38.017976 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.017878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:38.017976 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:38.017963    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:38.018092 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:38.018034    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:38.018146 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:38.018126    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:38.271997 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.271891    2580 generic.go:356] "Generic (PLEG): container finished" podID="b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95" containerID="1e5fe33d2fda2d8453a0ee755576fc8f550c1c67b399a716c6a5d3bfec2c497b" exitCode=0
Sep 17 21:41:38.271997 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:38.271968    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerDied","Data":"1e5fe33d2fda2d8453a0ee755576fc8f550c1c67b399a716c6a5d3bfec2c497b"}
Sep 17 21:41:39.018744 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:39.018712    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:39.019204 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:39.018863    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:40.018495 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:40.018452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:40.018692 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:40.018453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:40.018692 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.018584    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:40.018692 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.018636    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:40.632473 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:40.632432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:40.632755 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.632600    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:40.632755 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.632698    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:12.632674127 +0000 UTC m=+66.154239039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:41:40.733515 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:40.733475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:40.733736 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.733674    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:40.733815 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.733752    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret podName:e608f059-87f0-4200-b697-b41ce99eca5d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:12.733732029 +0000 UTC m=+66.255296937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret") pod "global-pull-secret-syncer-vmmb9" (UID: "e608f059-87f0-4200-b697-b41ce99eca5d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:41:40.834015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:40.833980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:40.834165 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.834132    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:41:40.834165 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.834150    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:41:40.834165 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.834159    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5zkkj for pod openshift-network-diagnostics/network-check-target-8wzrt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:40.834270 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:40.834206    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj podName:f9463e70-7329-4e4c-bc47-3c863e79aa19 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:12.834194481 +0000 UTC m=+66.355759390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zkkj" (UniqueName: "kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj") pod "network-check-target-8wzrt" (UID: "f9463e70-7329-4e4c-bc47-3c863e79aa19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:41:41.018708 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:41.018596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:41.018873 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:41.018760    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7mr2" podUID="837d276f-336d-4a93-a1fc-60e128025b09"
Sep 17 21:41:42.018760 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.018674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:42.018908 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.018808    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wzrt" podUID="f9463e70-7329-4e4c-bc47-3c863e79aa19"
Sep 17 21:41:42.018908 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.018866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:42.019260 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.018952    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmmb9" podUID="e608f059-87f0-4200-b697-b41ce99eca5d"
Sep 17 21:41:42.187412 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.187383    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-7.ec2.internal" event="NodeReady"
Sep 17 21:41:42.187606 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.187535    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 21:41:42.222373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.222341    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f97fcc679-k8bnp"]
Sep 17 21:41:42.227192 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.227171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.229795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.229776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 21:41:42.229912 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.229829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 21:41:42.230100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.230083    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fbg5w\""
Sep 17 21:41:42.230179 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.230137    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 21:41:42.234356 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.234334    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-54f7p"]
Sep 17 21:41:42.236698 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.236677    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 21:41:42.238477 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.237950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.238701 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.238683    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8q8xx"]
Sep 17 21:41:42.240399 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.240383    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 21:41:42.240603 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.240584    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 21:41:42.240727 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.240605    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-csvq4\""
Sep 17 21:41:42.242005 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.241986    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.244277 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.244257    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 21:41:42.244373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.244316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 21:41:42.244373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.244339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vmz7f\""
Sep 17 21:41:42.244591 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.244577    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 21:41:42.252883 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.252817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f97fcc679-k8bnp"]
Sep 17 21:41:42.254489 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.254468    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-54f7p"]
Sep 17 21:41:42.254688 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.254649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q8xx"]
Sep 17 21:41:42.344922 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.344836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.344922 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.344877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-registry-certificates\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.344922 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.344902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-trusted-ca\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.345156 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qct6\" (UniqueName: \"kubernetes.io/projected/7f500dbc-7540-4445-894f-3b4648eab040-kube-api-access-7qct6\") pod \"ingress-canary-8q8xx\" (UID: \"7f500dbc-7540-4445-894f-3b4648eab040\") " pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.345156 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.345156 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f500dbc-7540-4445-894f-3b4648eab040-cert\") pod \"ingress-canary-8q8xx\" (UID: \"7f500dbc-7540-4445-894f-3b4648eab040\") " pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.345156 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-image-registry-private-configuration\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.345156 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw7jf\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-kube-api-access-jw7jf\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.345333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adca5dc3-ad89-45ad-b05a-4166ac3f40de-config-volume\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.345333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4rrh\" (UniqueName: \"kubernetes.io/projected/adca5dc3-ad89-45ad-b05a-4166ac3f40de-kube-api-access-l4rrh\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.345333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-bound-sa-token\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.345333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-installation-pull-secrets\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.345333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adca5dc3-ad89-45ad-b05a-4166ac3f40de-tmp-dir\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.345513 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.345347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/231aac8e-9777-4869-83f0-62de59ea935d-ca-trust-extracted\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.412055 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.412016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:42.446056 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.446056 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f500dbc-7540-4445-894f-3b4648eab040-cert\") pod \"ingress-canary-8q8xx\" (UID: \"7f500dbc-7540-4445-894f-3b4648eab040\") " pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.446257 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-image-registry-private-configuration\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446257 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw7jf\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-kube-api-access-jw7jf\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446257 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adca5dc3-ad89-45ad-b05a-4166ac3f40de-config-volume\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.446257 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.446192    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:41:42.446257 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.446256    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls podName:adca5dc3-ad89-45ad-b05a-4166ac3f40de nodeName:}" failed. No retries permitted until 2026-09-17 21:41:42.946239793 +0000 UTC m=+36.467804702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls") pod "dns-default-54f7p" (UID: "adca5dc3-ad89-45ad-b05a-4166ac3f40de") : secret "dns-default-metrics-tls" not found
Sep 17 21:41:42.446450 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4rrh\" (UniqueName: \"kubernetes.io/projected/adca5dc3-ad89-45ad-b05a-4166ac3f40de-kube-api-access-l4rrh\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.446450 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-bound-sa-token\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446450 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-installation-pull-secrets\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446450 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adca5dc3-ad89-45ad-b05a-4166ac3f40de-tmp-dir\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.446582 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/231aac8e-9777-4869-83f0-62de59ea935d-ca-trust-extracted\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446582 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446679 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-registry-certificates\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446679 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-trusted-ca\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.446679 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qct6\" (UniqueName: \"kubernetes.io/projected/7f500dbc-7540-4445-894f-3b4648eab040-kube-api-access-7qct6\") pod \"ingress-canary-8q8xx\" (UID: \"7f500dbc-7540-4445-894f-3b4648eab040\") " pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.446795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adca5dc3-ad89-45ad-b05a-4166ac3f40de-config-volume\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.446795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adca5dc3-ad89-45ad-b05a-4166ac3f40de-tmp-dir\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.446931 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.446910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/231aac8e-9777-4869-83f0-62de59ea935d-ca-trust-extracted\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.447005 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.446961    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:41:42.447005 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.446979    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f97fcc679-k8bnp: secret "image-registry-tls" not found
Sep 17 21:41:42.447106 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.447065    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls podName:231aac8e-9777-4869-83f0-62de59ea935d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:42.947033094 +0000 UTC m=+36.468598017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls") pod "image-registry-f97fcc679-k8bnp" (UID: "231aac8e-9777-4869-83f0-62de59ea935d") : secret "image-registry-tls" not found
Sep 17 21:41:42.447334 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.447310    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-registry-certificates\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.447611 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.447589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-trusted-ca\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.458684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.451232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-image-registry-private-configuration\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.458684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.451268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f500dbc-7540-4445-894f-3b4648eab040-cert\") pod \"ingress-canary-8q8xx\" (UID: \"7f500dbc-7540-4445-894f-3b4648eab040\") " pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.458684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.451282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-installation-pull-secrets\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.458684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.456422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4rrh\" (UniqueName: \"kubernetes.io/projected/adca5dc3-ad89-45ad-b05a-4166ac3f40de-kube-api-access-l4rrh\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.458684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.456818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw7jf\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-kube-api-access-jw7jf\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.458684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.457083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-bound-sa-token\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.458684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.457365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qct6\" (UniqueName: \"kubernetes.io/projected/7f500dbc-7540-4445-894f-3b4648eab040-kube-api-access-7qct6\") pod \"ingress-canary-8q8xx\" (UID: \"7f500dbc-7540-4445-894f-3b4648eab040\") " pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.515314 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.515268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:42.562402 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.562342    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q8xx"
Sep 17 21:41:42.906351 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.906084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q8xx"]
Sep 17 21:41:42.919839 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:42.919808    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f500dbc_7540_4445_894f_3b4648eab040.slice/crio-834dc12825b6b1dd280840210d269b9c1a5f13001ed69d99ae8a77c0245e1c9a WatchSource:0}: Error finding container 834dc12825b6b1dd280840210d269b9c1a5f13001ed69d99ae8a77c0245e1c9a: Status 404 returned error can't find the container with id 834dc12825b6b1dd280840210d269b9c1a5f13001ed69d99ae8a77c0245e1c9a
Sep 17 21:41:42.949987 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.949791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:42.949987 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:42.949863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:42.949987 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.949938    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:41:42.949987 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.949950    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:41:42.949987 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.949961    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f97fcc679-k8bnp: secret "image-registry-tls" not found
Sep 17 21:41:42.950186 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.950004    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls podName:adca5dc3-ad89-45ad-b05a-4166ac3f40de nodeName:}" failed. No retries permitted until 2026-09-17 21:41:43.949987292 +0000 UTC m=+37.471552200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls") pod "dns-default-54f7p" (UID: "adca5dc3-ad89-45ad-b05a-4166ac3f40de") : secret "dns-default-metrics-tls" not found
Sep 17 21:41:42.950186 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:42.950018    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls podName:231aac8e-9777-4869-83f0-62de59ea935d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:43.950011666 +0000 UTC m=+37.471576574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls") pod "image-registry-f97fcc679-k8bnp" (UID: "231aac8e-9777-4869-83f0-62de59ea935d") : secret "image-registry-tls" not found
Sep 17 21:41:43.018923 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.018890    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:41:43.021877 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.021852    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 21:41:43.021877 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.021869    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-44pmn\""
Sep 17 21:41:43.287890 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.287863    2580 generic.go:356] "Generic (PLEG): container finished" podID="b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95" containerID="1be351c076aaf7c392089635bf5b21322d48a97bdacb8d13e161b6518c6cda6b" exitCode=0
Sep 17 21:41:43.288076 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.287951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerDied","Data":"1be351c076aaf7c392089635bf5b21322d48a97bdacb8d13e161b6518c6cda6b"}
Sep 17 21:41:43.289152 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.289133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q8xx" event={"ID":"7f500dbc-7540-4445-894f-3b4648eab040","Type":"ContainerStarted","Data":"834dc12825b6b1dd280840210d269b9c1a5f13001ed69d99ae8a77c0245e1c9a"}
Sep 17 21:41:43.957851 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.957811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:43.958068 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:43.957900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:43.958068 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:43.957953    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:41:43.958068 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:43.958013    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:41:43.958068 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:43.958032    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f97fcc679-k8bnp: secret "image-registry-tls" not found
Sep 17 21:41:43.958068 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:43.958034    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls podName:adca5dc3-ad89-45ad-b05a-4166ac3f40de nodeName:}" failed. No retries permitted until 2026-09-17 21:41:45.958011889 +0000 UTC m=+39.479576804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls") pod "dns-default-54f7p" (UID: "adca5dc3-ad89-45ad-b05a-4166ac3f40de") : secret "dns-default-metrics-tls" not found
Sep 17 21:41:43.958339 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:43.958091    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls podName:231aac8e-9777-4869-83f0-62de59ea935d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:45.958078843 +0000 UTC m=+39.479643752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls") pod "image-registry-f97fcc679-k8bnp" (UID: "231aac8e-9777-4869-83f0-62de59ea935d") : secret "image-registry-tls" not found
Sep 17 21:41:44.018425 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.018385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:41:44.018425 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.018424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:41:44.021404 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.021380    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 21:41:44.022553 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.022527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 21:41:44.022720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.022594    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7sc2s\""
Sep 17 21:41:44.022720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.022541    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 21:41:44.295091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.295056    2580 generic.go:356] "Generic (PLEG): container finished" podID="b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95" containerID="f5d445bf4ac3235ab578eafa1c64c4e153cdeb559793e7f616c2a33ada6814b3" exitCode=0
Sep 17 21:41:44.295248 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:44.295095    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerDied","Data":"f5d445bf4ac3235ab578eafa1c64c4e153cdeb559793e7f616c2a33ada6814b3"}
Sep 17 21:41:45.302183 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:45.302145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" event={"ID":"b119965f-4aa9-4eb4-b9f5-c9cc05dd6b95","Type":"ContainerStarted","Data":"0b994f21865936a13aa052482cfe180a8f71f166ac193ab8adfbdde7f236e3ce"}
Sep 17 21:41:45.327427 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:45.327361    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mf8hp" podStartSLOduration=9.259208159 podStartE2EDuration="38.327337512s" totalImagesPullingTime="29.068129353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:45.325428342 +0000 UTC m=+38.846993276" watchObservedRunningTime="2026-09-17 21:41:45.327337512 +0000 UTC m=+38.848902443"
Sep 17 21:41:45.450337 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:45.450292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:45.550799 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:45.550747    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:45.974172 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:45.974136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:45.974331 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:45.974211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:45.974331 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:45.974292    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:41:45.974331 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:45.974317    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f97fcc679-k8bnp: secret "image-registry-tls" not found
Sep 17 21:41:45.974331 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:45.974320    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:41:45.974475 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:45.974380    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls podName:231aac8e-9777-4869-83f0-62de59ea935d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:49.974361658 +0000 UTC m=+43.495926565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls") pod "image-registry-f97fcc679-k8bnp" (UID: "231aac8e-9777-4869-83f0-62de59ea935d") : secret "image-registry-tls" not found
Sep 17 21:41:45.974475 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:45.974393    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls podName:adca5dc3-ad89-45ad-b05a-4166ac3f40de nodeName:}" failed. No retries permitted until 2026-09-17 21:41:49.974387722 +0000 UTC m=+43.495952630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls") pod "dns-default-54f7p" (UID: "adca5dc3-ad89-45ad-b05a-4166ac3f40de") : secret "dns-default-metrics-tls" not found
Sep 17 21:41:46.306188 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:46.306141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q8xx" event={"ID":"7f500dbc-7540-4445-894f-3b4648eab040","Type":"ContainerStarted","Data":"0f508fc09c6faf0a53d8e9a07df3bb8cc81e2135ccdd72f4226a56d34c8902cd"}
Sep 17 21:41:46.331099 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:46.330975    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8q8xx" podStartSLOduration=1.373908512 podStartE2EDuration="4.330954533s" totalImagesPullingTime="2.957046021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:41:46.329727006 +0000 UTC m=+39.851291954" watchObservedRunningTime="2026-09-17 21:41:46.330954533 +0000 UTC m=+39.852519469"
Sep 17 21:41:46.514899 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:46.514864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:46.594470 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:46.594389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:47.352625 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:47.352580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:47.449383 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:47.449352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:47.548841 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:47.548809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:49.173351 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:49.173314    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:49.274420 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:49.274377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:49.373853 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:49.373787    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:50.006485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:50.006449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:50.006687 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:50.006515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:50.006687 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:50.006610    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:41:50.006687 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:50.006614    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:41:50.006795 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:50.006621    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f97fcc679-k8bnp: secret "image-registry-tls" not found
Sep 17 21:41:50.006795 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:50.006715    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls podName:adca5dc3-ad89-45ad-b05a-4166ac3f40de nodeName:}" failed. No retries permitted until 2026-09-17 21:41:58.006695237 +0000 UTC m=+51.528260148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls") pod "dns-default-54f7p" (UID: "adca5dc3-ad89-45ad-b05a-4166ac3f40de") : secret "dns-default-metrics-tls" not found
Sep 17 21:41:50.006795 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:50.006743    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls podName:231aac8e-9777-4869-83f0-62de59ea935d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:58.006724021 +0000 UTC m=+51.528288930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls") pod "image-registry-f97fcc679-k8bnp" (UID: "231aac8e-9777-4869-83f0-62de59ea935d") : secret "image-registry-tls" not found
Sep 17 21:41:52.500135 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:52.500073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:52.559972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:52.559932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:58.062119 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.062089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:41:58.062510 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.062146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:41:58.062510 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:58.062232    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:41:58.062510 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:58.062238    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:41:58.062510 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:58.062242    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f97fcc679-k8bnp: secret "image-registry-tls" not found
Sep 17 21:41:58.062510 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:58.062313    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls podName:adca5dc3-ad89-45ad-b05a-4166ac3f40de nodeName:}" failed. No retries permitted until 2026-09-17 21:42:14.0622834 +0000 UTC m=+67.583848310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls") pod "dns-default-54f7p" (UID: "adca5dc3-ad89-45ad-b05a-4166ac3f40de") : secret "dns-default-metrics-tls" not found
Sep 17 21:41:58.062510 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:58.062337    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls podName:231aac8e-9777-4869-83f0-62de59ea935d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:14.06232559 +0000 UTC m=+67.583890519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls") pod "image-registry-f97fcc679-k8bnp" (UID: "231aac8e-9777-4869-83f0-62de59ea935d") : secret "image-registry-tls" not found
Sep 17 21:41:58.603722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.603683    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"]
Sep 17 21:41:58.624235 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.624206    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"]
Sep 17 21:41:58.624393 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.624348    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.627053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.627026    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 21:41:58.627053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.627028    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9lwsd\""
Sep 17 21:41:58.627242 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.627086    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.628076 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.628062    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.628076 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.628069    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 21:41:58.640339 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.640281    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"]
Sep 17 21:41:58.640339 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.640318    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"]
Sep 17 21:41:58.640539 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.640404    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"
Sep 17 21:41:58.643088 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.643068    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.643191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.643068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zgcfj\""
Sep 17 21:41:58.643191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.643102    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.687941 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.687910    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"]
Sep 17 21:41:58.708372 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.708345    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"]
Sep 17 21:41:58.708555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.708455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"
Sep 17 21:41:58.711479 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.711460    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g4npm\""
Sep 17 21:41:58.726466 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.726440    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-m58ph"]
Sep 17 21:41:58.726594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.726562    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.729772 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.729752    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m5n4z\""
Sep 17 21:41:58.731338 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.731321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 21:41:58.731421 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.731378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 21:41:58.731421 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.731387    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.731421 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.731395    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.740568 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.740548    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"]
Sep 17 21:41:58.740699 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.740576    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-w49hn"]
Sep 17 21:41:58.740772 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.740693    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.743205 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.743184    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xvv7k\""
Sep 17 21:41:58.743307 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.743184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.743453 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.743438    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.743518 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.743497    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 21:41:58.743573 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.743515    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 21:41:58.748595 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.748559    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 21:41:58.762592 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.762566    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"]
Sep 17 21:41:58.762714 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.762601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-m58ph"]
Sep 17 21:41:58.762714 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.762628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-w49hn"]
Sep 17 21:41:58.762829 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.762719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.765756 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.765738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 21:41:58.765756 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.765750    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.767756 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.767734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11ebd6a7-5c96-4eba-80ef-919755bfc1da-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.767819 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.767787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tclg\" (UniqueName: \"kubernetes.io/projected/4b2925eb-b695-470c-9ae4-1fc669384585-kube-api-access-6tclg\") pod \"volume-data-source-validator-5c4db8bdf9-9pwvt\" (UID: \"4b2925eb-b695-470c-9ae4-1fc669384585\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"
Sep 17 21:41:58.767865 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.767848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpwv8\" (UniqueName: \"kubernetes.io/projected/11ebd6a7-5c96-4eba-80ef-919755bfc1da-kube-api-access-lpwv8\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.767914 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.767902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11ebd6a7-5c96-4eba-80ef-919755bfc1da-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.778144 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.778121    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 21:41:58.778251 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.778170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.778738 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.778721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p7j25\""
Sep 17 21:41:58.801201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.801170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 21:41:58.820647 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.820619    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"]
Sep 17 21:41:58.842151 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.842126    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"]
Sep 17 21:41:58.842299 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.842263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:58.848698 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.848672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zwzdn\""
Sep 17 21:41:58.848808 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.848786    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.848884 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.848805    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 21:41:58.848884 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.848790    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 21:41:58.850883 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.850867    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.858464 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.858395    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8498d4ff98-642dx"]
Sep 17 21:41:58.858576 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.858527    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:41:58.861717 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.861697    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 21:41:58.861826 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.861795    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.861888 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.861847    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.862681 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.862645    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-92t7n\""
Sep 17 21:41:58.868489 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.868564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsx5g\" (UniqueName: \"kubernetes.io/projected/67b3c9a6-6688-488b-8ee1-222152f6793a-kube-api-access-gsx5g\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.868564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kp7r\" (UniqueName: \"kubernetes.io/projected/64f6b117-ceb3-47a1-8fdc-25e8fef64701-kube-api-access-9kp7r\") pod \"network-check-source-7cbc45fddc-9vpfj\" (UID: \"64f6b117-ceb3-47a1-8fdc-25e8fef64701\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"
Sep 17 21:41:58.868564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6eeb779-69fd-4566-99f8-a0b24911a806-tmp\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.868690 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdad6dfd-e180-4780-97e3-7a06826ff952-trusted-ca\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.868690 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11ebd6a7-5c96-4eba-80ef-919755bfc1da-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.868690 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6eeb779-69fd-4566-99f8-a0b24911a806-snapshots\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.868690 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6eeb779-69fd-4566-99f8-a0b24911a806-serving-cert\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.868850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6eeb779-69fd-4566-99f8-a0b24911a806-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.868850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qptrr\" (UniqueName: \"kubernetes.io/projected/c6eeb779-69fd-4566-99f8-a0b24911a806-kube-api-access-qptrr\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.868850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdad6dfd-e180-4780-97e3-7a06826ff952-serving-cert\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.868850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tclg\" (UniqueName: \"kubernetes.io/projected/4b2925eb-b695-470c-9ae4-1fc669384585-kube-api-access-6tclg\") pod \"volume-data-source-validator-5c4db8bdf9-9pwvt\" (UID: \"4b2925eb-b695-470c-9ae4-1fc669384585\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"
Sep 17 21:41:58.869015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67b3c9a6-6688-488b-8ee1-222152f6793a-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.869015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpwv8\" (UniqueName: \"kubernetes.io/projected/11ebd6a7-5c96-4eba-80ef-919755bfc1da-kube-api-access-lpwv8\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.869015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6eeb779-69fd-4566-99f8-a0b24911a806-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.869015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.868988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qslgx\" (UniqueName: \"kubernetes.io/projected/cdad6dfd-e180-4780-97e3-7a06826ff952-kube-api-access-qslgx\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.869197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.869030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11ebd6a7-5c96-4eba-80ef-919755bfc1da-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.869197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.869061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdad6dfd-e180-4780-97e3-7a06826ff952-config\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.869490 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.869472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11ebd6a7-5c96-4eba-80ef-919755bfc1da-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.871905 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.871890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11ebd6a7-5c96-4eba-80ef-919755bfc1da-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.872298 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.872282    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"]
Sep 17 21:41:58.872340 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.872322    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"]
Sep 17 21:41:58.872388 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.872378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:58.874999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.874980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 17 21:41:58.875103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.874980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 17 21:41:58.875291 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.875267    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 17 21:41:58.875384 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.875344    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 21:41:58.875514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.875458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9fngz\""
Sep 17 21:41:58.875599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.875529    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 17 21:41:58.875599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.875550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 21:41:58.879748 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.879727    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8498d4ff98-642dx"]
Sep 17 21:41:58.883995 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.883973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tclg\" (UniqueName: \"kubernetes.io/projected/4b2925eb-b695-470c-9ae4-1fc669384585-kube-api-access-6tclg\") pod \"volume-data-source-validator-5c4db8bdf9-9pwvt\" (UID: \"4b2925eb-b695-470c-9ae4-1fc669384585\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"
Sep 17 21:41:58.884107 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.884083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpwv8\" (UniqueName: \"kubernetes.io/projected/11ebd6a7-5c96-4eba-80ef-919755bfc1da-kube-api-access-lpwv8\") pod \"kube-storage-version-migrator-operator-55889f7b47-twf58\" (UID: \"11ebd6a7-5c96-4eba-80ef-919755bfc1da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.936741 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.936701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"
Sep 17 21:41:58.948852 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.948828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"
Sep 17 21:41:58.970453 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6eeb779-69fd-4566-99f8-a0b24911a806-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.970549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qslgx\" (UniqueName: \"kubernetes.io/projected/cdad6dfd-e180-4780-97e3-7a06826ff952-kube-api-access-qslgx\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.970549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-default-certificate\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:58.970549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:58.970724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdad6dfd-e180-4780-97e3-7a06826ff952-config\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.970724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.970724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp866\" (UniqueName: \"kubernetes.io/projected/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-kube-api-access-qp866\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:58.970724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jz97\" (UniqueName: \"kubernetes.io/projected/3a7113ad-edec-42e3-953a-6ebfd6572930-kube-api-access-7jz97\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsx5g\" (UniqueName: \"kubernetes.io/projected/67b3c9a6-6688-488b-8ee1-222152f6793a-kube-api-access-gsx5g\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:58.970749    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kp7r\" (UniqueName: \"kubernetes.io/projected/64f6b117-ceb3-47a1-8fdc-25e8fef64701-kube-api-access-9kp7r\") pod \"network-check-source-7cbc45fddc-9vpfj\" (UID: \"64f6b117-ceb3-47a1-8fdc-25e8fef64701\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:58.970820    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls podName:67b3c9a6-6688-488b-8ee1-222152f6793a nodeName:}" failed. No retries permitted until 2026-09-17 21:41:59.470801184 +0000 UTC m=+52.992366111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-65d6h" (UID: "67b3c9a6-6688-488b-8ee1-222152f6793a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6eeb779-69fd-4566-99f8-a0b24911a806-tmp\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdad6dfd-e180-4780-97e3-7a06826ff952-trusted-ca\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:58.970926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59951536-e55e-4983-9214-500e766b3f17-serving-cert\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.970978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6eeb779-69fd-4566-99f8-a0b24911a806-snapshots\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6eeb779-69fd-4566-99f8-a0b24911a806-serving-cert\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6eeb779-69fd-4566-99f8-a0b24911a806-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8vgq\" (UniqueName: \"kubernetes.io/projected/59951536-e55e-4983-9214-500e766b3f17-kube-api-access-s8vgq\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptrr\" (UniqueName: \"kubernetes.io/projected/c6eeb779-69fd-4566-99f8-a0b24911a806-kube-api-access-qptrr\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdad6dfd-e180-4780-97e3-7a06826ff952-serving-cert\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59951536-e55e-4983-9214-500e766b3f17-config\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-stats-auth\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67b3c9a6-6688-488b-8ee1-222152f6793a-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.971323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdad6dfd-e180-4780-97e3-7a06826ff952-config\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.971871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6eeb779-69fd-4566-99f8-a0b24911a806-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.971871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdad6dfd-e180-4780-97e3-7a06826ff952-trusted-ca\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.971871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6eeb779-69fd-4566-99f8-a0b24911a806-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.971871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.971863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6eeb779-69fd-4566-99f8-a0b24911a806-tmp\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.972072 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.972026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67b3c9a6-6688-488b-8ee1-222152f6793a-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.972167 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.972148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6eeb779-69fd-4566-99f8-a0b24911a806-snapshots\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.973925 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.973902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdad6dfd-e180-4780-97e3-7a06826ff952-serving-cert\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.974071 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.974045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6eeb779-69fd-4566-99f8-a0b24911a806-serving-cert\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.988319 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.988297    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qslgx\" (UniqueName: \"kubernetes.io/projected/cdad6dfd-e180-4780-97e3-7a06826ff952-kube-api-access-qslgx\") pod \"console-operator-fd4bb46c-m58ph\" (UID: \"cdad6dfd-e180-4780-97e3-7a06826ff952\") " pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:58.988753 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.988730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsx5g\" (UniqueName: \"kubernetes.io/projected/67b3c9a6-6688-488b-8ee1-222152f6793a-kube-api-access-gsx5g\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:58.989707 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.989684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qptrr\" (UniqueName: \"kubernetes.io/projected/c6eeb779-69fd-4566-99f8-a0b24911a806-kube-api-access-qptrr\") pod \"insights-operator-6f9c644dd9-w49hn\" (UID: \"c6eeb779-69fd-4566-99f8-a0b24911a806\") " pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:58.989815 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.989795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kp7r\" (UniqueName: \"kubernetes.io/projected/64f6b117-ceb3-47a1-8fdc-25e8fef64701-kube-api-access-9kp7r\") pod \"network-check-source-7cbc45fddc-9vpfj\" (UID: \"64f6b117-ceb3-47a1-8fdc-25e8fef64701\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"
Sep 17 21:41:58.990576 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:58.990551    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:59.017022 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.016961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"
Sep 17 21:41:59.049152 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.049125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:41:59.070555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.070511    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-w49hn"
Sep 17 21:41:59.072389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59951536-e55e-4983-9214-500e766b3f17-config\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:59.072500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-stats-auth\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.072500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-default-certificate\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.072500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.072500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp866\" (UniqueName: \"kubernetes.io/projected/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-kube-api-access-qp866\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.072773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jz97\" (UniqueName: \"kubernetes.io/projected/3a7113ad-edec-42e3-953a-6ebfd6572930-kube-api-access-7jz97\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:41:59.072773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.072773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59951536-e55e-4983-9214-500e766b3f17-serving-cert\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:59.072773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:41:59.072975 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.072797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8vgq\" (UniqueName: \"kubernetes.io/projected/59951536-e55e-4983-9214-500e766b3f17-kube-api-access-s8vgq\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:59.073042 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.073023    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:59.573002982 +0000 UTC m=+53.094567891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : configmap references non-existent config key: service-ca.crt
Sep 17 21:41:59.073042 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.073024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59951536-e55e-4983-9214-500e766b3f17-config\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:59.073156 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.073119    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:41:59.073207 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.073166    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls podName:3a7113ad-edec-42e3-953a-6ebfd6572930 nodeName:}" failed. No retries permitted until 2026-09-17 21:41:59.573153118 +0000 UTC m=+53.094718041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-vc98b" (UID: "3a7113ad-edec-42e3-953a-6ebfd6572930") : secret "samples-operator-tls" not found
Sep 17 21:41:59.073318 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.073299    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:41:59.073379 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.073350    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:41:59.57333441 +0000 UTC m=+53.094899319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : secret "router-metrics-certs-default" not found
Sep 17 21:41:59.075578 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.075529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59951536-e55e-4983-9214-500e766b3f17-serving-cert\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:59.075707 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.075630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-stats-auth\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.075863 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.075842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-default-certificate\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.084725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.084699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp866\" (UniqueName: \"kubernetes.io/projected/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-kube-api-access-qp866\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.085281 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.085261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8vgq\" (UniqueName: \"kubernetes.io/projected/59951536-e55e-4983-9214-500e766b3f17-kube-api-access-s8vgq\") pod \"service-ca-operator-57cdc4b768-zrvgs\" (UID: \"59951536-e55e-4983-9214-500e766b3f17\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:59.086523 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.086498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jz97\" (UniqueName: \"kubernetes.io/projected/3a7113ad-edec-42e3-953a-6ebfd6572930-kube-api-access-7jz97\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:41:59.095684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.095629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:41:59.151097 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.150998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"
Sep 17 21:41:59.234651 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.234624    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58"]
Sep 17 21:41:59.238076 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:59.238049    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ebd6a7_5c96_4eba_80ef_919755bfc1da.slice/crio-bbcb5a58e06446ce2574be807f0a7c2aefcbe68180710e7e4d4dbcf33742672d WatchSource:0}: Error finding container bbcb5a58e06446ce2574be807f0a7c2aefcbe68180710e7e4d4dbcf33742672d: Status 404 returned error can't find the container with id bbcb5a58e06446ce2574be807f0a7c2aefcbe68180710e7e4d4dbcf33742672d
Sep 17 21:41:59.270243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.270218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt"]
Sep 17 21:41:59.272798 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:59.272771    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2925eb_b695_470c_9ae4_1fc669384585.slice/crio-b5ec1007644ccec1369f25e7feb1f70d28b3d96599850045aafe0a063572b04b WatchSource:0}: Error finding container b5ec1007644ccec1369f25e7feb1f70d28b3d96599850045aafe0a063572b04b: Status 404 returned error can't find the container with id b5ec1007644ccec1369f25e7feb1f70d28b3d96599850045aafe0a063572b04b
Sep 17 21:41:59.339199 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.339158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58" event={"ID":"11ebd6a7-5c96-4eba-80ef-919755bfc1da","Type":"ContainerStarted","Data":"bbcb5a58e06446ce2574be807f0a7c2aefcbe68180710e7e4d4dbcf33742672d"}
Sep 17 21:41:59.340271 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.340249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt" event={"ID":"4b2925eb-b695-470c-9ae4-1fc669384585","Type":"ContainerStarted","Data":"b5ec1007644ccec1369f25e7feb1f70d28b3d96599850045aafe0a063572b04b"}
Sep 17 21:41:59.342940 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.342910    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj"]
Sep 17 21:41:59.345240 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:59.345217    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f6b117_ceb3_47a1_8fdc_25e8fef64701.slice/crio-14309fea7f664725878ae687758a5e97346760e2915a1fe9dcb33a149bdc28c3 WatchSource:0}: Error finding container 14309fea7f664725878ae687758a5e97346760e2915a1fe9dcb33a149bdc28c3: Status 404 returned error can't find the container with id 14309fea7f664725878ae687758a5e97346760e2915a1fe9dcb33a149bdc28c3
Sep 17 21:41:59.351960 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.351934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-m58ph"]
Sep 17 21:41:59.354268 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:59.354247    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdad6dfd_e180_4780_97e3_7a06826ff952.slice/crio-19572c5228d84a5b05f98bb670ea50ac74a3bdbac3c376e12a21a3bfbdc54218 WatchSource:0}: Error finding container 19572c5228d84a5b05f98bb670ea50ac74a3bdbac3c376e12a21a3bfbdc54218: Status 404 returned error can't find the container with id 19572c5228d84a5b05f98bb670ea50ac74a3bdbac3c376e12a21a3bfbdc54218
Sep 17 21:41:59.383216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.383150    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-w49hn"]
Sep 17 21:41:59.385859 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:59.385836    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6eeb779_69fd_4566_99f8_a0b24911a806.slice/crio-799bdf00eaf1d1d2059d66d11fc5ff9b4b0c0fa5917801c5ceca83723b567898 WatchSource:0}: Error finding container 799bdf00eaf1d1d2059d66d11fc5ff9b4b0c0fa5917801c5ceca83723b567898: Status 404 returned error can't find the container with id 799bdf00eaf1d1d2059d66d11fc5ff9b4b0c0fa5917801c5ceca83723b567898
Sep 17 21:41:59.435287 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.435237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs"]
Sep 17 21:41:59.437223 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:41:59.437183    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59951536_e55e_4983_9214_500e766b3f17.slice/crio-a1ce0e3d8a01cefe5a2c1bfac36b4dcd9c08986f616c9cbb6adc7675e6bd217e WatchSource:0}: Error finding container a1ce0e3d8a01cefe5a2c1bfac36b4dcd9c08986f616c9cbb6adc7675e6bd217e: Status 404 returned error can't find the container with id a1ce0e3d8a01cefe5a2c1bfac36b4dcd9c08986f616c9cbb6adc7675e6bd217e
Sep 17 21:41:59.476061 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.476029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:41:59.476192 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.476174    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:41:59.476248 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.476242    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls podName:67b3c9a6-6688-488b-8ee1-222152f6793a nodeName:}" failed. No retries permitted until 2026-09-17 21:42:00.476226528 +0000 UTC m=+53.997791437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-65d6h" (UID: "67b3c9a6-6688-488b-8ee1-222152f6793a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:41:59.576807 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.576766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.576993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.576874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:41:59.576993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:41:59.576912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:41:59.576993 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.576921    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:41:59.577144 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.576997    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:00.576978051 +0000 UTC m=+54.098542975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : secret "router-metrics-certs-default" not found
Sep 17 21:41:59.577144 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.577016    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:00.577005494 +0000 UTC m=+54.098570425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : configmap references non-existent config key: service-ca.crt
Sep 17 21:41:59.577144 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.577031    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:41:59.577144 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:41:59.577091    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls podName:3a7113ad-edec-42e3-953a-6ebfd6572930 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:00.577074377 +0000 UTC m=+54.098639300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-vc98b" (UID: "3a7113ad-edec-42e3-953a-6ebfd6572930") : secret "samples-operator-tls" not found
Sep 17 21:42:00.117997 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.117889    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:00.209351 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.209295    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:00.308968 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.308909    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:00.348645 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.348599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj" event={"ID":"64f6b117-ceb3-47a1-8fdc-25e8fef64701","Type":"ContainerStarted","Data":"14309fea7f664725878ae687758a5e97346760e2915a1fe9dcb33a149bdc28c3"}
Sep 17 21:42:00.351705 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.351676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" event={"ID":"cdad6dfd-e180-4780-97e3-7a06826ff952","Type":"ContainerStarted","Data":"19572c5228d84a5b05f98bb670ea50ac74a3bdbac3c376e12a21a3bfbdc54218"}
Sep 17 21:42:00.353715 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.353636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs" event={"ID":"59951536-e55e-4983-9214-500e766b3f17","Type":"ContainerStarted","Data":"a1ce0e3d8a01cefe5a2c1bfac36b4dcd9c08986f616c9cbb6adc7675e6bd217e"}
Sep 17 21:42:00.356423 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.356368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-w49hn" event={"ID":"c6eeb779-69fd-4566-99f8-a0b24911a806","Type":"ContainerStarted","Data":"799bdf00eaf1d1d2059d66d11fc5ff9b4b0c0fa5917801c5ceca83723b567898"}
Sep 17 21:42:00.488035 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.487329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:42:00.488035 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:00.487528    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:00.488035 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:00.487595    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls podName:67b3c9a6-6688-488b-8ee1-222152f6793a nodeName:}" failed. No retries permitted until 2026-09-17 21:42:02.487575321 +0000 UTC m=+56.009140235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-65d6h" (UID: "67b3c9a6-6688-488b-8ee1-222152f6793a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.588456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.588528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.588626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:00.588851    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:00.588917    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:02.588896597 +0000 UTC m=+56.110461508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : secret "router-metrics-certs-default" not found
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:00.589328    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:02.589311123 +0000 UTC m=+56.110876034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : configmap references non-existent config key: service-ca.crt
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:00.589407    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:42:00.589476 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:00.589435    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls podName:3a7113ad-edec-42e3-953a-6ebfd6572930 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:02.589427551 +0000 UTC m=+56.110992459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-vc98b" (UID: "3a7113ad-edec-42e3-953a-6ebfd6572930") : secret "samples-operator-tls" not found
Sep 17 21:42:00.707352 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.707304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:00.769052 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:00.769016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:01.114773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:01.114490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:01.188289 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:01.188190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:01.289830 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:01.289792    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:01.362416 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:01.362351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt" event={"ID":"4b2925eb-b695-470c-9ae4-1fc669384585","Type":"ContainerStarted","Data":"79fe9b6b1a6a4d2803d6f44d8eb343706de0fa7586800c5bca845109c62040e0"}
Sep 17 21:42:01.381278 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:01.381160    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-9pwvt" podStartSLOduration=1.768558289 podStartE2EDuration="3.38113418s" totalImagesPullingTime="1.612575891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:01.378950362 +0000 UTC m=+54.900515293" watchObservedRunningTime="2026-09-17 21:42:01.38113418 +0000 UTC m=+54.902699111"
Sep 17 21:42:01.498189 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:01.498148    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:01.602232 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:01.601961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:02.510337 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:02.510291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:42:02.510830 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:02.510451    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:02.510830 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:02.510537    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls podName:67b3c9a6-6688-488b-8ee1-222152f6793a nodeName:}" failed. No retries permitted until 2026-09-17 21:42:06.51051612 +0000 UTC m=+60.032081048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-65d6h" (UID: "67b3c9a6-6688-488b-8ee1-222152f6793a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:02.611412 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:02.611374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:02.611618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:02.611430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:42:02.611618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:02.611497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:02.611618 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:02.611576    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:06.611552519 +0000 UTC m=+60.133117433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : configmap references non-existent config key: service-ca.crt
Sep 17 21:42:02.611618 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:02.611607    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:42:02.611799 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:02.611639    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:42:02.611799 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:02.611677    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls podName:3a7113ad-edec-42e3-953a-6ebfd6572930 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:06.611644248 +0000 UTC m=+60.133209157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-vc98b" (UID: "3a7113ad-edec-42e3-953a-6ebfd6572930") : secret "samples-operator-tls" not found
Sep 17 21:42:02.611799 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:02.611696    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:06.611684962 +0000 UTC m=+60.133249871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : secret "router-metrics-certs-default" not found
Sep 17 21:42:03.252706 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:03.252630    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:03.323012 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:03.322971    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:04.376579 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.373202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-w49hn" event={"ID":"c6eeb779-69fd-4566-99f8-a0b24911a806","Type":"ContainerStarted","Data":"6666ee909f7b821f8463c474df26da51f4b9490c7fb93c7c98f556a023353b43"}
Sep 17 21:42:04.376579 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.375775    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj" event={"ID":"64f6b117-ceb3-47a1-8fdc-25e8fef64701","Type":"ContainerStarted","Data":"d45ae7df8507be432c4dd8d89492a73e8139047c12b59a8c5dd545fab7bc2d9e"}
Sep 17 21:42:04.378002 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.377948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" event={"ID":"cdad6dfd-e180-4780-97e3-7a06826ff952","Type":"ContainerStarted","Data":"1114483085fd168ee484cbce617e6b64eb1d25b3a6928edf1d7e2c4853b8c5aa"}
Sep 17 21:42:04.378754 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.378722    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:42:04.379946 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.379921    2580 patch_prober.go:28] interesting pod/console-operator-fd4bb46c-m58ph container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Sep 17 21:42:04.380087 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.379970    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused"
Sep 17 21:42:04.380809 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.380786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58" event={"ID":"11ebd6a7-5c96-4eba-80ef-919755bfc1da","Type":"ContainerStarted","Data":"201410e3c034c37b9009b9f6437976529230574baf4814a857ef6a0eeb0e19b8"}
Sep 17 21:42:04.382853 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.382831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs" event={"ID":"59951536-e55e-4983-9214-500e766b3f17","Type":"ContainerStarted","Data":"6f07fcfb62c46cf6d53bda6dc080325c865683fdff2acf8eb43d08e2b4d453ac"}
Sep 17 21:42:04.395919 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.395807    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-w49hn" podStartSLOduration=1.545080381 podStartE2EDuration="6.395786606s" totalImagesPullingTime="4.850706225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:04.395048275 +0000 UTC m=+57.916613225" watchObservedRunningTime="2026-09-17 21:42:04.395786606 +0000 UTC m=+57.917351536"
Sep 17 21:42:04.437387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.437328    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58" podStartSLOduration=1.443143212 podStartE2EDuration="6.437305864s" totalImagesPullingTime="4.994162652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:04.437039645 +0000 UTC m=+57.958604573" watchObservedRunningTime="2026-09-17 21:42:04.437305864 +0000 UTC m=+57.958870795"
Sep 17 21:42:04.438393 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.438351    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs" podStartSLOduration=1.633587994 podStartE2EDuration="6.438334631s" totalImagesPullingTime="4.804746637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:04.413418468 +0000 UTC m=+57.934983416" watchObservedRunningTime="2026-09-17 21:42:04.438334631 +0000 UTC m=+57.959899560"
Sep 17 21:42:04.480746 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.480616    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-9vpfj" podStartSLOduration=1.577938396 podStartE2EDuration="6.480595121s" totalImagesPullingTime="4.902656725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:04.456802899 +0000 UTC m=+57.978367855" watchObservedRunningTime="2026-09-17 21:42:04.480595121 +0000 UTC m=+58.002160051"
Sep 17 21:42:04.480921 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.480742    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podStartSLOduration=1.60219328 podStartE2EDuration="6.480734525s" totalImagesPullingTime="4.878541245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:04.479911758 +0000 UTC m=+58.001476709" watchObservedRunningTime="2026-09-17 21:42:04.480734525 +0000 UTC m=+58.002299456"
Sep 17 21:42:04.859267 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.859234    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:04.962077 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:04.962045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:05.388397 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.388370    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/0.log"
Sep 17 21:42:05.388911 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.388883    2580 generic.go:356] "Generic (PLEG): container finished" podID="cdad6dfd-e180-4780-97e3-7a06826ff952" containerID="1114483085fd168ee484cbce617e6b64eb1d25b3a6928edf1d7e2c4853b8c5aa" exitCode=255
Sep 17 21:42:05.389190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.389148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" event={"ID":"cdad6dfd-e180-4780-97e3-7a06826ff952","Type":"ContainerDied","Data":"1114483085fd168ee484cbce617e6b64eb1d25b3a6928edf1d7e2c4853b8c5aa"}
Sep 17 21:42:05.389303 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.389232    2580 scope.go:117] "RemoveContainer" containerID="1114483085fd168ee484cbce617e6b64eb1d25b3a6928edf1d7e2c4853b8c5aa"
Sep 17 21:42:05.486936 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.486905    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4k6ps"]
Sep 17 21:42:05.501959 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.501929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.505524 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.505471    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5wn52\""
Sep 17 21:42:05.505909 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.505890    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 21:42:05.506103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.505894    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 21:42:05.512860 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.512833    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4k6ps"]
Sep 17 21:42:05.531632 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.531598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:05.545216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.544945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr69b\" (UniqueName: \"kubernetes.io/projected/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-api-access-zr69b\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.545216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.544985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-crio-socket\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.545216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.545069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.545216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.545125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-data-volume\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.545216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.545143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.645636 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.645580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-data-volume\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.645636 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.645640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.645914 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.645766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr69b\" (UniqueName: \"kubernetes.io/projected/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-api-access-zr69b\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.645914 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.645808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-crio-socket\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.645914 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.645884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.646087 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:05.646022    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:42:05.646087 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.646019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-data-volume\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.646087 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:05.646087    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:06.146066826 +0000 UTC m=+59.667631735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : configmap "kube-rbac-proxy" not found
Sep 17 21:42:05.646372 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:05.646282    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:05.646372 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:05.646348    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:06.146330791 +0000 UTC m=+59.667895706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:05.646850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.646381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-crio-socket\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:05.648008 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.647980    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:05.671961 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:05.671928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr69b\" (UniqueName: \"kubernetes.io/projected/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-api-access-zr69b\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:06.010444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.010409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:06.105788 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.105760    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:06.150883 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.150851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:06.151068 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.150910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:06.151068 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.150968    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:42:06.151068 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.151037    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:07.15102025 +0000 UTC m=+60.672585158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : configmap "kube-rbac-proxy" not found
Sep 17 21:42:06.151068 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.151047    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:06.151274 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.151093    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:07.151077015 +0000 UTC m=+60.672641938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:06.276492 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.276462    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dcq8"
Sep 17 21:42:06.323722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.323683    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:06.394069 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.394044    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/1.log"
Sep 17 21:42:06.394522 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.394503    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/0.log"
Sep 17 21:42:06.394577 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.394548    2580 generic.go:356] "Generic (PLEG): container finished" podID="cdad6dfd-e180-4780-97e3-7a06826ff952" containerID="06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf" exitCode=255
Sep 17 21:42:06.394644 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.394628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" event={"ID":"cdad6dfd-e180-4780-97e3-7a06826ff952","Type":"ContainerDied","Data":"06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf"}
Sep 17 21:42:06.394728 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.394700    2580 scope.go:117] "RemoveContainer" containerID="1114483085fd168ee484cbce617e6b64eb1d25b3a6928edf1d7e2c4853b8c5aa"
Sep 17 21:42:06.394921 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.394901    2580 scope.go:117] "RemoveContainer" containerID="06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf"
Sep 17 21:42:06.395120 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.395099    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-m58ph_openshift-console-operator(cdad6dfd-e180-4780-97e3-7a06826ff952)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952"
Sep 17 21:42:06.455237 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.455209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:06.555448 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.555366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:42:06.555589 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.555517    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:06.555589 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.555583    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls podName:67b3c9a6-6688-488b-8ee1-222152f6793a nodeName:}" failed. No retries permitted until 2026-09-17 21:42:14.555567659 +0000 UTC m=+68.077132566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-65d6h" (UID: "67b3c9a6-6688-488b-8ee1-222152f6793a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:06.588810 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.588780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:06.656009 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.655972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:42:06.656154 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.656050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:06.656154 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.656131    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:42:06.656154 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.656144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:06.656257 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.656197    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls podName:3a7113ad-edec-42e3-953a-6ebfd6572930 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:14.656179281 +0000 UTC m=+68.177744207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-vc98b" (UID: "3a7113ad-edec-42e3-953a-6ebfd6572930") : secret "samples-operator-tls" not found
Sep 17 21:42:06.656257 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.656199    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:42:06.656332 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.656258    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:14.656243133 +0000 UTC m=+68.177808057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : configmap references non-existent config key: service-ca.crt
Sep 17 21:42:06.656332 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:06.656275    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:14.656268057 +0000 UTC m=+68.177832966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : secret "router-metrics-certs-default" not found
Sep 17 21:42:06.694545 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.694505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:06.889215 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.889124    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fc96h_6517784b-d8d3-4498-804f-cd472685bdee/dns-node-resolver/0.log"
Sep 17 21:42:06.982558 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:06.982521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:07.160770 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:07.160674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:07.160770 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:07.160751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:07.160996 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:07.160842    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:42:07.160996 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:07.160877    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:07.160996 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:07.160920    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:09.160901381 +0000 UTC m=+62.682466298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : configmap "kube-rbac-proxy" not found
Sep 17 21:42:07.160996 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:07.160935    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:09.160929181 +0000 UTC m=+62.682494089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:07.317170 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:07.317141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:07.399198 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:07.399173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/1.log"
Sep 17 21:42:07.399596 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:07.399577    2580 scope.go:117] "RemoveContainer" containerID="06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf"
Sep 17 21:42:07.399822 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:07.399797    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-m58ph_openshift-console-operator(cdad6dfd-e180-4780-97e3-7a06826ff952)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952"
Sep 17 21:42:07.641564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:07.641534    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6vtqc_204f844e-14fa-43ab-8665-c53539aa4965/node-ca/0.log"
Sep 17 21:42:08.078301 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:08.078267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:08.191717 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:08.191685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:08.439357 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:08.439272    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q8xx_7f500dbc-7540-4445-894f-3b4648eab040/serve-healthcheck-canary/0.log"
Sep 17 21:42:09.050107 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:09.050066    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:42:09.050455 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:09.050442    2580 scope.go:117] "RemoveContainer" containerID="06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf"
Sep 17 21:42:09.050603 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:09.050586    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-m58ph_openshift-console-operator(cdad6dfd-e180-4780-97e3-7a06826ff952)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952"
Sep 17 21:42:09.178467 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:09.178427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:09.178643 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:09.178491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:09.178643 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:09.178553    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:42:09.178643 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:09.178616    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:13.178600525 +0000 UTC m=+66.700165433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : configmap "kube-rbac-proxy" not found
Sep 17 21:42:09.178643 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:09.178631    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:09.178818 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:09.178699    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:13.178686651 +0000 UTC m=+66.700251560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:09.333646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:09.333539    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:12.392781 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.392741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:12.502406 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.502365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:12.572235 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.572208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:12.660696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.660597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:12.707114 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.707081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:42:12.709827 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.709809    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 21:42:12.718193 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:12.718171    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 21:42:12.718249 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:12.718240    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs podName:837d276f-336d-4a93-a1fc-60e128025b09 nodeName:}" failed. No retries permitted until 2026-09-17 21:43:16.7182186 +0000 UTC m=+130.239783507 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs") pod "network-metrics-daemon-r7mr2" (UID: "837d276f-336d-4a93-a1fc-60e128025b09") : secret "metrics-daemon-secret" not found
Sep 17 21:42:12.808337 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.808284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:42:12.811491 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.811471    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 21:42:12.821414 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.821380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e608f059-87f0-4200-b697-b41ce99eca5d-original-pull-secret\") pod \"global-pull-secret-syncer-vmmb9\" (UID: \"e608f059-87f0-4200-b697-b41ce99eca5d\") " pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:42:12.837609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.837573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmmb9"
Sep 17 21:42:12.848752 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.848724    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:12.909521 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.909489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:42:12.912169 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.912102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zkkj\" (UniqueName: \"kubernetes.io/projected/f9463e70-7329-4e4c-bc47-3c863e79aa19-kube-api-access-5zkkj\") pod \"network-check-target-8wzrt\" (UID: \"f9463e70-7329-4e4c-bc47-3c863e79aa19\") " pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:42:12.948006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:12.947972    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:13.120922 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.120880    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:13.133412 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.133390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7sc2s\""
Sep 17 21:42:13.140715 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.140694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:42:13.171135 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.171006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmmb9"]
Sep 17 21:42:13.173964 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:13.173928    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode608f059_87f0_4200_b697_b41ce99eca5d.slice/crio-edb00e180e4349b9333da030dee96f17b89cac6f3746a8f13401876948221fbf WatchSource:0}: Error finding container edb00e180e4349b9333da030dee96f17b89cac6f3746a8f13401876948221fbf: Status 404 returned error can't find the container with id edb00e180e4349b9333da030dee96f17b89cac6f3746a8f13401876948221fbf
Sep 17 21:42:13.212732 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.212689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:13.212904 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:13.212800    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:42:13.212904 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.212798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:13.212904 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:13.212863    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:21.212845387 +0000 UTC m=+74.734410298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : configmap "kube-rbac-proxy" not found
Sep 17 21:42:13.212904 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:13.212893    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:13.213051 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:13.212956    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:21.212939476 +0000 UTC m=+74.734504403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:13.418008 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.417972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmmb9" event={"ID":"e608f059-87f0-4200-b697-b41ce99eca5d","Type":"ContainerStarted","Data":"edb00e180e4349b9333da030dee96f17b89cac6f3746a8f13401876948221fbf"}
Sep 17 21:42:13.446633 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.446565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8wzrt"]
Sep 17 21:42:13.449923 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:13.449899    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9463e70_7329_4e4c_bc47_3c863e79aa19.slice/crio-2fa4eb735e32662feac0a953e2303f8b7a4e6629b68f95b847a27d92c1e381e2 WatchSource:0}: Error finding container 2fa4eb735e32662feac0a953e2303f8b7a4e6629b68f95b847a27d92c1e381e2: Status 404 returned error can't find the container with id 2fa4eb735e32662feac0a953e2303f8b7a4e6629b68f95b847a27d92c1e381e2
Sep 17 21:42:13.499640 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:13.499617    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:14.091881 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.091846    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:14.122298 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.122253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:42:14.122497 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.122408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:42:14.122497 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.122449    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:42:14.122497 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.122474    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f97fcc679-k8bnp: secret "image-registry-tls" not found
Sep 17 21:42:14.122616 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.122550    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls podName:231aac8e-9777-4869-83f0-62de59ea935d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:46.122526327 +0000 UTC m=+99.644091242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls") pod "image-registry-f97fcc679-k8bnp" (UID: "231aac8e-9777-4869-83f0-62de59ea935d") : secret "image-registry-tls" not found
Sep 17 21:42:14.122616 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.122554    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:42:14.122616 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.122604    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls podName:adca5dc3-ad89-45ad-b05a-4166ac3f40de nodeName:}" failed. No retries permitted until 2026-09-17 21:42:46.122587871 +0000 UTC m=+99.644152779 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls") pod "dns-default-54f7p" (UID: "adca5dc3-ad89-45ad-b05a-4166ac3f40de") : secret "dns-default-metrics-tls" not found
Sep 17 21:42:14.295584 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.295550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:14.378841 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.378741    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:42:14.379232 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.379214    2580 scope.go:117] "RemoveContainer" containerID="06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf"
Sep 17 21:42:14.379430 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.379402    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-m58ph_openshift-console-operator(cdad6dfd-e180-4780-97e3-7a06826ff952)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952"
Sep 17 21:42:14.423170 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.423134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8wzrt" event={"ID":"f9463e70-7329-4e4c-bc47-3c863e79aa19","Type":"ContainerStarted","Data":"6d5f9c807811c7c630e7d2360e93f979d8cd8941bab0d5f7736cacdb4663fe42"}
Sep 17 21:42:14.423608 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.423192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8wzrt" event={"ID":"f9463e70-7329-4e4c-bc47-3c863e79aa19","Type":"ContainerStarted","Data":"2fa4eb735e32662feac0a953e2303f8b7a4e6629b68f95b847a27d92c1e381e2"}
Sep 17 21:42:14.423608 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.423269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:42:14.446903 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.446844    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8wzrt" podStartSLOduration=67.446821648 podStartE2EDuration="1m7.446821648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:14.445220945 +0000 UTC m=+67.966785920" watchObservedRunningTime="2026-09-17 21:42:14.446821648 +0000 UTC m=+67.968386579"
Sep 17 21:42:14.627712 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.627678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:42:14.627906 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.627841    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:14.627969 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.627911    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls podName:67b3c9a6-6688-488b-8ee1-222152f6793a nodeName:}" failed. No retries permitted until 2026-09-17 21:42:30.627893707 +0000 UTC m=+84.149458618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-65d6h" (UID: "67b3c9a6-6688-488b-8ee1-222152f6793a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:42:14.692094 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.691999    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:14.728748 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.728710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:14.728748 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.728755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:42:14.728988 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.728838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:14.728988 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.728919    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:30.728898573 +0000 UTC m=+84.250463486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : configmap references non-existent config key: service-ca.crt
Sep 17 21:42:14.729093 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.729021    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:42:14.729093 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:14.729083    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs podName:1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d nodeName:}" failed. No retries permitted until 2026-09-17 21:42:30.72906725 +0000 UTC m=+84.250632164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs") pod "router-default-8498d4ff98-642dx" (UID: "1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d") : secret "router-metrics-certs-default" not found
Sep 17 21:42:14.732158 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.732135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a7113ad-edec-42e3-953a-6ebfd6572930-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-vc98b\" (UID: \"3a7113ad-edec-42e3-953a-6ebfd6572930\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:42:14.771082 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.771055    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-92t7n\""
Sep 17 21:42:14.778394 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.778360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"
Sep 17 21:42:14.888055 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:14.888023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:15.059522 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:15.059488    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b"]
Sep 17 21:42:15.100448 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:15.100421    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:15.428690 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:15.428585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b" event={"ID":"3a7113ad-edec-42e3-953a-6ebfd6572930","Type":"ContainerStarted","Data":"f3b447d1114f4a72f0d51fa4d7c145531fd9d1c1a8ef8be452f45fb4cfddfa45"}
Sep 17 21:42:15.483696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:15.483641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:15.887605 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:15.887547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:16.102434 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:16.102392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:16.200248 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:16.200151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:16.518742 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:16.518684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:16.655986 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:16.655948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:16.757476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:16.757438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:16.888157 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:16.888078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:16.949936 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:16.949898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:17.369584 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:17.369546    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:17.889912 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:17.889880    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:18.286812 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.286779    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:18.441203 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.441167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b" event={"ID":"3a7113ad-edec-42e3-953a-6ebfd6572930","Type":"ContainerStarted","Data":"620497098a3bf812fe8f695a738bd58cd069b32691ecbed633fec24ff1ee8d9e"}
Sep 17 21:42:18.441410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.441223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b" event={"ID":"3a7113ad-edec-42e3-953a-6ebfd6572930","Type":"ContainerStarted","Data":"c614889cc3c77f981f84c3e79a80ad590c690f9339d864aa21e13e0bd6e391c5"}
Sep 17 21:42:18.442588 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.442566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmmb9" event={"ID":"e608f059-87f0-4200-b697-b41ce99eca5d","Type":"ContainerStarted","Data":"25c01caafef5e50495a8a4891b0dc057e1f1b8c485def686f870469613209283"}
Sep 17 21:42:18.458669 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.458612    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-vc98b" podStartSLOduration=17.71495374 podStartE2EDuration="20.458598678s" totalImagesPullingTime="2.743644938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:18.458220882 +0000 UTC m=+71.979785836" watchObservedRunningTime="2026-09-17 21:42:18.458598678 +0000 UTC m=+71.980163650"
Sep 17 21:42:18.474140 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.474100    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vmmb9" podStartSLOduration=66.796693516 podStartE2EDuration="1m11.474083469s" totalImagesPullingTime="4.677389953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:18.473167356 +0000 UTC m=+71.994732287" watchObservedRunningTime="2026-09-17 21:42:18.474083469 +0000 UTC m=+71.995648404"
Sep 17 21:42:18.623434 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.623348    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:18.724612 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.724581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:18.953676 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:18.953577    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:19.285769 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:19.285737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:19.685741 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:19.685627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:20.288411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:20.288379    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:20.676538 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:20.676451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:20.798751 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:20.798716    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:20.895604 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:20.895567    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:21.290714 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:21.290642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:21.291201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:21.290759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:21.291201 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:21.290911    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:21.291201 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:21.290982    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls podName:90241366-f8ac-4d7a-ab4b-1ad5c28d8419 nodeName:}" failed. No retries permitted until 2026-09-17 21:42:37.29096334 +0000 UTC m=+90.812528251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4k6ps" (UID: "90241366-f8ac-4d7a-ab4b-1ad5c28d8419") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:42:21.291201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:21.291134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:21.478953 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:21.478921    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:21.877484 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:21.877454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:22.284775 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:22.284739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:22.497760 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:22.497714    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:22.561166 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:22.561077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:22.680995 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:22.680955    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:22.896316 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:22.896221    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:23.086644 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:23.086610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:27.021048 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:27.021012    2580 scope.go:117] "RemoveContainer" containerID="06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf"
Sep 17 21:42:27.475421 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:27.475350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:42:27.475777 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:27.475760    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/1.log"
Sep 17 21:42:27.475882 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:27.475797    2580 generic.go:356] "Generic (PLEG): container finished" podID="cdad6dfd-e180-4780-97e3-7a06826ff952" containerID="6b84373ca8ea47d0167a45afeb212c2d828298c2e87331fa104fac34f88e3314" exitCode=255
Sep 17 21:42:27.475882 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:27.475867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" event={"ID":"cdad6dfd-e180-4780-97e3-7a06826ff952","Type":"ContainerDied","Data":"6b84373ca8ea47d0167a45afeb212c2d828298c2e87331fa104fac34f88e3314"}
Sep 17 21:42:27.475972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:27.475944    2580 scope.go:117] "RemoveContainer" containerID="06e9c28b681a60ee35f1ac1484288c18c6ceca19a8259e14b576be46ddb1b8bf"
Sep 17 21:42:27.476237 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:27.476222    2580 scope.go:117] "RemoveContainer" containerID="6b84373ca8ea47d0167a45afeb212c2d828298c2e87331fa104fac34f88e3314"
Sep 17 21:42:27.476428 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:27.476409    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-m58ph_openshift-console-operator(cdad6dfd-e180-4780-97e3-7a06826ff952)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952"
Sep 17 21:42:28.480449 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:28.480349    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:42:29.049492 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:29.049463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:42:29.049810 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:29.049796    2580 scope.go:117] "RemoveContainer" containerID="6b84373ca8ea47d0167a45afeb212c2d828298c2e87331fa104fac34f88e3314"
Sep 17 21:42:29.049959 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:29.049941    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-m58ph_openshift-console-operator(cdad6dfd-e180-4780-97e3-7a06826ff952)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952"
Sep 17 21:42:30.668813 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.668774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:42:30.671285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.671264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67b3c9a6-6688-488b-8ee1-222152f6793a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-65d6h\" (UID: \"67b3c9a6-6688-488b-8ee1-222152f6793a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:42:30.770081 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.770047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:30.770252 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.770117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:30.770694 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.770645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-service-ca-bundle\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:30.772621 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.772600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d-metrics-certs\") pod \"router-default-8498d4ff98-642dx\" (UID: \"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d\") " pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:30.838773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.838742    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m5n4z\""
Sep 17 21:42:30.846841 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.846814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"
Sep 17 21:42:30.987987 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.987910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9fngz\""
Sep 17 21:42:30.995809 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:30.995789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:31.115991 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.115814    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h"]
Sep 17 21:42:31.118372 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:31.118346    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b3c9a6_6688_488b_8ee1_222152f6793a.slice/crio-0e1c476c2c03b763d722297c069974ecb097b2f8390f841283d887504d0ddd38 WatchSource:0}: Error finding container 0e1c476c2c03b763d722297c069974ecb097b2f8390f841283d887504d0ddd38: Status 404 returned error can't find the container with id 0e1c476c2c03b763d722297c069974ecb097b2f8390f841283d887504d0ddd38
Sep 17 21:42:31.267363 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.267340    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8498d4ff98-642dx"]
Sep 17 21:42:31.271132 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:31.271109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac9c6cb_5cb5_485e_ba9f_49a59b690e4d.slice/crio-41fe1c422044797bf12ffe9b6d3cffd82a484bac0cf660b8c02dac775893ccdd WatchSource:0}: Error finding container 41fe1c422044797bf12ffe9b6d3cffd82a484bac0cf660b8c02dac775893ccdd: Status 404 returned error can't find the container with id 41fe1c422044797bf12ffe9b6d3cffd82a484bac0cf660b8c02dac775893ccdd
Sep 17 21:42:31.493363 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.493331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8498d4ff98-642dx" event={"ID":"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d","Type":"ContainerStarted","Data":"04faebdea56a9157bc8692fc9f50f4e54999a43d2acc9adbac0376dcb854032c"}
Sep 17 21:42:31.493552 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.493388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8498d4ff98-642dx" event={"ID":"1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d","Type":"ContainerStarted","Data":"41fe1c422044797bf12ffe9b6d3cffd82a484bac0cf660b8c02dac775893ccdd"}
Sep 17 21:42:31.494623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.494602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h" event={"ID":"67b3c9a6-6688-488b-8ee1-222152f6793a","Type":"ContainerStarted","Data":"0e1c476c2c03b763d722297c069974ecb097b2f8390f841283d887504d0ddd38"}
Sep 17 21:42:31.515737 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.515613    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8498d4ff98-642dx" podStartSLOduration=33.515591321 podStartE2EDuration="33.515591321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:31.515186898 +0000 UTC m=+85.036751846" watchObservedRunningTime="2026-09-17 21:42:31.515591321 +0000 UTC m=+85.037156246"
Sep 17 21:42:31.821371 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.821339    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"]
Sep 17 21:42:31.823865 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.823846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:31.839030 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.839008    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-72jbn\""
Sep 17 21:42:31.839306 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.839286    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 21:42:31.847578 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.847561    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 21:42:31.896532 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.896500    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"]
Sep 17 21:42:31.980962 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.980917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3707ed37-65a1-4eff-936d-51675e2ca043-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-cz4df\" (UID: \"3707ed37-65a1-4eff-936d-51675e2ca043\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:31.981138 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.981045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3707ed37-65a1-4eff-936d-51675e2ca043-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-cz4df\" (UID: \"3707ed37-65a1-4eff-936d-51675e2ca043\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:31.996925 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.996894    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:31.999861 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:31.999835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:32.035042 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.035012    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:32.084048 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.082208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3707ed37-65a1-4eff-936d-51675e2ca043-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-cz4df\" (UID: \"3707ed37-65a1-4eff-936d-51675e2ca043\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:32.084048 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.082319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3707ed37-65a1-4eff-936d-51675e2ca043-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-cz4df\" (UID: \"3707ed37-65a1-4eff-936d-51675e2ca043\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:32.086382 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.084620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3707ed37-65a1-4eff-936d-51675e2ca043-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-cz4df\" (UID: \"3707ed37-65a1-4eff-936d-51675e2ca043\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:32.087266 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.087219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3707ed37-65a1-4eff-936d-51675e2ca043-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-cz4df\" (UID: \"3707ed37-65a1-4eff-936d-51675e2ca043\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:32.132209 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.132171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"
Sep 17 21:42:32.134548 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.134462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:32.250797 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.250761    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:32.349359 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.349282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:32.415220 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.415187    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-cz4df"]
Sep 17 21:42:32.419757 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:32.419723    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3707ed37_65a1_4eff_936d_51675e2ca043.slice/crio-8b07f100937ba4318f393142687f69bcd8c3654bcda268f6fea9bfe1f82c21d6 WatchSource:0}: Error finding container 8b07f100937ba4318f393142687f69bcd8c3654bcda268f6fea9bfe1f82c21d6: Status 404 returned error can't find the container with id 8b07f100937ba4318f393142687f69bcd8c3654bcda268f6fea9bfe1f82c21d6
Sep 17 21:42:32.480264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.480228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:32.500241 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.500198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df" event={"ID":"3707ed37-65a1-4eff-936d-51675e2ca043","Type":"ContainerStarted","Data":"8b07f100937ba4318f393142687f69bcd8c3654bcda268f6fea9bfe1f82c21d6"}
Sep 17 21:42:32.500462 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.500429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:32.501772 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:32.501748    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8498d4ff98-642dx"
Sep 17 21:42:33.442237 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:33.442157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:33.507530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:33.507492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h" event={"ID":"67b3c9a6-6688-488b-8ee1-222152f6793a","Type":"ContainerStarted","Data":"6f3be40ec6754737da927f1e876e6ddcafa6c8720d30c55102c8907f68ac97dc"}
Sep 17 21:42:33.542216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:33.542153    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-65d6h" podStartSLOduration=33.549542104 podStartE2EDuration="35.542127982s" totalImagesPullingTime="1.992585878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:33.541329446 +0000 UTC m=+87.062894396" watchObservedRunningTime="2026-09-17 21:42:33.542127982 +0000 UTC m=+87.063692911"
Sep 17 21:42:33.573553 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:33.573504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:33.704972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:33.704852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:34.077197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:34.077143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:34.379166 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:34.379115    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:42:34.379528 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:34.379515    2580 scope.go:117] "RemoveContainer" containerID="6b84373ca8ea47d0167a45afeb212c2d828298c2e87331fa104fac34f88e3314"
Sep 17 21:42:34.379703 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:42:34.379685    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-m58ph_openshift-console-operator(cdad6dfd-e180-4780-97e3-7a06826ff952)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" podUID="cdad6dfd-e180-4780-97e3-7a06826ff952"
Sep 17 21:42:34.512689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:34.512636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df" event={"ID":"3707ed37-65a1-4eff-936d-51675e2ca043","Type":"ContainerStarted","Data":"e1887c12e556d3da0b361902e5309bde2c0beaa4438d67c5a9fd787490bb4a50"}
Sep 17 21:42:34.710681 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:34.710573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:34.796469 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:34.796424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:37.175953 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.175914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:37.242206 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.242174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:37.331224 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.331189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:37.333605 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.333573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90241366-f8ac-4d7a-ab4b-1ad5c28d8419-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4k6ps\" (UID: \"90241366-f8ac-4d7a-ab4b-1ad5c28d8419\") " pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:37.615787 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.615755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5wn52\""
Sep 17 21:42:37.623160 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.623139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4k6ps"
Sep 17 21:42:37.930079 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.929942    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-cz4df" podStartSLOduration=5.4303344 podStartE2EDuration="6.929925761s" totalImagesPullingTime="1.499591361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:34.534504087 +0000 UTC m=+88.056069007" watchObservedRunningTime="2026-09-17 21:42:37.929925761 +0000 UTC m=+91.451490729"
Sep 17 21:42:37.930488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:37.930469    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4k6ps"]
Sep 17 21:42:37.933922 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:37.933895    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90241366_f8ac_4d7a_ab4b_1ad5c28d8419.slice/crio-74591b140d95aa88d03032f3bb5bb52021e812823bb67b32c9a7b9e60ecc7c6e WatchSource:0}: Error finding container 74591b140d95aa88d03032f3bb5bb52021e812823bb67b32c9a7b9e60ecc7c6e: Status 404 returned error can't find the container with id 74591b140d95aa88d03032f3bb5bb52021e812823bb67b32c9a7b9e60ecc7c6e
Sep 17 21:42:38.327594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:38.327559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:38.400325 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:38.400288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:38.527787 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:38.527754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4k6ps" event={"ID":"90241366-f8ac-4d7a-ab4b-1ad5c28d8419","Type":"ContainerStarted","Data":"66570bb690bb3df53d7459037b583d01749163394aaf9f6c901f731a5f8f2d41"}
Sep 17 21:42:38.527940 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:38.527810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4k6ps" event={"ID":"90241366-f8ac-4d7a-ab4b-1ad5c28d8419","Type":"ContainerStarted","Data":"74591b140d95aa88d03032f3bb5bb52021e812823bb67b32c9a7b9e60ecc7c6e"}
Sep 17 21:42:38.755503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:38.755430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:38.860584 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:38.860552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:39.004614 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:39.004578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:39.533219 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:39.533187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4k6ps" event={"ID":"90241366-f8ac-4d7a-ab4b-1ad5c28d8419","Type":"ContainerStarted","Data":"c0047956858313bc517fdca70fd60dc091b8b9b00910a932d7ce01c0c9a93781"}
Sep 17 21:42:40.934682 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:40.934589    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:41.267211 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:41.267184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:41.370298 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:41.370267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:41.541812 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:41.541728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4k6ps" event={"ID":"90241366-f8ac-4d7a-ab4b-1ad5c28d8419","Type":"ContainerStarted","Data":"fdb5ec547c6778dbd8f0550030c79e934b94c023d6c98b77833b92d62445f084"}
Sep 17 21:42:41.563851 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:41.563799    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4k6ps" podStartSLOduration=34.224320568 podStartE2EDuration="36.563783252s" totalImagesPullingTime="2.339462684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:42:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:41.562049262 +0000 UTC m=+95.083614207" watchObservedRunningTime="2026-09-17 21:42:41.563783252 +0000 UTC m=+95.085348182"
Sep 17 21:42:42.922710 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:42.922678    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:43.205052 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.204970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:43.316956 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.316923    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dgfpc"]
Sep 17 21:42:43.319374 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.319297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.320922 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.320882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:43.322275 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.322249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 21:42:43.322275 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.322268    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 21:42:43.322469 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.322287    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 21:42:43.322469 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.322294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tv9nv\""
Sep 17 21:42:43.323933 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.323917    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 21:42:43.379867 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.379831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-wtmp\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380017 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.379884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac934d9f-931a-4cd3-81c6-54cba9c465fc-metrics-client-ca\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380017 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.379926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380017 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.379988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-textfile\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380126 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.380021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380126 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.380054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-root\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380126 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.380072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87s9\" (UniqueName: \"kubernetes.io/projected/ac934d9f-931a-4cd3-81c6-54cba9c465fc-kube-api-access-z87s9\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380239 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.380151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-tls\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.380239 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.380178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-sys\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.467103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.466987    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:43.481058 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-tls\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-sys\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-wtmp\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac934d9f-931a-4cd3-81c6-54cba9c465fc-metrics-client-ca\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-sys\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-textfile\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-root\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-wtmp\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87s9\" (UniqueName: \"kubernetes.io/projected/ac934d9f-931a-4cd3-81c6-54cba9c465fc-kube-api-access-z87s9\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac934d9f-931a-4cd3-81c6-54cba9c465fc-root\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481735 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-textfile\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481827 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.481943 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.481875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac934d9f-931a-4cd3-81c6-54cba9c465fc-metrics-client-ca\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.483672 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.483632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.483780 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.483764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac934d9f-931a-4cd3-81c6-54cba9c465fc-node-exporter-tls\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.490287 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.490262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87s9\" (UniqueName: \"kubernetes.io/projected/ac934d9f-931a-4cd3-81c6-54cba9c465fc-kube-api-access-z87s9\") pod \"node-exporter-dgfpc\" (UID: \"ac934d9f-931a-4cd3-81c6-54cba9c465fc\") " pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.568299 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.568263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:43.628449 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.628422    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgfpc"
Sep 17 21:42:43.639167 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:43.639138    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac934d9f_931a_4cd3_81c6_54cba9c465fc.slice/crio-85d525609c61ae70747636f5fac36899db7f23829c9366c3b6926ace7294eca4 WatchSource:0}: Error finding container 85d525609c61ae70747636f5fac36899db7f23829c9366c3b6926ace7294eca4: Status 404 returned error can't find the container with id 85d525609c61ae70747636f5fac36899db7f23829c9366c3b6926ace7294eca4
Sep 17 21:42:43.665417 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.665378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:43.766017 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.765923    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:43.867706 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:43.867652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:44.075613 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:44.075579    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:44.176080 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:44.176049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:44.307318 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:44.307284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:44.493243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:44.493157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:44.552957 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:44.552919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgfpc" event={"ID":"ac934d9f-931a-4cd3-81c6-54cba9c465fc","Type":"ContainerStarted","Data":"85d525609c61ae70747636f5fac36899db7f23829c9366c3b6926ace7294eca4"}
Sep 17 21:42:45.431512 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:45.431482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8wzrt"
Sep 17 21:42:45.558488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:45.558453    2580 generic.go:356] "Generic (PLEG): container finished" podID="ac934d9f-931a-4cd3-81c6-54cba9c465fc" containerID="8f96e8998807e0426329a7612a96c41d615cb7796935b0ef9d1d59da556898d0" exitCode=0
Sep 17 21:42:45.558678 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:45.558495    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgfpc" event={"ID":"ac934d9f-931a-4cd3-81c6-54cba9c465fc","Type":"ContainerDied","Data":"8f96e8998807e0426329a7612a96c41d615cb7796935b0ef9d1d59da556898d0"}
Sep 17 21:42:46.207387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.207350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:42:46.207555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.207417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:42:46.209895 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.209866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adca5dc3-ad89-45ad-b05a-4166ac3f40de-metrics-tls\") pod \"dns-default-54f7p\" (UID: \"adca5dc3-ad89-45ad-b05a-4166ac3f40de\") " pod="openshift-dns/dns-default-54f7p"
Sep 17 21:42:46.210041 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.209988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"image-registry-f97fcc679-k8bnp\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") " pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:42:46.441508 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.441480    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fbg5w\""
Sep 17 21:42:46.449160 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.449141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:42:46.456067 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.456043    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-csvq4\""
Sep 17 21:42:46.463147 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.463113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-54f7p"
Sep 17 21:42:46.556611 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.556555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:46.564305 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.564279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgfpc" event={"ID":"ac934d9f-931a-4cd3-81c6-54cba9c465fc","Type":"ContainerStarted","Data":"7e84e589ec6fe69f4dae461505d89163372b09913b17ca0a85c65131b88a773d"}
Sep 17 21:42:46.564456 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.564328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgfpc" event={"ID":"ac934d9f-931a-4cd3-81c6-54cba9c465fc","Type":"ContainerStarted","Data":"982e9ac683644564e0830e3e1d5c1c30ec768154c54a5854e18ffda426e5eb6d"}
Sep 17 21:42:46.687812 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.687770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:46.745978 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.745932    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dgfpc" podStartSLOduration=2.522348037 podStartE2EDuration="3.745912957s" totalImagesPullingTime="1.151905076s" totalInitContainerRuntime="71.659844ms" isStatefulPod=true podCreationTimestamp="2026-09-17 21:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:46.603132061 +0000 UTC m=+100.124697010" watchObservedRunningTime="2026-09-17 21:42:46.745912957 +0000 UTC m=+100.267477887"
Sep 17 21:42:46.746151 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.746129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f97fcc679-k8bnp"]
Sep 17 21:42:46.747834 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:46.747805    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231aac8e_9777_4869_83f0_62de59ea935d.slice/crio-48979874bf5210f009455f3e9a48e43adf8a89d9bf3866a735b55e65b5f4196a WatchSource:0}: Error finding container 48979874bf5210f009455f3e9a48e43adf8a89d9bf3866a735b55e65b5f4196a: Status 404 returned error can't find the container with id 48979874bf5210f009455f3e9a48e43adf8a89d9bf3866a735b55e65b5f4196a
Sep 17 21:42:46.767584 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:46.767561    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-54f7p"]
Sep 17 21:42:46.773610 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:42:46.773587    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadca5dc3_ad89_45ad_b05a_4166ac3f40de.slice/crio-3d833b956b1f1cf44af1786020efe09989d2518b68ad270a86a35c37115dcede WatchSource:0}: Error finding container 3d833b956b1f1cf44af1786020efe09989d2518b68ad270a86a35c37115dcede: Status 404 returned error can't find the container with id 3d833b956b1f1cf44af1786020efe09989d2518b68ad270a86a35c37115dcede
Sep 17 21:42:47.151599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:47.151551    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:47.406109 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:47.405993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:47.569470 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:47.569435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54f7p" event={"ID":"adca5dc3-ad89-45ad-b05a-4166ac3f40de","Type":"ContainerStarted","Data":"3d833b956b1f1cf44af1786020efe09989d2518b68ad270a86a35c37115dcede"}
Sep 17 21:42:47.571406 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:47.571367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp" event={"ID":"231aac8e-9777-4869-83f0-62de59ea935d","Type":"ContainerStarted","Data":"8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079"}
Sep 17 21:42:47.571530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:47.571417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp" event={"ID":"231aac8e-9777-4869-83f0-62de59ea935d","Type":"ContainerStarted","Data":"48979874bf5210f009455f3e9a48e43adf8a89d9bf3866a735b55e65b5f4196a"}
Sep 17 21:42:47.571840 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:47.571824    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:42:47.736305 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:47.736196    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp" podStartSLOduration=100.736178481 podStartE2EDuration="1m40.736178481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:47.735177435 +0000 UTC m=+101.256742389" watchObservedRunningTime="2026-09-17 21:42:47.736178481 +0000 UTC m=+101.257743402"
Sep 17 21:42:48.019229 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.019202    2580 scope.go:117] "RemoveContainer" containerID="6b84373ca8ea47d0167a45afeb212c2d828298c2e87331fa104fac34f88e3314"
Sep 17 21:42:48.066725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.066696    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:48.492232 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.492137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:48.577221 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.577200    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:42:48.577597 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.577323    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph" event={"ID":"cdad6dfd-e180-4780-97e3-7a06826ff952","Type":"ContainerStarted","Data":"5e02c37ff950ded1003563a808c2ee4c96ee46d5856779206bdb9ba3507d8ff3"}
Sep 17 21:42:48.577790 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.577775    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:42:48.627229 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.627190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:48.676617 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.676596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-m58ph"
Sep 17 21:42:48.963749 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:48.963719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:49.039330 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.039300    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:49.211317 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.211289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:49.552500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.552470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:49.582644 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.582614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54f7p" event={"ID":"adca5dc3-ad89-45ad-b05a-4166ac3f40de","Type":"ContainerStarted","Data":"4637da8e59fba4133e704e77085c6ea58750effa8afa2e6f5221f10c8058762a"}
Sep 17 21:42:49.583080 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.582683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54f7p" event={"ID":"adca5dc3-ad89-45ad-b05a-4166ac3f40de","Type":"ContainerStarted","Data":"6b0b49d8b2a255408efd75fc307e3b2bad75560985e7f21b0aeca7e35c11788c"}
Sep 17 21:42:49.606049 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.606002    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-54f7p" podStartSLOduration=65.804368477 podStartE2EDuration="1m7.60598706s" totalImagesPullingTime="1.801618583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:42:49.604216342 +0000 UTC m=+103.125781290" watchObservedRunningTime="2026-09-17 21:42:49.60598706 +0000 UTC m=+103.127551991"
Sep 17 21:42:49.653150 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.653121    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:49.881597 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:49.881515    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:50.586906 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:50.586870    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-54f7p"
Sep 17 21:42:50.770843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:50.770807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:51.014514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:51.014425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:51.305238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:51.305208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:51.405000 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:51.404965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:51.793098 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:51.793065    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:51.943891 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:51.943863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:52.504894 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:52.504864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:52.606613 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:52.606576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:54.430097 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:54.430065    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:54.571477 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:54.571440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:55.325720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:55.325686    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f97fcc679-k8bnp"]
Sep 17 21:42:55.520278 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:55.520237    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:55.643798 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:55.643703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:55.742220 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:55.742191    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:56.226845 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:56.226818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:56.380491 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:56.380458    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:58.783879 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:58.783848    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:42:58.843501 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:42:58.843463    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:00.556448 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.556412    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54ff4fddc9-86zk6"]
Sep 17 21:43:00.558738 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.558721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.561399 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.561376    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 21:43:00.561525 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.561421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 21:43:00.562474 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.562459    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 21:43:00.562579 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.562555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 21:43:00.562639 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.562592    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5hrpx\""
Sep 17 21:43:00.562718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.562559    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 21:43:00.562718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.562652    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 21:43:00.562971 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.562958    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 21:43:00.569497 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.569469    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ff4fddc9-86zk6"]
Sep 17 21:43:00.591940 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.591918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-54f7p"
Sep 17 21:43:00.635570 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.635538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-service-ca\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.635791 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.635592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-config\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.635791 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.635706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-serving-cert\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.635791 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.635747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-oauth-serving-cert\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.635968 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.635797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-oauth-config\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.635968 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.635835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvkzk\" (UniqueName: \"kubernetes.io/projected/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-kube-api-access-bvkzk\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.736971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-config\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737198 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.737024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-serving-cert\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737198 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.737064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-oauth-serving-cert\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737198 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.737101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-oauth-config\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737198 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.737132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvkzk\" (UniqueName: \"kubernetes.io/projected/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-kube-api-access-bvkzk\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737365 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.737200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-service-ca\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737906 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.737875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-config\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.737906 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.737878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-oauth-serving-cert\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.738200 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.738179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-service-ca\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.739620 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.739601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-oauth-config\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.739727 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.739710    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-serving-cert\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.750810 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.750791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvkzk\" (UniqueName: \"kubernetes.io/projected/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-kube-api-access-bvkzk\") pod \"console-54ff4fddc9-86zk6\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") " pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:00.867875 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:00.867781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:01.139379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:01.139304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ff4fddc9-86zk6"]
Sep 17 21:43:01.142084 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:43:01.142059    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6d2049_fc11_4661_9d1d_4bfda9faac7e.slice/crio-13b578a0ec379ba815f5139de5ddc090c8a73f1cc7d09cce664572403651eb8c WatchSource:0}: Error finding container 13b578a0ec379ba815f5139de5ddc090c8a73f1cc7d09cce664572403651eb8c: Status 404 returned error can't find the container with id 13b578a0ec379ba815f5139de5ddc090c8a73f1cc7d09cce664572403651eb8c
Sep 17 21:43:01.627183 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:01.627098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4fddc9-86zk6" event={"ID":"1d6d2049-fc11-4661-9d1d-4bfda9faac7e","Type":"ContainerStarted","Data":"13b578a0ec379ba815f5139de5ddc090c8a73f1cc7d09cce664572403651eb8c"}
Sep 17 21:43:02.147072 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:02.147035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:02.225395 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:02.225363    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:02.549381 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:02.549343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:02.648735 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:02.648700    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:02.751009 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:02.750925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:05.331761 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:05.331683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:43:05.602266 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:05.602169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:05.645727 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:05.645694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4fddc9-86zk6" event={"ID":"1d6d2049-fc11-4661-9d1d-4bfda9faac7e","Type":"ContainerStarted","Data":"9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0"}
Sep 17 21:43:05.665480 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:05.665398    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54ff4fddc9-86zk6" podStartSLOduration=1.7290971960000001 podStartE2EDuration="5.665379492s" totalImagesPullingTime="3.936282296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:43:05.664007516 +0000 UTC m=+119.185572446" watchObservedRunningTime="2026-09-17 21:43:05.665379492 +0000 UTC m=+119.186944421"
Sep 17 21:43:05.672815 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:05.672784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:07.512867 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:07.512830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:07.650710 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:07.650678    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:09.733979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:09.733931    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:09.834393 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:09.834326    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:10.195416 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.195385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:10.262032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.261999    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:10.671336 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.671301    2580 generic.go:356] "Generic (PLEG): container finished" podID="59951536-e55e-4983-9214-500e766b3f17" containerID="6f07fcfb62c46cf6d53bda6dc080325c865683fdff2acf8eb43d08e2b4d453ac" exitCode=0
Sep 17 21:43:10.671336 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.671340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs" event={"ID":"59951536-e55e-4983-9214-500e766b3f17","Type":"ContainerDied","Data":"6f07fcfb62c46cf6d53bda6dc080325c865683fdff2acf8eb43d08e2b4d453ac"}
Sep 17 21:43:10.671639 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.671625    2580 scope.go:117] "RemoveContainer" containerID="6f07fcfb62c46cf6d53bda6dc080325c865683fdff2acf8eb43d08e2b4d453ac"
Sep 17 21:43:10.816665 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.816616    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f85d66d-p8q5m"]
Sep 17 21:43:10.818932 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.818910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:10.826839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.826813    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 21:43:10.832854 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.832832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f85d66d-p8q5m"]
Sep 17 21:43:10.867916 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.867866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:10.868119 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.867941    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:10.872889 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.872863    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:10.926323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.926230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-config\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:10.926323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.926283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-oauth-config\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:10.926323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.926318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-service-ca\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:10.926564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.926335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-trusted-ca-bundle\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:10.926564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.926370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-oauth-serving-cert\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:10.926564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.926396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-serving-cert\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:10.926564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:10.926435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfcr\" (UniqueName: \"kubernetes.io/projected/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-kube-api-access-rxfcr\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.027141 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.027103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfcr\" (UniqueName: \"kubernetes.io/projected/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-kube-api-access-rxfcr\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.027336 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.027156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-config\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.027336 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.027224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-oauth-config\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.027336 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.027273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-service-ca\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.027336 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.027295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-trusted-ca-bundle\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.027544 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.027367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-oauth-serving-cert\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.027544 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.027395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-serving-cert\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.028233 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.028025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-config\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.028383 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.028250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-trusted-ca-bundle\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.028383 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.028353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-service-ca\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.028492 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.028451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-oauth-serving-cert\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.030053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.030030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-oauth-config\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.030407 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.030381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-serving-cert\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.036606 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.036583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfcr\" (UniqueName: \"kubernetes.io/projected/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-kube-api-access-rxfcr\") pod \"console-65f85d66d-p8q5m\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") " pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.128341 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.128297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:11.403425 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.403391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f85d66d-p8q5m"]
Sep 17 21:43:11.406763 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:43:11.406735    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a0f13b_7e75_4eb6_b9be_c8d303d0128f.slice/crio-f1804f46d34d8546a69133c210d1cc6db142bd2b234bc77c48fec20836596b2f WatchSource:0}: Error finding container f1804f46d34d8546a69133c210d1cc6db142bd2b234bc77c48fec20836596b2f: Status 404 returned error can't find the container with id f1804f46d34d8546a69133c210d1cc6db142bd2b234bc77c48fec20836596b2f
Sep 17 21:43:11.677006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.676969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zrvgs" event={"ID":"59951536-e55e-4983-9214-500e766b3f17","Type":"ContainerStarted","Data":"3798d424a6f1c1b029071ce9d466a9b1b24d8860b28ab33aaa5bd15bc56e2589"}
Sep 17 21:43:11.678602 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.678575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f85d66d-p8q5m" event={"ID":"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f","Type":"ContainerStarted","Data":"14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836"}
Sep 17 21:43:11.678750 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.678613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f85d66d-p8q5m" event={"ID":"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f","Type":"ContainerStarted","Data":"f1804f46d34d8546a69133c210d1cc6db142bd2b234bc77c48fec20836596b2f"}
Sep 17 21:43:11.682309 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.682291    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:11.731831 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:11.731725    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65f85d66d-p8q5m" podStartSLOduration=1.731706333 podStartE2EDuration="1.731706333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:43:11.730059686 +0000 UTC m=+125.251624616" watchObservedRunningTime="2026-09-17 21:43:11.731706333 +0000 UTC m=+125.253271263"
Sep 17 21:43:14.391555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:14.391523    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:14.491846 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:14.491813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:16.203517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:16.203476    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:16.275740 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:16.275703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:16.778258 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:16.778226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:43:16.780748 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:16.780711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837d276f-336d-4a93-a1fc-60e128025b09-metrics-certs\") pod \"network-metrics-daemon-r7mr2\" (UID: \"837d276f-336d-4a93-a1fc-60e128025b09\") " pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:43:16.930425 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:16.930389    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-44pmn\""
Sep 17 21:43:16.938261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:16.938235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7mr2"
Sep 17 21:43:17.213705 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:17.213601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r7mr2"]
Sep 17 21:43:17.216901 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:43:17.216866    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837d276f_336d_4a93_a1fc_60e128025b09.slice/crio-c1c8b64e2b7d305bb5db3d85d69ac67af2f146ca917e89ebd9831d87fcc89042 WatchSource:0}: Error finding container c1c8b64e2b7d305bb5db3d85d69ac67af2f146ca917e89ebd9831d87fcc89042: Status 404 returned error can't find the container with id c1c8b64e2b7d305bb5db3d85d69ac67af2f146ca917e89ebd9831d87fcc89042
Sep 17 21:43:17.703703 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:17.703648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7mr2" event={"ID":"837d276f-336d-4a93-a1fc-60e128025b09","Type":"ContainerStarted","Data":"c1c8b64e2b7d305bb5db3d85d69ac67af2f146ca917e89ebd9831d87fcc89042"}
Sep 17 21:43:18.709269 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:18.709180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7mr2" event={"ID":"837d276f-336d-4a93-a1fc-60e128025b09","Type":"ContainerStarted","Data":"83446568d102d9cde225884c74277614b9743feb46e7a6b6aff7ae15ef7253e2"}
Sep 17 21:43:18.709269 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:18.709244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7mr2" event={"ID":"837d276f-336d-4a93-a1fc-60e128025b09","Type":"ContainerStarted","Data":"6175dacfd2e85f9e7341d954cf268ca3350269196ebf4888cf4459eb824831b5"}
Sep 17 21:43:18.726674 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:18.726598    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r7mr2" podStartSLOduration=130.491703774 podStartE2EDuration="2m11.726582168s" totalImagesPullingTime="1.234878394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:43:18.725255338 +0000 UTC m=+132.246820268" watchObservedRunningTime="2026-09-17 21:43:18.726582168 +0000 UTC m=+132.248147098"
Sep 17 21:43:18.826260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:18.826227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:18.899889 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:18.899855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:19.654555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:19.654521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:19.794503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:19.794451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:19.859271 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:19.859239    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:20.345236 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.345188    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp" podUID="231aac8e-9777-4869-83f0-62de59ea935d" containerName="registry" containerID="cri-o://8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079" gracePeriod=30
Sep 17 21:43:20.591694 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.591647    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:43:20.712498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-image-registry-private-configuration\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.712498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-trusted-ca\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.712498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-registry-certificates\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.712825 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712514    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.712825 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/231aac8e-9777-4869-83f0-62de59ea935d-ca-trust-extracted\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.712825 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712648    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-installation-pull-secrets\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.712825 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712724    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw7jf\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-kube-api-access-jw7jf\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.712825 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712747    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-bound-sa-token\") pod \"231aac8e-9777-4869-83f0-62de59ea935d\" (UID: \"231aac8e-9777-4869-83f0-62de59ea935d\") "
Sep 17 21:43:20.713104 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.712993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:43:20.713162 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.713020    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:43:20.715674 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.715601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:43:20.715801 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.715712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:43:20.715864 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.715812    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-kube-api-access-jw7jf" (OuterVolumeSpecName: "kube-api-access-jw7jf") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "kube-api-access-jw7jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:43:20.715864 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.715811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:43:20.715968 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.715916    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:43:20.719854 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.719827    2580 generic.go:356] "Generic (PLEG): container finished" podID="231aac8e-9777-4869-83f0-62de59ea935d" containerID="8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079" exitCode=0
Sep 17 21:43:20.719979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.719924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp" event={"ID":"231aac8e-9777-4869-83f0-62de59ea935d","Type":"ContainerDied","Data":"8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079"}
Sep 17 21:43:20.719979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.719934    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp"
Sep 17 21:43:20.719979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.719975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f97fcc679-k8bnp" event={"ID":"231aac8e-9777-4869-83f0-62de59ea935d","Type":"ContainerDied","Data":"48979874bf5210f009455f3e9a48e43adf8a89d9bf3866a735b55e65b5f4196a"}
Sep 17 21:43:20.720101 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.720002    2580 scope.go:117] "RemoveContainer" containerID="8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079"
Sep 17 21:43:20.722345 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.722320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231aac8e-9777-4869-83f0-62de59ea935d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "231aac8e-9777-4869-83f0-62de59ea935d" (UID: "231aac8e-9777-4869-83f0-62de59ea935d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:43:20.733139 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.733121    2580 scope.go:117] "RemoveContainer" containerID="8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079"
Sep 17 21:43:20.733595 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:43:20.733573    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079\": container with ID starting with 8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079 not found: ID does not exist" containerID="8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079"
Sep 17 21:43:20.733697 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.733603    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079"} err="failed to get container status \"8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079\": rpc error: code = NotFound desc = could not find container \"8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079\": container with ID starting with 8299acd6ecfea57a85d69c769ddd5630e5a226a3bf9a55a7d208839b9f988079 not found: ID does not exist"
Sep 17 21:43:20.814001 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.813966    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-registry-certificates\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:20.814001 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.813996    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-registry-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:20.814001 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.814006    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/231aac8e-9777-4869-83f0-62de59ea935d-ca-trust-extracted\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:20.814382 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.814015    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-installation-pull-secrets\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:20.814382 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.814027    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw7jf\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-kube-api-access-jw7jf\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:20.814382 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.814035    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/231aac8e-9777-4869-83f0-62de59ea935d-bound-sa-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:20.814382 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.814043    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/231aac8e-9777-4869-83f0-62de59ea935d-image-registry-private-configuration\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:20.814382 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:20.814052    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/231aac8e-9777-4869-83f0-62de59ea935d-trusted-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:21.047806 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.047770    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f97fcc679-k8bnp"]
Sep 17 21:43:21.055523 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.055494    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f97fcc679-k8bnp"]
Sep 17 21:43:21.128485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.128446    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:21.128708 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.128508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:21.133311 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.133290    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:21.725771 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.725675    2580 generic.go:356] "Generic (PLEG): container finished" podID="11ebd6a7-5c96-4eba-80ef-919755bfc1da" containerID="201410e3c034c37b9009b9f6437976529230574baf4814a857ef6a0eeb0e19b8" exitCode=0
Sep 17 21:43:21.725771 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.725741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58" event={"ID":"11ebd6a7-5c96-4eba-80ef-919755bfc1da","Type":"ContainerDied","Data":"201410e3c034c37b9009b9f6437976529230574baf4814a857ef6a0eeb0e19b8"}
Sep 17 21:43:21.726099 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.726078    2580 scope.go:117] "RemoveContainer" containerID="201410e3c034c37b9009b9f6437976529230574baf4814a857ef6a0eeb0e19b8"
Sep 17 21:43:21.730915 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.730892    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:43:21.827803 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:21.827773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ff4fddc9-86zk6"]
Sep 17 21:43:22.510322 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:22.510292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:22.610331 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:22.610297    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:22.733189 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:22.733153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-twf58" event={"ID":"11ebd6a7-5c96-4eba-80ef-919755bfc1da","Type":"ContainerStarted","Data":"19f55733694989365292910568d42a814ac2922f22ac16dca4c9da8fa22082a9"}
Sep 17 21:43:23.024143 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:23.024110    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231aac8e-9777-4869-83f0-62de59ea935d" path="/var/lib/kubelet/pods/231aac8e-9777-4869-83f0-62de59ea935d/volumes"
Sep 17 21:43:24.195471 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:24.195422    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:24.263749 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:24.263692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:25.219424 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:25.219383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:25.311671 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:25.311632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:35.784037 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:35.784006    2580 generic.go:356] "Generic (PLEG): container finished" podID="c6eeb779-69fd-4566-99f8-a0b24911a806" containerID="6666ee909f7b821f8463c474df26da51f4b9490c7fb93c7c98f556a023353b43" exitCode=0
Sep 17 21:43:35.784403 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:35.784079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-w49hn" event={"ID":"c6eeb779-69fd-4566-99f8-a0b24911a806","Type":"ContainerDied","Data":"6666ee909f7b821f8463c474df26da51f4b9490c7fb93c7c98f556a023353b43"}
Sep 17 21:43:35.784403 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:35.784383    2580 scope.go:117] "RemoveContainer" containerID="6666ee909f7b821f8463c474df26da51f4b9490c7fb93c7c98f556a023353b43"
Sep 17 21:43:36.790238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:36.790207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-w49hn" event={"ID":"c6eeb779-69fd-4566-99f8-a0b24911a806","Type":"ContainerStarted","Data":"ffc87bd07d8374f562fc77a0ebb2193a67783d65c3ddaa96ed6d2e0c17c1a398"}
Sep 17 21:43:37.567150 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:37.567109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:37.665292 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:37.665262    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:43:46.857091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:46.857049    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54ff4fddc9-86zk6" podUID="1d6d2049-fc11-4661-9d1d-4bfda9faac7e" containerName="console" containerID="cri-o://9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0" gracePeriod=15
Sep 17 21:43:47.113946 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.113884    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:47.204162 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204134    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-serving-cert\") pod \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") "
Sep 17 21:43:47.204162 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-oauth-config\") pod \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") "
Sep 17 21:43:47.204410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-service-ca\") pod \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") "
Sep 17 21:43:47.204410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-oauth-serving-cert\") pod \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") "
Sep 17 21:43:47.204410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204361    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvkzk\" (UniqueName: \"kubernetes.io/projected/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-kube-api-access-bvkzk\") pod \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") "
Sep 17 21:43:47.204561 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204418    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-config\") pod \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\" (UID: \"1d6d2049-fc11-4661-9d1d-4bfda9faac7e\") "
Sep 17 21:43:47.204561 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204542    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "1d6d2049-fc11-4661-9d1d-4bfda9faac7e" (UID: "1d6d2049-fc11-4661-9d1d-4bfda9faac7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:43:47.204702 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204629    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:47.205000 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.204966    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-config" (OuterVolumeSpecName: "console-config") pod "1d6d2049-fc11-4661-9d1d-4bfda9faac7e" (UID: "1d6d2049-fc11-4661-9d1d-4bfda9faac7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:43:47.205278 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.205244    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1d6d2049-fc11-4661-9d1d-4bfda9faac7e" (UID: "1d6d2049-fc11-4661-9d1d-4bfda9faac7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:43:47.207005 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.206980    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-kube-api-access-bvkzk" (OuterVolumeSpecName: "kube-api-access-bvkzk") pod "1d6d2049-fc11-4661-9d1d-4bfda9faac7e" (UID: "1d6d2049-fc11-4661-9d1d-4bfda9faac7e"). InnerVolumeSpecName "kube-api-access-bvkzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:43:47.207106 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.207011    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1d6d2049-fc11-4661-9d1d-4bfda9faac7e" (UID: "1d6d2049-fc11-4661-9d1d-4bfda9faac7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:43:47.207106 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.207027    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1d6d2049-fc11-4661-9d1d-4bfda9faac7e" (UID: "1d6d2049-fc11-4661-9d1d-4bfda9faac7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:43:47.304992 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.304959    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:47.304992 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.304990    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvkzk\" (UniqueName: \"kubernetes.io/projected/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-kube-api-access-bvkzk\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:47.305201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.305002    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:47.305201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.305015    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:47.305201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.305027    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d6d2049-fc11-4661-9d1d-4bfda9faac7e-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:43:47.834350 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.834314    2580 generic.go:356] "Generic (PLEG): container finished" podID="1d6d2049-fc11-4661-9d1d-4bfda9faac7e" containerID="9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0" exitCode=0
Sep 17 21:43:47.834350 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.834352    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ff4fddc9-86zk6"
Sep 17 21:43:47.834564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.834391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4fddc9-86zk6" event={"ID":"1d6d2049-fc11-4661-9d1d-4bfda9faac7e","Type":"ContainerDied","Data":"9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0"}
Sep 17 21:43:47.834564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.834447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ff4fddc9-86zk6" event={"ID":"1d6d2049-fc11-4661-9d1d-4bfda9faac7e","Type":"ContainerDied","Data":"13b578a0ec379ba815f5139de5ddc090c8a73f1cc7d09cce664572403651eb8c"}
Sep 17 21:43:47.834564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.834480    2580 scope.go:117] "RemoveContainer" containerID="9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0"
Sep 17 21:43:47.848188 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.848162    2580 scope.go:117] "RemoveContainer" containerID="9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0"
Sep 17 21:43:47.848519 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:43:47.848498    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0\": container with ID starting with 9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0 not found: ID does not exist" containerID="9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0"
Sep 17 21:43:47.848614 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.848526    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0"} err="failed to get container status \"9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0\": rpc error: code = NotFound desc = could not find container \"9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0\": container with ID starting with 9cb36f2cd19e4116f659f1ab4400050e3dd9cca620c68f574e098233bf3ba2f0 not found: ID does not exist"
Sep 17 21:43:47.861583 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.861553    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ff4fddc9-86zk6"]
Sep 17 21:43:47.865485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:47.865464    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54ff4fddc9-86zk6"]
Sep 17 21:43:49.023922 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:43:49.023885    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d6d2049-fc11-4661-9d1d-4bfda9faac7e" path="/var/lib/kubelet/pods/1d6d2049-fc11-4661-9d1d-4bfda9faac7e/volumes"
Sep 17 21:44:02.885494 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:02.885398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:02.995481 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:02.995450    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:07.930820 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.930780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:07.984491 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.984457    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"]
Sep 17 21:44:07.984794 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.984781    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231aac8e-9777-4869-83f0-62de59ea935d" containerName="registry"
Sep 17 21:44:07.984865 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.984797    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="231aac8e-9777-4869-83f0-62de59ea935d" containerName="registry"
Sep 17 21:44:07.984865 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.984813    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d6d2049-fc11-4661-9d1d-4bfda9faac7e" containerName="console"
Sep 17 21:44:07.984865 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.984822    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d6d2049-fc11-4661-9d1d-4bfda9faac7e" containerName="console"
Sep 17 21:44:07.984969 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.984872    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d6d2049-fc11-4661-9d1d-4bfda9faac7e" containerName="console"
Sep 17 21:44:07.984969 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.984881    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="231aac8e-9777-4869-83f0-62de59ea935d" containerName="registry"
Sep 17 21:44:07.989344 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.989328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:07.993878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.993853    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xlldj\""
Sep 17 21:44:07.994018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.993908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 21:44:07.994018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.993925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 21:44:07.994018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.993946    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 21:44:07.994018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.993952    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 21:44:07.994018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:07.993971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 21:44:08.000692 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.000651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 21:44:08.008115 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.008092    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"]
Sep 17 21:44:08.055996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.055962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfcc\" (UniqueName: \"kubernetes.io/projected/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-kube-api-access-7tfcc\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.056163 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.056105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-federate-client-tls\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.056163 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.056148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-secret-telemeter-client\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.056238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.056178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.056238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.056211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-telemeter-client-tls\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.056347 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.056327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.056463 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.056441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-metrics-client-ca\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.056544 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.056529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-serving-certs-ca-bundle\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157402 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-secret-telemeter-client\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157402 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157644 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-telemeter-client-tls\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157644 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157644 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-metrics-client-ca\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-serving-certs-ca-bundle\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfcc\" (UniqueName: \"kubernetes.io/projected/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-kube-api-access-7tfcc\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.157839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.157794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-federate-client-tls\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.158436 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.158409    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-metrics-client-ca\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.158574 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.158459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.158702 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.158680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-serving-certs-ca-bundle\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.160224 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.160190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.160335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.160240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-federate-client-tls\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.160549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.160529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-secret-telemeter-client\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.160645 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.160626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-telemeter-client-tls\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.167490 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.167462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfcc\" (UniqueName: \"kubernetes.io/projected/5f0c7b57-1dd2-494e-a48b-dd079d2432d4-kube-api-access-7tfcc\") pod \"telemeter-client-5fcf6ff945-cjkmk\" (UID: \"5f0c7b57-1dd2-494e-a48b-dd079d2432d4\") " pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.299503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.299460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"
Sep 17 21:44:08.583215 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.583137    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk"]
Sep 17 21:44:08.586793 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:44:08.586768    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0c7b57_1dd2_494e_a48b_dd079d2432d4.slice/crio-f559aa9adee9c5b20029202340ae9d66022fd058ef1d3cc0c470d0ac05c0498c WatchSource:0}: Error finding container f559aa9adee9c5b20029202340ae9d66022fd058ef1d3cc0c470d0ac05c0498c: Status 404 returned error can't find the container with id f559aa9adee9c5b20029202340ae9d66022fd058ef1d3cc0c470d0ac05c0498c
Sep 17 21:44:08.915558 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:08.915481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk" event={"ID":"5f0c7b57-1dd2-494e-a48b-dd079d2432d4","Type":"ContainerStarted","Data":"f559aa9adee9c5b20029202340ae9d66022fd058ef1d3cc0c470d0ac05c0498c"}
Sep 17 21:44:10.925539 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:10.925496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk" event={"ID":"5f0c7b57-1dd2-494e-a48b-dd079d2432d4","Type":"ContainerStarted","Data":"a767ca925ee71bfd190719dce3cea3934346cc90ef8ec1097aee29e07c91197e"}
Sep 17 21:44:11.931049 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:11.931009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk" event={"ID":"5f0c7b57-1dd2-494e-a48b-dd079d2432d4","Type":"ContainerStarted","Data":"c93bbe0cb6a18be3a1082ce1e88f86d4b4a41f295565361e1069e5ebb67d2cb6"}
Sep 17 21:44:11.931441 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:11.931065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk" event={"ID":"5f0c7b57-1dd2-494e-a48b-dd079d2432d4","Type":"ContainerStarted","Data":"19ade5fe5aae3cf58f43aca801c6f7508012d1c29db231f196968540c6552728"}
Sep 17 21:44:11.958632 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:11.958578    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fcf6ff945-cjkmk" podStartSLOduration=2.223125884 podStartE2EDuration="4.958562292s" totalImagesPullingTime="2.735436408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:44:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:44:11.956044843 +0000 UTC m=+185.477609796" watchObservedRunningTime="2026-09-17 21:44:11.958562292 +0000 UTC m=+185.480127222"
Sep 17 21:44:12.067720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.067672    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5656d78f88-zgtpq"]
Sep 17 21:44:12.070950 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.070928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.085446 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.085417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5656d78f88-zgtpq"]
Sep 17 21:44:12.126687 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.126632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:12.192006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.191913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrjf\" (UniqueName: \"kubernetes.io/projected/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-kube-api-access-fvrjf\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.192006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.191964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-service-ca\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.192006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.191984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-trusted-ca-bundle\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.192260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.192013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-config\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.192260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.192034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-oauth-serving-cert\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.192260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.192058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-serving-cert\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.192260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.192125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-oauth-config\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.233171 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.233142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:12.293263 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.293230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrjf\" (UniqueName: \"kubernetes.io/projected/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-kube-api-access-fvrjf\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.293445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.293280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-service-ca\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.293445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.293302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-trusted-ca-bundle\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.293445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.293329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-config\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.293445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.293352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-oauth-serving-cert\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.293445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.293390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-serving-cert\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.293445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.293443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-oauth-config\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.294137 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.294110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-service-ca\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.294277 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.294196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-config\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.294277 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.294202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-oauth-serving-cert\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.294390 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.294335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-trusted-ca-bundle\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.296553 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.296527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-oauth-config\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.296761 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.296738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-serving-cert\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.302039 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.302017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrjf\" (UniqueName: \"kubernetes.io/projected/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-kube-api-access-fvrjf\") pod \"console-5656d78f88-zgtpq\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") " pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.381323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.381287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:12.654830 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.654753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5656d78f88-zgtpq"]
Sep 17 21:44:12.657263 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:44:12.657233    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e348a7_8202_4b19_9ef3_77fef51a9cb1.slice/crio-135b4cc9924076a70ef83c9dd1a2b56654d6c812248f102f68d50c88a114e3de WatchSource:0}: Error finding container 135b4cc9924076a70ef83c9dd1a2b56654d6c812248f102f68d50c88a114e3de: Status 404 returned error can't find the container with id 135b4cc9924076a70ef83c9dd1a2b56654d6c812248f102f68d50c88a114e3de
Sep 17 21:44:12.936927 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.936824    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5656d78f88-zgtpq" event={"ID":"b2e348a7-8202-4b19-9ef3-77fef51a9cb1","Type":"ContainerStarted","Data":"961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f"}
Sep 17 21:44:12.936927 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.936881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5656d78f88-zgtpq" event={"ID":"b2e348a7-8202-4b19-9ef3-77fef51a9cb1","Type":"ContainerStarted","Data":"135b4cc9924076a70ef83c9dd1a2b56654d6c812248f102f68d50c88a114e3de"}
Sep 17 21:44:12.982854 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:12.982795    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5656d78f88-zgtpq" podStartSLOduration=0.982776892 podStartE2EDuration="982.776892ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:44:12.981436181 +0000 UTC m=+186.503001110" watchObservedRunningTime="2026-09-17 21:44:12.982776892 +0000 UTC m=+186.504341822"
Sep 17 21:44:22.381431 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:22.381388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:22.381981 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:22.381447    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:22.386115 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:22.386094    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:22.976483 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:22.976456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:44:23.032580 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:23.032552    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f85d66d-p8q5m"]
Sep 17 21:44:23.163930 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:23.163898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:23.264861 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:23.264782    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:23.369556 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:23.369520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:44:48.053884 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.053843    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65f85d66d-p8q5m" podUID="e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" containerName="console" containerID="cri-o://14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836" gracePeriod=15
Sep 17 21:44:48.289375 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.289352    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:44:48.299100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxfcr\" (UniqueName: \"kubernetes.io/projected/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-kube-api-access-rxfcr\") pod \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") "
Sep 17 21:44:48.299228 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-service-ca\") pod \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") "
Sep 17 21:44:48.299228 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299173    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-oauth-serving-cert\") pod \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") "
Sep 17 21:44:48.299228 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299205    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-trusted-ca-bundle\") pod \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") "
Sep 17 21:44:48.299396 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-config\") pod \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") "
Sep 17 21:44:48.299396 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-oauth-config\") pod \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") "
Sep 17 21:44:48.299396 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-serving-cert\") pod \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\" (UID: \"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f\") "
Sep 17 21:44:48.299606 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" (UID: "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:44:48.299682 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299634    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" (UID: "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:44:48.299682 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" (UID: "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:44:48.299767 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.299694    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-config" (OuterVolumeSpecName: "console-config") pod "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" (UID: "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:44:48.301542 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.301514    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-kube-api-access-rxfcr" (OuterVolumeSpecName: "kube-api-access-rxfcr") pod "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" (UID: "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f"). InnerVolumeSpecName "kube-api-access-rxfcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:44:48.301646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.301548    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" (UID: "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:44:48.301646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.301577    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" (UID: "e8a0f13b-7e75-4eb6-b9be-c8d303d0128f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:44:48.399924 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.399886    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:44:48.399924 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.399916    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-trusted-ca-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:44:48.399924 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.399925    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:44:48.400155 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.399935    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:44:48.400155 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.399945    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:44:48.400155 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.399952    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxfcr\" (UniqueName: \"kubernetes.io/projected/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-kube-api-access-rxfcr\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:44:48.400155 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:48.399960    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:44:49.080348 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.080318    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" containerID="14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836" exitCode=0
Sep 17 21:44:49.080820 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.080367    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f85d66d-p8q5m"
Sep 17 21:44:49.080820 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.080406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f85d66d-p8q5m" event={"ID":"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f","Type":"ContainerDied","Data":"14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836"}
Sep 17 21:44:49.080820 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.080465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f85d66d-p8q5m" event={"ID":"e8a0f13b-7e75-4eb6-b9be-c8d303d0128f","Type":"ContainerDied","Data":"f1804f46d34d8546a69133c210d1cc6db142bd2b234bc77c48fec20836596b2f"}
Sep 17 21:44:49.080820 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.080496    2580 scope.go:117] "RemoveContainer" containerID="14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836"
Sep 17 21:44:49.088849 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.088831    2580 scope.go:117] "RemoveContainer" containerID="14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836"
Sep 17 21:44:49.089129 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:44:49.089110    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836\": container with ID starting with 14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836 not found: ID does not exist" containerID="14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836"
Sep 17 21:44:49.089194 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.089142    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836"} err="failed to get container status \"14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836\": rpc error: code = NotFound desc = could not find container \"14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836\": container with ID starting with 14a929a0b5071457477cabf6184204b9cd2b9fc8556e6b8c1d65c2092524d836 not found: ID does not exist"
Sep 17 21:44:49.108799 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.108773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f85d66d-p8q5m"]
Sep 17 21:44:49.111783 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:49.111748    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f85d66d-p8q5m"]
Sep 17 21:44:51.023499 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:44:51.023469    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" path="/var/lib/kubelet/pods/e8a0f13b-7e75-4eb6-b9be-c8d303d0128f/volumes"
Sep 17 21:45:07.068162 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:07.068116    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:07.179211 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:07.179117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:18.189468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:18.189430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:18.267577 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:18.267541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:21.966508 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:21.966403    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5f586fb4-zptsr"]
Sep 17 21:45:21.967256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:21.967233    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" containerName="console"
Sep 17 21:45:21.967370 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:21.967260    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" containerName="console"
Sep 17 21:45:21.967370 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:21.967356    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a0f13b-7e75-4eb6-b9be-c8d303d0128f" containerName="console"
Sep 17 21:45:21.970602 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:21.970583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:21.986730 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:21.986705    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5f586fb4-zptsr"]
Sep 17 21:45:22.028096 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.028057    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:22.049104 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.049073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-console-config\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.049215 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.049109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-serving-cert\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.049215 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.049129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-trusted-ca-bundle\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.049215 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.049148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-oauth-serving-cert\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.049215 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.049205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-service-ca\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.049369 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.049231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgtk\" (UniqueName: \"kubernetes.io/projected/d8f5e442-7512-4bf1-a51b-d718751281cf-kube-api-access-8jgtk\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.049369 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.049263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-oauth-config\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.093557 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.093528    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:22.149704 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.149650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-service-ca\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.149869 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.149713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgtk\" (UniqueName: \"kubernetes.io/projected/d8f5e442-7512-4bf1-a51b-d718751281cf-kube-api-access-8jgtk\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.149869 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.149753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-oauth-config\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.149869 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.149839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-console-config\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.150039 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.149874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-serving-cert\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.150092 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.150034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-trusted-ca-bundle\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.150146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.150088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-oauth-serving-cert\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.150502 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.150469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-service-ca\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.150819 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.150647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-console-config\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.150819 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.150774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-oauth-serving-cert\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.150943 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.150862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-trusted-ca-bundle\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.152917 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.152893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-serving-cert\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.153339 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.153319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-oauth-config\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.159364 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.159320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgtk\" (UniqueName: \"kubernetes.io/projected/d8f5e442-7512-4bf1-a51b-d718751281cf-kube-api-access-8jgtk\") pod \"console-7f5f586fb4-zptsr\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") " pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.279554 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.279516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:22.559677 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:22.559472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5f586fb4-zptsr"]
Sep 17 21:45:22.562338 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:45:22.562304    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f5e442_7512_4bf1_a51b_d718751281cf.slice/crio-83aef9b7ef812dbef331bbc1ea4988086998ab37665df0fbfd21c5191a7d71f0 WatchSource:0}: Error finding container 83aef9b7ef812dbef331bbc1ea4988086998ab37665df0fbfd21c5191a7d71f0: Status 404 returned error can't find the container with id 83aef9b7ef812dbef331bbc1ea4988086998ab37665df0fbfd21c5191a7d71f0
Sep 17 21:45:23.206344 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:23.206303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5f586fb4-zptsr" event={"ID":"d8f5e442-7512-4bf1-a51b-d718751281cf","Type":"ContainerStarted","Data":"dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147"}
Sep 17 21:45:23.206752 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:23.206358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5f586fb4-zptsr" event={"ID":"d8f5e442-7512-4bf1-a51b-d718751281cf","Type":"ContainerStarted","Data":"83aef9b7ef812dbef331bbc1ea4988086998ab37665df0fbfd21c5191a7d71f0"}
Sep 17 21:45:23.227030 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:23.226982    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5f586fb4-zptsr" podStartSLOduration=2.226965921 podStartE2EDuration="2.226965921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:45:23.225746277 +0000 UTC m=+256.747311220" watchObservedRunningTime="2026-09-17 21:45:23.226965921 +0000 UTC m=+256.748530852"
Sep 17 21:45:30.133479 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:30.133388    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:30.233855 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:30.233822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:32.280392 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:32.280359    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:32.280800 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:32.280415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:32.285195 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:32.285170    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:33.254375 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:33.254346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:45:33.311033 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:33.310994    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5656d78f88-zgtpq"]
Sep 17 21:45:33.457849 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:33.457811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:33.558418 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:33.558386    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:33.642719 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:33.642687    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:35.566114 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:35.566080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:35.664726 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:35.664690    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:45:58.335131 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.335084    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5656d78f88-zgtpq" podUID="b2e348a7-8202-4b19-9ef3-77fef51a9cb1" containerName="console" containerID="cri-o://961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f" gracePeriod=15
Sep 17 21:45:58.574288 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.574255    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:45:58.641880 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.641789    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-oauth-serving-cert\") pod \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") "
Sep 17 21:45:58.641880 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.641829    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-trusted-ca-bundle\") pod \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") "
Sep 17 21:45:58.641880 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.641879    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvrjf\" (UniqueName: \"kubernetes.io/projected/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-kube-api-access-fvrjf\") pod \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") "
Sep 17 21:45:58.642136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.641904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-service-ca\") pod \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") "
Sep 17 21:45:58.642136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.641943    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-config\") pod \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") "
Sep 17 21:45:58.642136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.641965    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-serving-cert\") pod \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") "
Sep 17 21:45:58.642136 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.641988    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-oauth-config\") pod \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\" (UID: \"b2e348a7-8202-4b19-9ef3-77fef51a9cb1\") "
Sep 17 21:45:58.642378 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.642341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2e348a7-8202-4b19-9ef3-77fef51a9cb1" (UID: "b2e348a7-8202-4b19-9ef3-77fef51a9cb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:45:58.642378 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.642352    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2e348a7-8202-4b19-9ef3-77fef51a9cb1" (UID: "b2e348a7-8202-4b19-9ef3-77fef51a9cb1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:45:58.642509 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.642451    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-config" (OuterVolumeSpecName: "console-config") pod "b2e348a7-8202-4b19-9ef3-77fef51a9cb1" (UID: "b2e348a7-8202-4b19-9ef3-77fef51a9cb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:45:58.642509 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.642496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2e348a7-8202-4b19-9ef3-77fef51a9cb1" (UID: "b2e348a7-8202-4b19-9ef3-77fef51a9cb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:45:58.644283 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.644251    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2e348a7-8202-4b19-9ef3-77fef51a9cb1" (UID: "b2e348a7-8202-4b19-9ef3-77fef51a9cb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:45:58.644385 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.644351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2e348a7-8202-4b19-9ef3-77fef51a9cb1" (UID: "b2e348a7-8202-4b19-9ef3-77fef51a9cb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:45:58.644461 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.644394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-kube-api-access-fvrjf" (OuterVolumeSpecName: "kube-api-access-fvrjf") pod "b2e348a7-8202-4b19-9ef3-77fef51a9cb1" (UID: "b2e348a7-8202-4b19-9ef3-77fef51a9cb1"). InnerVolumeSpecName "kube-api-access-fvrjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:45:58.742999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.742947    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvrjf\" (UniqueName: \"kubernetes.io/projected/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-kube-api-access-fvrjf\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:45:58.742999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.742992    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:45:58.742999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.743003    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:45:58.742999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.743010    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:45:58.742999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.743018    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:45:58.743298 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.743026    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:45:58.743298 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:58.743034    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2e348a7-8202-4b19-9ef3-77fef51a9cb1-trusted-ca-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:45:59.346435 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.346346    2580 generic.go:356] "Generic (PLEG): container finished" podID="b2e348a7-8202-4b19-9ef3-77fef51a9cb1" containerID="961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f" exitCode=0
Sep 17 21:45:59.346435 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.346392    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5656d78f88-zgtpq"
Sep 17 21:45:59.346913 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.346446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5656d78f88-zgtpq" event={"ID":"b2e348a7-8202-4b19-9ef3-77fef51a9cb1","Type":"ContainerDied","Data":"961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f"}
Sep 17 21:45:59.346913 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.346497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5656d78f88-zgtpq" event={"ID":"b2e348a7-8202-4b19-9ef3-77fef51a9cb1","Type":"ContainerDied","Data":"135b4cc9924076a70ef83c9dd1a2b56654d6c812248f102f68d50c88a114e3de"}
Sep 17 21:45:59.346913 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.346516    2580 scope.go:117] "RemoveContainer" containerID="961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f"
Sep 17 21:45:59.354811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.354795    2580 scope.go:117] "RemoveContainer" containerID="961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f"
Sep 17 21:45:59.355080 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:45:59.355062    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f\": container with ID starting with 961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f not found: ID does not exist" containerID="961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f"
Sep 17 21:45:59.355159 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.355087    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f"} err="failed to get container status \"961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f\": rpc error: code = NotFound desc = could not find container \"961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f\": container with ID starting with 961411a2b7c533d19ce3f53567088140a2015df37878f02816442ec9c291294f not found: ID does not exist"
Sep 17 21:45:59.364161 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.364130    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5656d78f88-zgtpq"]
Sep 17 21:45:59.368642 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:45:59.368619    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5656d78f88-zgtpq"]
Sep 17 21:46:00.148941 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:00.148894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:00.242530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:00.242503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:01.022991 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.022961    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e348a7-8202-4b19-9ef3-77fef51a9cb1" path="/var/lib/kubelet/pods/b2e348a7-8202-4b19-9ef3-77fef51a9cb1/volumes"
Sep 17 21:46:01.173469 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.173434    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"]
Sep 17 21:46:01.173751 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.173739    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e348a7-8202-4b19-9ef3-77fef51a9cb1" containerName="console"
Sep 17 21:46:01.173802 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.173753    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e348a7-8202-4b19-9ef3-77fef51a9cb1" containerName="console"
Sep 17 21:46:01.173834 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.173814    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e348a7-8202-4b19-9ef3-77fef51a9cb1" containerName="console"
Sep 17 21:46:01.178078 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.178061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.180874 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.180827    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 21:46:01.181933 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.181917    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 21:46:01.181998 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.181937    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl9xl\""
Sep 17 21:46:01.186536 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.186507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"]
Sep 17 21:46:01.262785 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.262746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.262962 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.262820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xth9d\" (UniqueName: \"kubernetes.io/projected/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-kube-api-access-xth9d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.262962 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.262854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.363535 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.363448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xth9d\" (UniqueName: \"kubernetes.io/projected/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-kube-api-access-xth9d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.363535 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.363493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.363851 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.363708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.363896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.363848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.363982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.363964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.373404 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.373384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xth9d\" (UniqueName: \"kubernetes.io/projected/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-kube-api-access-xth9d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.488064 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.488024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:01.763005 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:01.762979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"]
Sep 17 21:46:01.764978 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:46:01.764946    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227a166f_5f18_4f14_9a2a_3a4d53a2cb4c.slice/crio-4bdec0668983e24d8a686d02dce47142909f39b32f82b7acab7c8b2415ae4d25 WatchSource:0}: Error finding container 4bdec0668983e24d8a686d02dce47142909f39b32f82b7acab7c8b2415ae4d25: Status 404 returned error can't find the container with id 4bdec0668983e24d8a686d02dce47142909f39b32f82b7acab7c8b2415ae4d25
Sep 17 21:46:02.361892 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:02.361861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9" event={"ID":"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c","Type":"ContainerStarted","Data":"4bdec0668983e24d8a686d02dce47142909f39b32f82b7acab7c8b2415ae4d25"}
Sep 17 21:46:08.326010 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:08.325986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:46:08.326409 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:08.326317    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:46:08.336016 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:08.335996    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 21:46:09.393322 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:09.393284    2580 generic.go:356] "Generic (PLEG): container finished" podID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerID="5acd630bd01a94e3ef907f1ba6d36770d86fb1d16d7810a656a613cd4b2b931f" exitCode=0
Sep 17 21:46:09.393808 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:09.393358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9" event={"ID":"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c","Type":"ContainerDied","Data":"5acd630bd01a94e3ef907f1ba6d36770d86fb1d16d7810a656a613cd4b2b931f"}
Sep 17 21:46:09.394383 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:09.394358    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 21:46:10.818068 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:10.818034    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:11.403839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:11.403755    2580 generic.go:356] "Generic (PLEG): container finished" podID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerID="e4e1bd133bde0b9c62231c704bf2449a1aa13ace150d1b0cf094825eb4d79d91" exitCode=0
Sep 17 21:46:11.403839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:11.403793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9" event={"ID":"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c","Type":"ContainerDied","Data":"e4e1bd133bde0b9c62231c704bf2449a1aa13ace150d1b0cf094825eb4d79d91"}
Sep 17 21:46:18.440982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:18.440944    2580 generic.go:356] "Generic (PLEG): container finished" podID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerID="3f8f450e328bc1ed1914bd08ae50f6aa326a6155fde39547365dec97cea5918e" exitCode=0
Sep 17 21:46:18.441385 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:18.441007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9" event={"ID":"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c","Type":"ContainerDied","Data":"3f8f450e328bc1ed1914bd08ae50f6aa326a6155fde39547365dec97cea5918e"}
Sep 17 21:46:19.575094 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.575068    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:19.622997 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.622962    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-util\") pod \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") "
Sep 17 21:46:19.623183 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.623026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-bundle\") pod \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") "
Sep 17 21:46:19.623183 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.623048    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xth9d\" (UniqueName: \"kubernetes.io/projected/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-kube-api-access-xth9d\") pod \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\" (UID: \"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c\") "
Sep 17 21:46:19.623757 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.623728    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-bundle" (OuterVolumeSpecName: "bundle") pod "227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" (UID: "227a166f-5f18-4f14-9a2a-3a4d53a2cb4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:46:19.625379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.625354    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-kube-api-access-xth9d" (OuterVolumeSpecName: "kube-api-access-xth9d") pod "227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" (UID: "227a166f-5f18-4f14-9a2a-3a4d53a2cb4c"). InnerVolumeSpecName "kube-api-access-xth9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:46:19.627338 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.627315    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-util" (OuterVolumeSpecName: "util") pod "227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" (UID: "227a166f-5f18-4f14-9a2a-3a4d53a2cb4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:46:19.724046 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.723961    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:19.724046 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.723993    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xth9d\" (UniqueName: \"kubernetes.io/projected/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-kube-api-access-xth9d\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:19.724046 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:19.724002    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227a166f-5f18-4f14-9a2a-3a4d53a2cb4c-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:20.449855 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:20.449816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9" event={"ID":"227a166f-5f18-4f14-9a2a-3a4d53a2cb4c","Type":"ContainerDied","Data":"4bdec0668983e24d8a686d02dce47142909f39b32f82b7acab7c8b2415ae4d25"}
Sep 17 21:46:20.449855 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:20.449845    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq4c9"
Sep 17 21:46:20.450062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:20.449871    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bdec0668983e24d8a686d02dce47142909f39b32f82b7acab7c8b2415ae4d25"
Sep 17 21:46:22.203909 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:22.203879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:23.072503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:23.072456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:24.308250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308220    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"]
Sep 17 21:46:24.308618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308508    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerName="pull"
Sep 17 21:46:24.308618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308519    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerName="pull"
Sep 17 21:46:24.308618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308530    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerName="extract"
Sep 17 21:46:24.308618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308536    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerName="extract"
Sep 17 21:46:24.308618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308547    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerName="util"
Sep 17 21:46:24.308618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308552    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerName="util"
Sep 17 21:46:24.308618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.308593    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="227a166f-5f18-4f14-9a2a-3a4d53a2cb4c" containerName="extract"
Sep 17 21:46:24.312211 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.312193    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.315027 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.315007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:46:24.315456 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.315434    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 17 21:46:24.315755 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.315740    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cgxks\""
Sep 17 21:46:24.328815 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.328781    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"]
Sep 17 21:46:24.461814 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.461782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbsd\" (UniqueName: \"kubernetes.io/projected/1e1e94b7-7487-4be5-b4b0-0d58c39d1e25-kube-api-access-blbsd\") pod \"cert-manager-operator-controller-manager-55c444bf86-skf7k\" (UID: \"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.462032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.461921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1e94b7-7487-4be5-b4b0-0d58c39d1e25-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-skf7k\" (UID: \"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.562526 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.562433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1e94b7-7487-4be5-b4b0-0d58c39d1e25-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-skf7k\" (UID: \"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.562526 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.562518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blbsd\" (UniqueName: \"kubernetes.io/projected/1e1e94b7-7487-4be5-b4b0-0d58c39d1e25-kube-api-access-blbsd\") pod \"cert-manager-operator-controller-manager-55c444bf86-skf7k\" (UID: \"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.562891 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.562869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1e94b7-7487-4be5-b4b0-0d58c39d1e25-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-skf7k\" (UID: \"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.578631 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.578600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbsd\" (UniqueName: \"kubernetes.io/projected/1e1e94b7-7487-4be5-b4b0-0d58c39d1e25-kube-api-access-blbsd\") pod \"cert-manager-operator-controller-manager-55c444bf86-skf7k\" (UID: \"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.620936 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.620900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"
Sep 17 21:46:24.899350 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:24.899265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k"]
Sep 17 21:46:24.903312 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:46:24.903278    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1e94b7_7487_4be5_b4b0_0d58c39d1e25.slice/crio-122d8b1bcbf44338d9d3a80f2fc92c403183c3c7d5b1cb5474796888a229b913 WatchSource:0}: Error finding container 122d8b1bcbf44338d9d3a80f2fc92c403183c3c7d5b1cb5474796888a229b913: Status 404 returned error can't find the container with id 122d8b1bcbf44338d9d3a80f2fc92c403183c3c7d5b1cb5474796888a229b913
Sep 17 21:46:25.471447 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:25.471411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k" event={"ID":"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25","Type":"ContainerStarted","Data":"122d8b1bcbf44338d9d3a80f2fc92c403183c3c7d5b1cb5474796888a229b913"}
Sep 17 21:46:26.016115 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:26.016078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:26.076756 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:26.076707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:27.472582 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:27.472553    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:27.481944 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:27.481916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k" event={"ID":"1e1e94b7-7487-4be5-b4b0-0d58c39d1e25","Type":"ContainerStarted","Data":"ebc965cde927195a76395666105c6bcebb0c36761ca574e10917a3123453d642"}
Sep 17 21:46:27.519939 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:27.519885    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-skf7k" podStartSLOduration=1.7747021630000002 podStartE2EDuration="3.519869179s" totalImagesPullingTime="1.745167016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:46:27.518806517 +0000 UTC m=+321.040371472" watchObservedRunningTime="2026-09-17 21:46:27.519869179 +0000 UTC m=+321.041434109"
Sep 17 21:46:28.595411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.595374    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"]
Sep 17 21:46:28.597999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.597980    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.604555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.604183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl9xl\""
Sep 17 21:46:28.604555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.604309    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 21:46:28.605304 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.605283    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 21:46:28.625351 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.625314    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"]
Sep 17 21:46:28.697041 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.697001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4g44\" (UniqueName: \"kubernetes.io/projected/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-kube-api-access-h4g44\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.697222 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.697069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.697222 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.697108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.798477 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.798433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.798477 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.798480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.798750 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.798550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4g44\" (UniqueName: \"kubernetes.io/projected/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-kube-api-access-h4g44\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.798984 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.798956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.799107 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.799009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.803772 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.803740    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:28.808967 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.808942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4g44\" (UniqueName: \"kubernetes.io/projected/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-kube-api-access-h4g44\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:28.907211 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:28.907096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:29.163188 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:29.163095    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:29.198186 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:29.198157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"]
Sep 17 21:46:29.201488 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:46:29.201439    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7f7c34_2a5b_417d_bfe6_6a3318c43ce1.slice/crio-52cbdd828cc602494c46e5b7fee034092ec1ebd8531d9223d83023b3931e7f1c WatchSource:0}: Error finding container 52cbdd828cc602494c46e5b7fee034092ec1ebd8531d9223d83023b3931e7f1c: Status 404 returned error can't find the container with id 52cbdd828cc602494c46e5b7fee034092ec1ebd8531d9223d83023b3931e7f1c
Sep 17 21:46:29.492506 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:29.492414    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerID="7a40c1a9b6d75538861fc43d07f85484ac596db98c1c4056fac4d3c0065dbfdc" exitCode=0
Sep 17 21:46:29.492506 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:29.492463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv" event={"ID":"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1","Type":"ContainerDied","Data":"7a40c1a9b6d75538861fc43d07f85484ac596db98c1c4056fac4d3c0065dbfdc"}
Sep 17 21:46:29.492754 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:29.492511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv" event={"ID":"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1","Type":"ContainerStarted","Data":"52cbdd828cc602494c46e5b7fee034092ec1ebd8531d9223d83023b3931e7f1c"}
Sep 17 21:46:29.939240 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:29.939207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:30.233736 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.233642    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"]
Sep 17 21:46:30.236461 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.236435    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:30.239700 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.239642    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 21:46:30.241032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.241013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 21:46:30.241032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.241020    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cvzf2\""
Sep 17 21:46:30.247601 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.247577    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"]
Sep 17 21:46:30.313142 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.313104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h56d5\" (UniqueName: \"kubernetes.io/projected/a96448e5-37cc-439c-b69e-736ab0e8dbdf-kube-api-access-h56d5\") pod \"cert-manager-cainjector-559cdd8c87-cbv7k\" (UID: \"a96448e5-37cc-439c-b69e-736ab0e8dbdf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:30.313328 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.313271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a96448e5-37cc-439c-b69e-736ab0e8dbdf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cbv7k\" (UID: \"a96448e5-37cc-439c-b69e-736ab0e8dbdf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:30.414219 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.414185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h56d5\" (UniqueName: \"kubernetes.io/projected/a96448e5-37cc-439c-b69e-736ab0e8dbdf-kube-api-access-h56d5\") pod \"cert-manager-cainjector-559cdd8c87-cbv7k\" (UID: \"a96448e5-37cc-439c-b69e-736ab0e8dbdf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:30.414413 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.414251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a96448e5-37cc-439c-b69e-736ab0e8dbdf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cbv7k\" (UID: \"a96448e5-37cc-439c-b69e-736ab0e8dbdf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:30.424127 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.424102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a96448e5-37cc-439c-b69e-736ab0e8dbdf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cbv7k\" (UID: \"a96448e5-37cc-439c-b69e-736ab0e8dbdf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:30.424286 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.424099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h56d5\" (UniqueName: \"kubernetes.io/projected/a96448e5-37cc-439c-b69e-736ab0e8dbdf-kube-api-access-h56d5\") pod \"cert-manager-cainjector-559cdd8c87-cbv7k\" (UID: \"a96448e5-37cc-439c-b69e-736ab0e8dbdf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:30.555762 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:30.555716    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"
Sep 17 21:46:31.503901 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:31.503820    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k"]
Sep 17 21:46:31.504781 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:31.504759    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerID="2b357e38f20c001fd22bd36f7bf1daba0d1b5de9d4043a78a6ce1cd09852aa17" exitCode=0
Sep 17 21:46:31.504827 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:31.504797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv" event={"ID":"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1","Type":"ContainerDied","Data":"2b357e38f20c001fd22bd36f7bf1daba0d1b5de9d4043a78a6ce1cd09852aa17"}
Sep 17 21:46:31.507509 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:46:31.507475    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda96448e5_37cc_439c_b69e_736ab0e8dbdf.slice/crio-7e7b2cbc0290ee2983ff699ebbe6c1861b461a8d488b115b44e68739d73b0569 WatchSource:0}: Error finding container 7e7b2cbc0290ee2983ff699ebbe6c1861b461a8d488b115b44e68739d73b0569: Status 404 returned error can't find the container with id 7e7b2cbc0290ee2983ff699ebbe6c1861b461a8d488b115b44e68739d73b0569
Sep 17 21:46:32.511101 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:32.511064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k" event={"ID":"a96448e5-37cc-439c-b69e-736ab0e8dbdf","Type":"ContainerStarted","Data":"7e7b2cbc0290ee2983ff699ebbe6c1861b461a8d488b115b44e68739d73b0569"}
Sep 17 21:46:32.513523 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:32.513479    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerID="fad72471b929b2611fc8f6978e0e655e71b923069b18211b54a97a3682a0cdc3" exitCode=0
Sep 17 21:46:32.513681 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:32.513528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv" event={"ID":"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1","Type":"ContainerDied","Data":"fad72471b929b2611fc8f6978e0e655e71b923069b18211b54a97a3682a0cdc3"}
Sep 17 21:46:32.833463 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:32.833413    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:32.901552 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:32.901520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:34.078707 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.078682    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:34.146335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.146309    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-bundle\") pod \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") "
Sep 17 21:46:34.146468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.146368    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-util\") pod \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") "
Sep 17 21:46:34.146468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.146387    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4g44\" (UniqueName: \"kubernetes.io/projected/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-kube-api-access-h4g44\") pod \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\" (UID: \"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1\") "
Sep 17 21:46:34.146846 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.146814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-bundle" (OuterVolumeSpecName: "bundle") pod "bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" (UID: "bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:46:34.148763 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.148728    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-kube-api-access-h4g44" (OuterVolumeSpecName: "kube-api-access-h4g44") pod "bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" (UID: "bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1"). InnerVolumeSpecName "kube-api-access-h4g44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:46:34.153712 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.153683    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-util" (OuterVolumeSpecName: "util") pod "bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" (UID: "bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:46:34.247596 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.247553    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:34.247596 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.247585    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4g44\" (UniqueName: \"kubernetes.io/projected/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-kube-api-access-h4g44\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:34.247596 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.247596    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:34.525456 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.525423    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv"
Sep 17 21:46:34.525456 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.525448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7z7fv" event={"ID":"bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1","Type":"ContainerDied","Data":"52cbdd828cc602494c46e5b7fee034092ec1ebd8531d9223d83023b3931e7f1c"}
Sep 17 21:46:34.525706 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.525495    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52cbdd828cc602494c46e5b7fee034092ec1ebd8531d9223d83023b3931e7f1c"
Sep 17 21:46:34.527227 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.527198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k" event={"ID":"a96448e5-37cc-439c-b69e-736ab0e8dbdf","Type":"ContainerStarted","Data":"d6f28877e6dd5d56d784abfd1cf56a27c780e49cb322b522d15dd043cc11814b"}
Sep 17 21:46:34.545324 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:34.545275    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cbv7k" podStartSLOduration=1.9492976770000001 podStartE2EDuration="4.545258413s" totalImagesPullingTime="2.595960736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:46:34.543987586 +0000 UTC m=+328.065552541" watchObservedRunningTime="2026-09-17 21:46:34.545258413 +0000 UTC m=+328.066823342"
Sep 17 21:46:35.216780 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:35.216741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:35.326036 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:35.325993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:39.028512 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:39.028472    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:39.158465 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:39.158419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:41.048825 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.048792    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"]
Sep 17 21:46:41.049191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.049089    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerName="extract"
Sep 17 21:46:41.049191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.049101    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerName="extract"
Sep 17 21:46:41.049191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.049119    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerName="util"
Sep 17 21:46:41.049191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.049124    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerName="util"
Sep 17 21:46:41.049191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.049131    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerName="pull"
Sep 17 21:46:41.049191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.049136    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerName="pull"
Sep 17 21:46:41.049191 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.049193    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7f7c34-2a5b-417d-bfe6-6a3318c43ce1" containerName="extract"
Sep 17 21:46:41.055843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.055816    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.059492 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.059463    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4q8jc\""
Sep 17 21:46:41.059642 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.059520    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:46:41.059740 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.059474    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 21:46:41.060511 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.060453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"]
Sep 17 21:46:41.206195 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.206159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm9tk\" (UniqueName: \"kubernetes.io/projected/f583038e-852c-4094-a50d-3b48c6271b7e-kube-api-access-tm9tk\") pod \"openshift-lws-operator-fd8ccff4c-6smz8\" (UID: \"f583038e-852c-4094-a50d-3b48c6271b7e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.206372 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.206257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f583038e-852c-4094-a50d-3b48c6271b7e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6smz8\" (UID: \"f583038e-852c-4094-a50d-3b48c6271b7e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.307593 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.307487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm9tk\" (UniqueName: \"kubernetes.io/projected/f583038e-852c-4094-a50d-3b48c6271b7e-kube-api-access-tm9tk\") pod \"openshift-lws-operator-fd8ccff4c-6smz8\" (UID: \"f583038e-852c-4094-a50d-3b48c6271b7e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.307593 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.307575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f583038e-852c-4094-a50d-3b48c6271b7e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6smz8\" (UID: \"f583038e-852c-4094-a50d-3b48c6271b7e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.308056 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.308032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f583038e-852c-4094-a50d-3b48c6271b7e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6smz8\" (UID: \"f583038e-852c-4094-a50d-3b48c6271b7e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.317203 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.317172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm9tk\" (UniqueName: \"kubernetes.io/projected/f583038e-852c-4094-a50d-3b48c6271b7e-kube-api-access-tm9tk\") pod \"openshift-lws-operator-fd8ccff4c-6smz8\" (UID: \"f583038e-852c-4094-a50d-3b48c6271b7e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.367331 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.367296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"
Sep 17 21:46:41.639345 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:41.639257    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8"]
Sep 17 21:46:41.642135 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:46:41.642109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf583038e_852c_4094_a50d_3b48c6271b7e.slice/crio-ef46c0a70f36c2409b8e9b1f075417a22a42d871fcb2cba04461f9a423c8856e WatchSource:0}: Error finding container ef46c0a70f36c2409b8e9b1f075417a22a42d871fcb2cba04461f9a423c8856e: Status 404 returned error can't find the container with id ef46c0a70f36c2409b8e9b1f075417a22a42d871fcb2cba04461f9a423c8856e
Sep 17 21:46:42.564103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:42.564061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8" event={"ID":"f583038e-852c-4094-a50d-3b48c6271b7e","Type":"ContainerStarted","Data":"ef46c0a70f36c2409b8e9b1f075417a22a42d871fcb2cba04461f9a423c8856e"}
Sep 17 21:46:43.570135 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:43.570045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8" event={"ID":"f583038e-852c-4094-a50d-3b48c6271b7e","Type":"ContainerStarted","Data":"ffd6757d720b0d06a3a3af736fd3eb8503f9860a6b30b6448fec05b522a9184a"}
Sep 17 21:46:43.587319 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:43.587266    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6smz8" podStartSLOduration=0.985750287 podStartE2EDuration="2.587249865s" totalImagesPullingTime="1.601499578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:46:43.586254346 +0000 UTC m=+337.107819277" watchObservedRunningTime="2026-09-17 21:46:43.587249865 +0000 UTC m=+337.108814791"
Sep 17 21:46:44.351093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:44.351058    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:44.453175 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:44.453146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:46.477652 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.477614    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"]
Sep 17 21:46:46.480132 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.480115    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.483141 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.483122    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 21:46:46.483211 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.483143    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 21:46:46.484285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.484269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl9xl\""
Sep 17 21:46:46.491477 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.491440    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"]
Sep 17 21:46:46.652114 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.652077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.652283 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.652126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.652283 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.652224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t28kj\" (UniqueName: \"kubernetes.io/projected/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-kube-api-access-t28kj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.753380 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.753288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t28kj\" (UniqueName: \"kubernetes.io/projected/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-kube-api-access-t28kj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.753380 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.753345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.753593 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.753394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.753845 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.753813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.753947 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.753867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.766945 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.766915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t28kj\" (UniqueName: \"kubernetes.io/projected/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-kube-api-access-t28kj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:46.786790 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.786755    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:46:46.789545 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:46.789515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:47.067232 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:47.067206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"]
Sep 17 21:46:47.069479 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:46:47.069447    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e195a2f_cf6f_4882_b7b2_a9bf17fd60fe.slice/crio-ce8c0626343529f73eef61768a0708951437e911843bf72f4115eee01e2c78c4 WatchSource:0}: Error finding container ce8c0626343529f73eef61768a0708951437e911843bf72f4115eee01e2c78c4: Status 404 returned error can't find the container with id ce8c0626343529f73eef61768a0708951437e911843bf72f4115eee01e2c78c4
Sep 17 21:46:47.589489 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:47.589460    2580 generic.go:356] "Generic (PLEG): container finished" podID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerID="8b9abd4bf3dc483d48bf13cb15766446774821b4d035fba400e9f300e0b152a3" exitCode=0
Sep 17 21:46:47.589888 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:47.589513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6" event={"ID":"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe","Type":"ContainerDied","Data":"8b9abd4bf3dc483d48bf13cb15766446774821b4d035fba400e9f300e0b152a3"}
Sep 17 21:46:47.589888 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:47.589551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6" event={"ID":"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe","Type":"ContainerStarted","Data":"ce8c0626343529f73eef61768a0708951437e911843bf72f4115eee01e2c78c4"}
Sep 17 21:46:48.597991 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:48.597959    2580 generic.go:356] "Generic (PLEG): container finished" podID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerID="39e8ed12b24568b39a3e21220e9413a47b2517cc32e4a9d87192d0fd1eee7bcc" exitCode=0
Sep 17 21:46:48.598381 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:48.598035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6" event={"ID":"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe","Type":"ContainerDied","Data":"39e8ed12b24568b39a3e21220e9413a47b2517cc32e4a9d87192d0fd1eee7bcc"}
Sep 17 21:46:49.604943 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:49.604905    2580 generic.go:356] "Generic (PLEG): container finished" podID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerID="49977f8a61fb3564f121f93a70847173908f10c9b9f2d4471fb206be4a6e060e" exitCode=0
Sep 17 21:46:49.605381 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:49.604982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6" event={"ID":"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe","Type":"ContainerDied","Data":"49977f8a61fb3564f121f93a70847173908f10c9b9f2d4471fb206be4a6e060e"}
Sep 17 21:46:50.750184 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.750150    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:50.892110 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.892009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-util\") pod \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") "
Sep 17 21:46:50.892110 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.892066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-bundle\") pod \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") "
Sep 17 21:46:50.892110 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.892095    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t28kj\" (UniqueName: \"kubernetes.io/projected/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-kube-api-access-t28kj\") pod \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\" (UID: \"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe\") "
Sep 17 21:46:50.893006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.892968    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-bundle" (OuterVolumeSpecName: "bundle") pod "3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" (UID: "3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:46:50.894326 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.894302    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-kube-api-access-t28kj" (OuterVolumeSpecName: "kube-api-access-t28kj") pod "3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" (UID: "3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe"). InnerVolumeSpecName "kube-api-access-t28kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:46:50.897777 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.897758    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-util" (OuterVolumeSpecName: "util") pod "3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" (UID: "3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:46:50.992972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.992932    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:50.992972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.992964    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:50.992972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:50.992974    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t28kj\" (UniqueName: \"kubernetes.io/projected/3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe-kube-api-access-t28kj\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:46:51.616143 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:51.616108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6" event={"ID":"3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe","Type":"ContainerDied","Data":"ce8c0626343529f73eef61768a0708951437e911843bf72f4115eee01e2c78c4"}
Sep 17 21:46:51.616143 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:51.616140    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af26vp6"
Sep 17 21:46:51.616350 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:46:51.616163    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce8c0626343529f73eef61768a0708951437e911843bf72f4115eee01e2c78c4"
Sep 17 21:47:02.245907 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:02.245827    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:02.348697 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:02.348648    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:02.928899 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:02.928864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:03.090078 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"]
Sep 17 21:47:03.090396 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090379    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerName="pull"
Sep 17 21:47:03.090485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerName="pull"
Sep 17 21:47:03.090485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090440    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerName="extract"
Sep 17 21:47:03.090485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090449    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerName="extract"
Sep 17 21:47:03.090485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090470    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerName="util"
Sep 17 21:47:03.090485 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090478    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerName="util"
Sep 17 21:47:03.090771 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.090603    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e195a2f-cf6f-4882-b7b2-a9bf17fd60fe" containerName="extract"
Sep 17 21:47:03.097647 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.097624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.101200 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.101179    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 21:47:03.102322 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.102297    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 21:47:03.102322 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.102299    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl9xl\""
Sep 17 21:47:03.108614 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.108591    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"]
Sep 17 21:47:03.178417 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.178385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdqkq\" (UniqueName: \"kubernetes.io/projected/32dfbbac-39ed-476f-b67d-65765480e0c2-kube-api-access-vdqkq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.178417 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.178421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.178701 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.178454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.278951 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.278917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdqkq\" (UniqueName: \"kubernetes.io/projected/32dfbbac-39ed-476f-b67d-65765480e0c2-kube-api-access-vdqkq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.278951 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.278952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.279335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.278968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.279335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.279295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.279335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.279319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.291151 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.291129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdqkq\" (UniqueName: \"kubernetes.io/projected/32dfbbac-39ed-476f-b67d-65765480e0c2-kube-api-access-vdqkq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.317114 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.317085    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:03.407303 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.407271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:03.418945 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.418922    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"]
Sep 17 21:47:03.422580 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.422559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.427150 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.427127    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 21:47:03.427150 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.427144    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 21:47:03.427323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.427219    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n8qrl\""
Sep 17 21:47:03.427380 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.427359    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 21:47:03.427603 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.427587    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 21:47:03.442554 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.442423    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:03.444383 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.444356    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"]
Sep 17 21:47:03.481282 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.481251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65ec2558-281d-4a72-a506-f58338d3bd11-webhook-cert\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.481445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.481288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65ec2558-281d-4a72-a506-f58338d3bd11-tmp\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.481445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.481319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65ec2558-281d-4a72-a506-f58338d3bd11-apiservice-cert\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.481445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.481339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65ec2558-281d-4a72-a506-f58338d3bd11-manifests\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.481445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.481358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85p5s\" (UniqueName: \"kubernetes.io/projected/65ec2558-281d-4a72-a506-f58338d3bd11-kube-api-access-85p5s\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.582444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.582358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65ec2558-281d-4a72-a506-f58338d3bd11-apiservice-cert\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.582444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.582396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65ec2558-281d-4a72-a506-f58338d3bd11-manifests\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.582444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.582419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85p5s\" (UniqueName: \"kubernetes.io/projected/65ec2558-281d-4a72-a506-f58338d3bd11-kube-api-access-85p5s\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.582712 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.582460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65ec2558-281d-4a72-a506-f58338d3bd11-webhook-cert\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.582712 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.582487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65ec2558-281d-4a72-a506-f58338d3bd11-tmp\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.582875 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.582852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65ec2558-281d-4a72-a506-f58338d3bd11-manifests\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.585003 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.584975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65ec2558-281d-4a72-a506-f58338d3bd11-tmp\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.585203 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.585188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65ec2558-281d-4a72-a506-f58338d3bd11-apiservice-cert\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.585280 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.585202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65ec2558-281d-4a72-a506-f58338d3bd11-webhook-cert\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.593887 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.593862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85p5s\" (UniqueName: \"kubernetes.io/projected/65ec2558-281d-4a72-a506-f58338d3bd11-kube-api-access-85p5s\") pod \"opendatahub-operator-controller-manager-555cdfd7b4-lzsc9\" (UID: \"65ec2558-281d-4a72-a506-f58338d3bd11\") " pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.599531 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.599511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:03.696146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.696091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"]
Sep 17 21:47:03.698322 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:47:03.698292    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32dfbbac_39ed_476f_b67d_65765480e0c2.slice/crio-be66c7d3e41b387a5d8ab6843aa9fd0e239a47be32a5a76390703a244d33c0a5 WatchSource:0}: Error finding container be66c7d3e41b387a5d8ab6843aa9fd0e239a47be32a5a76390703a244d33c0a5: Status 404 returned error can't find the container with id be66c7d3e41b387a5d8ab6843aa9fd0e239a47be32a5a76390703a244d33c0a5
Sep 17 21:47:03.738212 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.738183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:03.766496 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.766461    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:03.859277 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.859193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:03.957566 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:03.957509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:04.030570 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.030538    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"]
Sep 17 21:47:04.033563 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:47:04.033534    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ec2558_281d_4a72_a506_f58338d3bd11.slice/crio-61a425d1ba1bdcf565915dbf0478b705cf0e7e19d939ad1e2ca7ecb673b57279 WatchSource:0}: Error finding container 61a425d1ba1bdcf565915dbf0478b705cf0e7e19d939ad1e2ca7ecb673b57279: Status 404 returned error can't find the container with id 61a425d1ba1bdcf565915dbf0478b705cf0e7e19d939ad1e2ca7ecb673b57279
Sep 17 21:47:04.041713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.041685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:04.134285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.134198    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:04.264469 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.264435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:04.680492 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.680457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9" event={"ID":"65ec2558-281d-4a72-a506-f58338d3bd11","Type":"ContainerStarted","Data":"61a425d1ba1bdcf565915dbf0478b705cf0e7e19d939ad1e2ca7ecb673b57279"}
Sep 17 21:47:04.682390 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.682362    2580 generic.go:356] "Generic (PLEG): container finished" podID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerID="be526abf36012bd22713d40c70c7283d1448d9703fe9f6806d4bda7ab19800d4" exitCode=0
Sep 17 21:47:04.682529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.682452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g" event={"ID":"32dfbbac-39ed-476f-b67d-65765480e0c2","Type":"ContainerDied","Data":"be526abf36012bd22713d40c70c7283d1448d9703fe9f6806d4bda7ab19800d4"}
Sep 17 21:47:04.682529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:04.682505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g" event={"ID":"32dfbbac-39ed-476f-b67d-65765480e0c2","Type":"ContainerStarted","Data":"be66c7d3e41b387a5d8ab6843aa9fd0e239a47be32a5a76390703a244d33c0a5"}
Sep 17 21:47:05.690589 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:05.690555    2580 generic.go:356] "Generic (PLEG): container finished" podID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerID="46f931c004ea1288f90ab93af6e00be51ae8c9fbadcd4200fd625416c14a873d" exitCode=0
Sep 17 21:47:05.691068 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:05.690691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g" event={"ID":"32dfbbac-39ed-476f-b67d-65765480e0c2","Type":"ContainerDied","Data":"46f931c004ea1288f90ab93af6e00be51ae8c9fbadcd4200fd625416c14a873d"}
Sep 17 21:47:07.701881 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:07.701830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9" event={"ID":"65ec2558-281d-4a72-a506-f58338d3bd11","Type":"ContainerStarted","Data":"0f617136edc2bd52351a36490be33531254cb1ec2f9276eaf2115749b46228b5"}
Sep 17 21:47:07.704154 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:07.704127    2580 generic.go:356] "Generic (PLEG): container finished" podID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerID="d41cc2ac9f55614583de904ec238dbf7b337316d1a1601f78b68ac64470c9b87" exitCode=0
Sep 17 21:47:07.704293 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:07.704161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g" event={"ID":"32dfbbac-39ed-476f-b67d-65765480e0c2","Type":"ContainerDied","Data":"d41cc2ac9f55614583de904ec238dbf7b337316d1a1601f78b68ac64470c9b87"}
Sep 17 21:47:08.710778 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.710744    2580 generic.go:356] "Generic (PLEG): container finished" podID="65ec2558-281d-4a72-a506-f58338d3bd11" containerID="0f617136edc2bd52351a36490be33531254cb1ec2f9276eaf2115749b46228b5" exitCode=0
Sep 17 21:47:08.711260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.710843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9" event={"ID":"65ec2558-281d-4a72-a506-f58338d3bd11","Type":"ContainerDied","Data":"0f617136edc2bd52351a36490be33531254cb1ec2f9276eaf2115749b46228b5"}
Sep 17 21:47:08.870786 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.870759    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:08.930521 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.930418    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdqkq\" (UniqueName: \"kubernetes.io/projected/32dfbbac-39ed-476f-b67d-65765480e0c2-kube-api-access-vdqkq\") pod \"32dfbbac-39ed-476f-b67d-65765480e0c2\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") "
Sep 17 21:47:08.930710 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.930566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-bundle\") pod \"32dfbbac-39ed-476f-b67d-65765480e0c2\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") "
Sep 17 21:47:08.930710 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.930585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-util\") pod \"32dfbbac-39ed-476f-b67d-65765480e0c2\" (UID: \"32dfbbac-39ed-476f-b67d-65765480e0c2\") "
Sep 17 21:47:08.931276 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.931252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-bundle" (OuterVolumeSpecName: "bundle") pod "32dfbbac-39ed-476f-b67d-65765480e0c2" (UID: "32dfbbac-39ed-476f-b67d-65765480e0c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:47:08.932603 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:08.932574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32dfbbac-39ed-476f-b67d-65765480e0c2-kube-api-access-vdqkq" (OuterVolumeSpecName: "kube-api-access-vdqkq") pod "32dfbbac-39ed-476f-b67d-65765480e0c2" (UID: "32dfbbac-39ed-476f-b67d-65765480e0c2"). InnerVolumeSpecName "kube-api-access-vdqkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:47:09.032035 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.032008    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdqkq\" (UniqueName: \"kubernetes.io/projected/32dfbbac-39ed-476f-b67d-65765480e0c2-kube-api-access-vdqkq\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:47:09.032035 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.032031    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:47:09.340965 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.340924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-util" (OuterVolumeSpecName: "util") pod "32dfbbac-39ed-476f-b67d-65765480e0c2" (UID: "32dfbbac-39ed-476f-b67d-65765480e0c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:47:09.437358 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.437322    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dfbbac-39ed-476f-b67d-65765480e0c2-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:47:09.717736 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.717627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9" event={"ID":"65ec2558-281d-4a72-a506-f58338d3bd11","Type":"ContainerStarted","Data":"050aa67d99ef31995cab0ea94a2f2b93cca981930864111de32c50209879595a"}
Sep 17 21:47:09.718196 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.717747    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:09.719484 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.719460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g" event={"ID":"32dfbbac-39ed-476f-b67d-65765480e0c2","Type":"ContainerDied","Data":"be66c7d3e41b387a5d8ab6843aa9fd0e239a47be32a5a76390703a244d33c0a5"}
Sep 17 21:47:09.719594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.719501    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be66c7d3e41b387a5d8ab6843aa9fd0e239a47be32a5a76390703a244d33c0a5"
Sep 17 21:47:09.719594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.719504    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mrb7g"
Sep 17 21:47:09.750293 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:09.750249    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9" podStartSLOduration=2.130316035 podStartE2EDuration="6.750234282s" totalImagesPullingTime="3.610583971s" totalInitContainerRuntime="1.009334276s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:47:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:47:09.748090711 +0000 UTC m=+363.269655687" watchObservedRunningTime="2026-09-17 21:47:09.750234282 +0000 UTC m=+363.271799212"
Sep 17 21:47:15.253089 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:15.253046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:15.352005 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:15.351967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:16.099725 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:16.099693    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:20.726062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:20.726037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-555cdfd7b4-lzsc9"
Sep 17 21:47:23.062592 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:23.062556    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:23.248519 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:23.248485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:23.861341 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:23.861297    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:24.049991 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.049964    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"]
Sep 17 21:47:24.050252 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.050241    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerName="util"
Sep 17 21:47:24.050296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.050255    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerName="util"
Sep 17 21:47:24.050296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.050274    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerName="extract"
Sep 17 21:47:24.050296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.050279    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerName="extract"
Sep 17 21:47:24.050296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.050293    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerName="pull"
Sep 17 21:47:24.050418 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.050298    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerName="pull"
Sep 17 21:47:24.050418 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.050342    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32dfbbac-39ed-476f-b67d-65765480e0c2" containerName="extract"
Sep 17 21:47:24.058208 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.058180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.064623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.064594    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 21:47:24.064623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.064607    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 21:47:24.064623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.064618    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 21:47:24.068892 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.068875    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rczrq\""
Sep 17 21:47:24.081505 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.081476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"]
Sep 17 21:47:24.146113 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.146029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:24.166161 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.166133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwdv\" (UniqueName: \"kubernetes.io/projected/58a3a194-c026-436f-bb9c-5237c5268037-kube-api-access-mcwdv\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.166300 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.166165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58a3a194-c026-436f-bb9c-5237c5268037-metrics-cert\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.166300 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.166193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58a3a194-c026-436f-bb9c-5237c5268037-cert\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.166300 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.166274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58a3a194-c026-436f-bb9c-5237c5268037-manager-config\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.267086 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.267051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwdv\" (UniqueName: \"kubernetes.io/projected/58a3a194-c026-436f-bb9c-5237c5268037-kube-api-access-mcwdv\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.267250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.267103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58a3a194-c026-436f-bb9c-5237c5268037-metrics-cert\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.267331 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.267252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58a3a194-c026-436f-bb9c-5237c5268037-cert\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.267386 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.267327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58a3a194-c026-436f-bb9c-5237c5268037-manager-config\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.268323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.268271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58a3a194-c026-436f-bb9c-5237c5268037-manager-config\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.270201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.270171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58a3a194-c026-436f-bb9c-5237c5268037-metrics-cert\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.270607 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.270585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58a3a194-c026-436f-bb9c-5237c5268037-cert\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.297141 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.297119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwdv\" (UniqueName: \"kubernetes.io/projected/58a3a194-c026-436f-bb9c-5237c5268037-kube-api-access-mcwdv\") pod \"lws-controller-manager-7746dd6866-bkc8s\" (UID: \"58a3a194-c026-436f-bb9c-5237c5268037\") " pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.368018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.367987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:24.553667 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.553623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:24.731741 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.731652    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"]
Sep 17 21:47:24.735255 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:47:24.735225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a3a194_c026_436f_bb9c_5237c5268037.slice/crio-06f5e1f8fcc688e3d2b27e03c10c336b587522eb05371712d4d17fbb222aa348 WatchSource:0}: Error finding container 06f5e1f8fcc688e3d2b27e03c10c336b587522eb05371712d4d17fbb222aa348: Status 404 returned error can't find the container with id 06f5e1f8fcc688e3d2b27e03c10c336b587522eb05371712d4d17fbb222aa348
Sep 17 21:47:24.795551 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.795511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s" event={"ID":"58a3a194-c026-436f-bb9c-5237c5268037","Type":"ContainerStarted","Data":"06f5e1f8fcc688e3d2b27e03c10c336b587522eb05371712d4d17fbb222aa348"}
Sep 17 21:47:24.796203 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:24.796167    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:26.806270 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:26.806234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s" event={"ID":"58a3a194-c026-436f-bb9c-5237c5268037","Type":"ContainerStarted","Data":"2eedfd2688ae9ba9ce533c610ee45be4737e83618e8e0b29f4ee224fd46a013c"}
Sep 17 21:47:26.806708 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:26.806350    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:26.870822 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:26.870763    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s" podStartSLOduration=2.517091626 podStartE2EDuration="3.870744518s" totalImagesPullingTime="1.353652892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:47:26.868861583 +0000 UTC m=+380.390426512" watchObservedRunningTime="2026-09-17 21:47:26.870744518 +0000 UTC m=+380.392309453"
Sep 17 21:47:27.778107 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:27.778072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:27.954455 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:27.954415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:29.597823 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:29.597790    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:33.990348 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:33.990313    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ccx8m"]
Sep 17 21:47:33.997879 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:33.995067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.007701 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.006879    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kgf4m\""
Sep 17 21:47:34.007837 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.007724    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 17 21:47:34.009474 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.009445    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ccx8m"]
Sep 17 21:47:34.025576 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.025546    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:34.127722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.127683    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:34.157027 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.156991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch9jz\" (UniqueName: \"kubernetes.io/projected/1918708d-48fb-4908-bfc3-f90195d324a6-kube-api-access-ch9jz\") pod \"odh-model-controller-7998c67dc4-ccx8m\" (UID: \"1918708d-48fb-4908-bfc3-f90195d324a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.157174 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.157059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1918708d-48fb-4908-bfc3-f90195d324a6-cert\") pod \"odh-model-controller-7998c67dc4-ccx8m\" (UID: \"1918708d-48fb-4908-bfc3-f90195d324a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.223538 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.223497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:34.258046 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.257971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1918708d-48fb-4908-bfc3-f90195d324a6-cert\") pod \"odh-model-controller-7998c67dc4-ccx8m\" (UID: \"1918708d-48fb-4908-bfc3-f90195d324a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.258193 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.258044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9jz\" (UniqueName: \"kubernetes.io/projected/1918708d-48fb-4908-bfc3-f90195d324a6-kube-api-access-ch9jz\") pod \"odh-model-controller-7998c67dc4-ccx8m\" (UID: \"1918708d-48fb-4908-bfc3-f90195d324a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.260730 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.260706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1918708d-48fb-4908-bfc3-f90195d324a6-cert\") pod \"odh-model-controller-7998c67dc4-ccx8m\" (UID: \"1918708d-48fb-4908-bfc3-f90195d324a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.267635 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.267599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch9jz\" (UniqueName: \"kubernetes.io/projected/1918708d-48fb-4908-bfc3-f90195d324a6-kube-api-access-ch9jz\") pod \"odh-model-controller-7998c67dc4-ccx8m\" (UID: \"1918708d-48fb-4908-bfc3-f90195d324a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.311503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.311464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:34.343626 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.343592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:34.348292 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.348271    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5v47c"]
Sep 17 21:47:34.351775 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.351751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.354584 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.354564    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 17 21:47:34.354815 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.354801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-pwzxr\""
Sep 17 21:47:34.368679 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.366756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5v47c"]
Sep 17 21:47:34.459337 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.459296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqdwx\" (UniqueName: \"kubernetes.io/projected/385b4a84-1556-4f9d-a21c-5c70d63b8c4b-kube-api-access-bqdwx\") pod \"model-serving-api-54d89bd5fc-5v47c\" (UID: \"385b4a84-1556-4f9d-a21c-5c70d63b8c4b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.459337 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.459338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385b4a84-1556-4f9d-a21c-5c70d63b8c4b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5v47c\" (UID: \"385b4a84-1556-4f9d-a21c-5c70d63b8c4b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.503449 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.503417    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:34.560719 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.560684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqdwx\" (UniqueName: \"kubernetes.io/projected/385b4a84-1556-4f9d-a21c-5c70d63b8c4b-kube-api-access-bqdwx\") pod \"model-serving-api-54d89bd5fc-5v47c\" (UID: \"385b4a84-1556-4f9d-a21c-5c70d63b8c4b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.560877 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.560734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385b4a84-1556-4f9d-a21c-5c70d63b8c4b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5v47c\" (UID: \"385b4a84-1556-4f9d-a21c-5c70d63b8c4b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.563924 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.563899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385b4a84-1556-4f9d-a21c-5c70d63b8c4b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5v47c\" (UID: \"385b4a84-1556-4f9d-a21c-5c70d63b8c4b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.570385 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.570356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqdwx\" (UniqueName: \"kubernetes.io/projected/385b4a84-1556-4f9d-a21c-5c70d63b8c4b-kube-api-access-bqdwx\") pod \"model-serving-api-54d89bd5fc-5v47c\" (UID: \"385b4a84-1556-4f9d-a21c-5c70d63b8c4b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.595068 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.595045    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ccx8m"]
Sep 17 21:47:34.597041 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:47:34.597013    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1918708d_48fb_4908_bfc3_f90195d324a6.slice/crio-d687e252477050edd8a40d1c90a6e9c4337953b2d380d9007793fb79e5b032d4 WatchSource:0}: Error finding container d687e252477050edd8a40d1c90a6e9c4337953b2d380d9007793fb79e5b032d4: Status 404 returned error can't find the container with id d687e252477050edd8a40d1c90a6e9c4337953b2d380d9007793fb79e5b032d4
Sep 17 21:47:34.664783 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.664751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:34.845091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.845005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m" event={"ID":"1918708d-48fb-4908-bfc3-f90195d324a6","Type":"ContainerStarted","Data":"d687e252477050edd8a40d1c90a6e9c4337953b2d380d9007793fb79e5b032d4"}
Sep 17 21:47:34.937087 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:34.937062    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5v47c"]
Sep 17 21:47:34.938856 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:47:34.938826    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385b4a84_1556_4f9d_a21c_5c70d63b8c4b.slice/crio-38294c424622a56d850d98609f49e9f3aeaaf0562d3229500f7526028c074514 WatchSource:0}: Error finding container 38294c424622a56d850d98609f49e9f3aeaaf0562d3229500f7526028c074514: Status 404 returned error can't find the container with id 38294c424622a56d850d98609f49e9f3aeaaf0562d3229500f7526028c074514
Sep 17 21:47:35.855472 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:35.855370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5v47c" event={"ID":"385b4a84-1556-4f9d-a21c-5c70d63b8c4b","Type":"ContainerStarted","Data":"38294c424622a56d850d98609f49e9f3aeaaf0562d3229500f7526028c074514"}
Sep 17 21:47:37.813488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:37.813454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7746dd6866-bkc8s"
Sep 17 21:47:38.882727 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:38.882620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m" event={"ID":"1918708d-48fb-4908-bfc3-f90195d324a6","Type":"ContainerStarted","Data":"1d86687b528026b4e0eda186ee0992227702c5daa323b6cbafffc8ed1a7c26b7"}
Sep 17 21:47:38.883128 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:38.882741    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:38.884559 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:38.884535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5v47c" event={"ID":"385b4a84-1556-4f9d-a21c-5c70d63b8c4b","Type":"ContainerStarted","Data":"193109ae47fe4b46f27dbe3082ba7969b0baf093ef7e504e4d8a5af2fb4fd270"}
Sep 17 21:47:38.884693 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:38.884680    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:47:38.932842 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:38.932792    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m" podStartSLOduration=1.9945632469999999 podStartE2EDuration="5.932775933s" totalImagesPullingTime="3.938212686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:47:38.907532987 +0000 UTC m=+392.429097918" watchObservedRunningTime="2026-09-17 21:47:38.932775933 +0000 UTC m=+392.454340913"
Sep 17 21:47:38.933087 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:38.933067    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5v47c" podStartSLOduration=1.289977976 podStartE2EDuration="4.933062516s" totalImagesPullingTime="3.64308454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:47:38.931050859 +0000 UTC m=+392.452615793" watchObservedRunningTime="2026-09-17 21:47:38.933062516 +0000 UTC m=+392.454627445"
Sep 17 21:47:41.035473 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.035441    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"]
Sep 17 21:47:41.109757 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.109724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"]
Sep 17 21:47:41.109912 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.109845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.112871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.112843    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 21:47:41.113028 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.112873    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 21:47:41.113028 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.112858    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-44x5w\""
Sep 17 21:47:41.113028 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.112897    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 21:47:41.113028 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.112941    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 21:47:41.224250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.224213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.224250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.224247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.224468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.224273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.224468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.224392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75f67\" (UniqueName: \"kubernetes.io/projected/061b096e-d6a7-4284-b7cb-7cef5906a24f-kube-api-access-75f67\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.224468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.224454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.224571 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.224475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b096e-d6a7-4284-b7cb-7cef5906a24f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.224571 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.224498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.325356 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.325262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75f67\" (UniqueName: \"kubernetes.io/projected/061b096e-d6a7-4284-b7cb-7cef5906a24f-kube-api-access-75f67\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.325356 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.325321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.325599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.325429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b096e-d6a7-4284-b7cb-7cef5906a24f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.325599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.325474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.325599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.325524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.325599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.325540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.325599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.325562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.326372 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.326344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.328016 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.327986    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.328124 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.328017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/061b096e-d6a7-4284-b7cb-7cef5906a24f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.328124 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.328064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.328190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.328129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.338123 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.338094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/061b096e-d6a7-4284-b7cb-7cef5906a24f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.338123 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.338118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75f67\" (UniqueName: \"kubernetes.io/projected/061b096e-d6a7-4284-b7cb-7cef5906a24f-kube-api-access-75f67\") pod \"istiod-openshift-gateway-5677ccb49b-z8dj5\" (UID: \"061b096e-d6a7-4284-b7cb-7cef5906a24f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.422109 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.422067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:41.740271 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.740194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"]
Sep 17 21:47:41.743769 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:47:41.743746    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061b096e_d6a7_4284_b7cb_7cef5906a24f.slice/crio-e635ba81a1ffe153853d7bea2d6ede02d1b3735e8cd70c336c1f246dbdf25d82 WatchSource:0}: Error finding container e635ba81a1ffe153853d7bea2d6ede02d1b3735e8cd70c336c1f246dbdf25d82: Status 404 returned error can't find the container with id e635ba81a1ffe153853d7bea2d6ede02d1b3735e8cd70c336c1f246dbdf25d82
Sep 17 21:47:41.902926 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:41.902892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5" event={"ID":"061b096e-d6a7-4284-b7cb-7cef5906a24f","Type":"ContainerStarted","Data":"e635ba81a1ffe153853d7bea2d6ede02d1b3735e8cd70c336c1f246dbdf25d82"}
Sep 17 21:47:44.010638 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.010582    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:47:44.010966 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.010772    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:47:44.057105 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.057050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:44.238652 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.238608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:44.626048 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.625963    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:44.864434 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.864402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:44.921869 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.921772    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5" event={"ID":"061b096e-d6a7-4284-b7cb-7cef5906a24f","Type":"ContainerStarted","Data":"f4f94dd2eb4819f2b7f5eddaa6585e4081ae8f8471edaa04a5f82eb5268f78a1"}
Sep 17 21:47:44.921869 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.921864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:44.981324 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:44.981270    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5" podStartSLOduration=1.716855502 podStartE2EDuration="3.981253832s" totalImagesPullingTime="2.26439833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:47:44.979264283 +0000 UTC m=+398.500829239" watchObservedRunningTime="2026-09-17 21:47:44.981253832 +0000 UTC m=+398.502818763"
Sep 17 21:47:45.119149 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:45.119113    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:45.270817 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:45.270789    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:45.567625 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:45.567586    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:45.674511 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:45.674472    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:45.865511 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:45.865424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:47:45.928466 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:45.928438    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-z8dj5"
Sep 17 21:47:49.892498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:49.892464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ccx8m"
Sep 17 21:47:49.894531 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:47:49.894510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5v47c"
Sep 17 21:48:02.929267 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:02.929235    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fd6b67c-5td7v"]
Sep 17 21:48:02.932744 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:02.932721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:02.953946 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:02.953916    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fd6b67c-5td7v"]
Sep 17 21:48:03.010366 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.010325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-serving-cert\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.010568 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.010376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-oauth-config\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.010568 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.010473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-trusted-ca-bundle\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.010568 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.010517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-config\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.010568 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.010541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9bj\" (UniqueName: \"kubernetes.io/projected/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-kube-api-access-tt9bj\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.010799 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.010604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-oauth-serving-cert\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.010799 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.010642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-service-ca\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.044798 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.044762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:03.111441 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.111404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-oauth-serving-cert\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.111650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.111453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-service-ca\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.111650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.111477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-serving-cert\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.111650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.111506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-oauth-config\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.111650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.111545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-trusted-ca-bundle\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.111650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.111565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-config\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.111650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.111579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9bj\" (UniqueName: \"kubernetes.io/projected/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-kube-api-access-tt9bj\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.112355 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.112327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-service-ca\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.112461 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.112333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-config\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.112527 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.112474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-trusted-ca-bundle\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.112563 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.112493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-oauth-serving-cert\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.114272 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.114251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-serving-cert\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.114373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.114253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-console-oauth-config\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.123905 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.123878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9bj\" (UniqueName: \"kubernetes.io/projected/2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9-kube-api-access-tt9bj\") pod \"console-54fd6b67c-5td7v\" (UID: \"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9\") " pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.148339 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.148306    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:03.242949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.242856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:03.520383 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:03.520350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fd6b67c-5td7v"]
Sep 17 21:48:03.523297 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:48:03.523277    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2702873c_5f51_4b5d_9cdc_a8c9e2e5abb9.slice/crio-c52cf4bd9ce1193292be258a26fc21775a1f9156081ee2ccbfe8b5922bfe8394 WatchSource:0}: Error finding container c52cf4bd9ce1193292be258a26fc21775a1f9156081ee2ccbfe8b5922bfe8394: Status 404 returned error can't find the container with id c52cf4bd9ce1193292be258a26fc21775a1f9156081ee2ccbfe8b5922bfe8394
Sep 17 21:48:04.025785 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:04.025747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fd6b67c-5td7v" event={"ID":"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9","Type":"ContainerStarted","Data":"47086f18c90921d9b2d0c945273452501afcf313e5badea89997b3cf43ea9f5a"}
Sep 17 21:48:04.026189 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:04.025801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fd6b67c-5td7v" event={"ID":"2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9","Type":"ContainerStarted","Data":"c52cf4bd9ce1193292be258a26fc21775a1f9156081ee2ccbfe8b5922bfe8394"}
Sep 17 21:48:04.046212 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:04.046162    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54fd6b67c-5td7v" podStartSLOduration=2.046141878 podStartE2EDuration="2.046141878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:48:04.045433216 +0000 UTC m=+417.566998191" watchObservedRunningTime="2026-09-17 21:48:04.046141878 +0000 UTC m=+417.567706809"
Sep 17 21:48:10.316537 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:10.316497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:10.412142 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:10.412109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:13.243469 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:13.243435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:13.243890 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:13.243495    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:13.249622 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:13.249600    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:14.080967 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:14.080941    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54fd6b67c-5td7v"
Sep 17 21:48:14.134938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:14.134907    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5f586fb4-zptsr"]
Sep 17 21:48:14.281447 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:14.281405    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:14.469352 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:14.469265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:35.274525 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:35.274430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:35.441405 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:35.441371    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:39.157206 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.157160    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f5f586fb4-zptsr" podUID="d8f5e442-7512-4bf1-a51b-d718751281cf" containerName="console" containerID="cri-o://dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147" gracePeriod=15
Sep 17 21:48:39.396480 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.396454    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:48:39.432599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.432527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-console-config\") pod \"d8f5e442-7512-4bf1-a51b-d718751281cf\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") "
Sep 17 21:48:39.432599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.432561    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-trusted-ca-bundle\") pod \"d8f5e442-7512-4bf1-a51b-d718751281cf\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") "
Sep 17 21:48:39.432599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.432587    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-oauth-serving-cert\") pod \"d8f5e442-7512-4bf1-a51b-d718751281cf\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") "
Sep 17 21:48:39.433083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.432623    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-service-ca\") pod \"d8f5e442-7512-4bf1-a51b-d718751281cf\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") "
Sep 17 21:48:39.433083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.432690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jgtk\" (UniqueName: \"kubernetes.io/projected/d8f5e442-7512-4bf1-a51b-d718751281cf-kube-api-access-8jgtk\") pod \"d8f5e442-7512-4bf1-a51b-d718751281cf\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") "
Sep 17 21:48:39.433083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.432744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-serving-cert\") pod \"d8f5e442-7512-4bf1-a51b-d718751281cf\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") "
Sep 17 21:48:39.433083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.432766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-oauth-config\") pod \"d8f5e442-7512-4bf1-a51b-d718751281cf\" (UID: \"d8f5e442-7512-4bf1-a51b-d718751281cf\") "
Sep 17 21:48:39.433391 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.433090    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-console-config" (OuterVolumeSpecName: "console-config") pod "d8f5e442-7512-4bf1-a51b-d718751281cf" (UID: "d8f5e442-7512-4bf1-a51b-d718751281cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:48:39.433391 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.433111    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d8f5e442-7512-4bf1-a51b-d718751281cf" (UID: "d8f5e442-7512-4bf1-a51b-d718751281cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:48:39.433391 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.433119    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8f5e442-7512-4bf1-a51b-d718751281cf" (UID: "d8f5e442-7512-4bf1-a51b-d718751281cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:48:39.433391 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.433277    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8f5e442-7512-4bf1-a51b-d718751281cf" (UID: "d8f5e442-7512-4bf1-a51b-d718751281cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:48:39.435065 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.435031    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8f5e442-7512-4bf1-a51b-d718751281cf" (UID: "d8f5e442-7512-4bf1-a51b-d718751281cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:48:39.435241 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.435217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8f5e442-7512-4bf1-a51b-d718751281cf-kube-api-access-8jgtk" (OuterVolumeSpecName: "kube-api-access-8jgtk") pod "d8f5e442-7512-4bf1-a51b-d718751281cf" (UID: "d8f5e442-7512-4bf1-a51b-d718751281cf"). InnerVolumeSpecName "kube-api-access-8jgtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:48:39.435285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.435223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8f5e442-7512-4bf1-a51b-d718751281cf" (UID: "d8f5e442-7512-4bf1-a51b-d718751281cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:48:39.534038 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.534006    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:39.534038 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.534034    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jgtk\" (UniqueName: \"kubernetes.io/projected/d8f5e442-7512-4bf1-a51b-d718751281cf-kube-api-access-8jgtk\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:39.534038 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.534044    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:39.534261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.534054    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f5e442-7512-4bf1-a51b-d718751281cf-console-oauth-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:39.534261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.534063    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-console-config\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:39.534261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.534070    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-trusted-ca-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:39.534261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:39.534077    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f5e442-7512-4bf1-a51b-d718751281cf-oauth-serving-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:40.013261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.013228    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"]
Sep 17 21:48:40.013569 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.013557    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8f5e442-7512-4bf1-a51b-d718751281cf" containerName="console"
Sep 17 21:48:40.013612 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.013571    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8f5e442-7512-4bf1-a51b-d718751281cf" containerName="console"
Sep 17 21:48:40.013647 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.013632    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8f5e442-7512-4bf1-a51b-d718751281cf" containerName="console"
Sep 17 21:48:40.017062 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.017046    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.019770 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.019746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 21:48:40.020779 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.020757    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hl9xl\""
Sep 17 21:48:40.020871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.020757    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 21:48:40.025269 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.025246    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"]
Sep 17 21:48:40.037671 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.037626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv57c\" (UniqueName: \"kubernetes.io/projected/84819d95-22a6-46c6-9768-5ea42fe42c15-kube-api-access-bv57c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.037802 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.037754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.037802 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.037782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.121570 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.121531    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"]
Sep 17 21:48:40.125079 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.125063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.135243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.135217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"]
Sep 17 21:48:40.138339 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv57c\" (UniqueName: \"kubernetes.io/projected/84819d95-22a6-46c6-9768-5ea42fe42c15-kube-api-access-bv57c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.138429 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.138429 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.138514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw9jf\" (UniqueName: \"kubernetes.io/projected/32e4d3f8-e93c-4502-8a94-c0063808333a-kube-api-access-gw9jf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.138514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.138583 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.138846 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.138890 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.138852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.148270 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.148242    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv57c\" (UniqueName: \"kubernetes.io/projected/84819d95-22a6-46c6-9768-5ea42fe42c15-kube-api-access-bv57c\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.202643 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.202605    2580 generic.go:356] "Generic (PLEG): container finished" podID="d8f5e442-7512-4bf1-a51b-d718751281cf" containerID="dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147" exitCode=0
Sep 17 21:48:40.203047 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.202650    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5f586fb4-zptsr"
Sep 17 21:48:40.203047 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.202702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5f586fb4-zptsr" event={"ID":"d8f5e442-7512-4bf1-a51b-d718751281cf","Type":"ContainerDied","Data":"dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147"}
Sep 17 21:48:40.203047 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.202753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5f586fb4-zptsr" event={"ID":"d8f5e442-7512-4bf1-a51b-d718751281cf","Type":"ContainerDied","Data":"83aef9b7ef812dbef331bbc1ea4988086998ab37665df0fbfd21c5191a7d71f0"}
Sep 17 21:48:40.203047 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.202775    2580 scope.go:117] "RemoveContainer" containerID="dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147"
Sep 17 21:48:40.212506 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.212487    2580 scope.go:117] "RemoveContainer" containerID="dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147"
Sep 17 21:48:40.212798 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:48:40.212779    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147\": container with ID starting with dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147 not found: ID does not exist" containerID="dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147"
Sep 17 21:48:40.212870 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.212813    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147"} err="failed to get container status \"dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147\": rpc error: code = NotFound desc = could not find container \"dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147\": container with ID starting with dd1a6b8abb78226b7b3d17d5a6138a94b5f00e418ce5e85715a3b6bf31e65147 not found: ID does not exist"
Sep 17 21:48:40.220361 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.220338    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"]
Sep 17 21:48:40.225116 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.225099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.229313 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.229292    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5f586fb4-zptsr"]
Sep 17 21:48:40.233952 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.233929    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"]
Sep 17 21:48:40.236040 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.236012    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5f586fb4-zptsr"]
Sep 17 21:48:40.239470 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7bb4\" (UniqueName: \"kubernetes.io/projected/7e4f1610-ef94-4f20-a017-b1f2efad73e8-kube-api-access-q7bb4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.239575 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.239575 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.239575 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.239776 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.239776 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw9jf\" (UniqueName: \"kubernetes.io/projected/32e4d3f8-e93c-4502-8a94-c0063808333a-kube-api-access-gw9jf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.239935 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.239995 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.239921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.248764 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.248742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw9jf\" (UniqueName: \"kubernetes.io/projected/32e4d3f8-e93c-4502-8a94-c0063808333a-kube-api-access-gw9jf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.317197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.317165    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"]
Sep 17 21:48:40.320735 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.320715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.327249 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.327227    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:40.330714 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.330579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"]
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cg6j\" (UniqueName: \"kubernetes.io/projected/59da9a1c-8ac4-4083-b644-a891120b9c5a-kube-api-access-6cg6j\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7bb4\" (UniqueName: \"kubernetes.io/projected/7e4f1610-ef94-4f20-a017-b1f2efad73e8-kube-api-access-q7bb4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.341949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.341650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.350508 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.350489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7bb4\" (UniqueName: \"kubernetes.io/projected/7e4f1610-ef94-4f20-a017-b1f2efad73e8-kube-api-access-q7bb4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.434891 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.434861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:40.442399 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.442374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cg6j\" (UniqueName: \"kubernetes.io/projected/59da9a1c-8ac4-4083-b644-a891120b9c5a-kube-api-access-6cg6j\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.442530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.442421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.442530 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.442440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.442779 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.442762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.442849 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.442796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.452282 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.452257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cg6j\" (UniqueName: \"kubernetes.io/projected/59da9a1c-8ac4-4083-b644-a891120b9c5a-kube-api-access-6cg6j\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.535787 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.535756    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:40.605585 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.605560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"]
Sep 17 21:48:40.608409 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:48:40.608384    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84819d95_22a6_46c6_9768_5ea42fe42c15.slice/crio-c00aa981e7d89588aa6aad6c5985627b810f6dcd123005d0c59f6f24a9107624 WatchSource:0}: Error finding container c00aa981e7d89588aa6aad6c5985627b810f6dcd123005d0c59f6f24a9107624: Status 404 returned error can't find the container with id c00aa981e7d89588aa6aad6c5985627b810f6dcd123005d0c59f6f24a9107624
Sep 17 21:48:40.630927 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.630902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:40.713543 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.713424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"]
Sep 17 21:48:40.811401 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.811377    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"]
Sep 17 21:48:40.813385 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:48:40.813354    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4f1610_ef94_4f20_a017_b1f2efad73e8.slice/crio-11d21cc046775bfc3cc08e8434b262a514d38d82495f6a306918819a9504564c WatchSource:0}: Error finding container 11d21cc046775bfc3cc08e8434b262a514d38d82495f6a306918819a9504564c: Status 404 returned error can't find the container with id 11d21cc046775bfc3cc08e8434b262a514d38d82495f6a306918819a9504564c
Sep 17 21:48:40.925747 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:40.925711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"]
Sep 17 21:48:40.952445 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:48:40.952415    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59da9a1c_8ac4_4083_b644_a891120b9c5a.slice/crio-286a46484509b9198839be140398359c52803c770f80286ef425d256b0b337e4 WatchSource:0}: Error finding container 286a46484509b9198839be140398359c52803c770f80286ef425d256b0b337e4: Status 404 returned error can't find the container with id 286a46484509b9198839be140398359c52803c770f80286ef425d256b0b337e4
Sep 17 21:48:41.025159 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.025126    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8f5e442-7512-4bf1-a51b-d718751281cf" path="/var/lib/kubelet/pods/d8f5e442-7512-4bf1-a51b-d718751281cf/volumes"
Sep 17 21:48:41.210531 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.210434    2580 generic.go:356] "Generic (PLEG): container finished" podID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerID="ea9d48db755b912357ca54bf171f158e371c03382908d55f873a026984cc3e5c" exitCode=0
Sep 17 21:48:41.210531 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.210520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9" event={"ID":"59da9a1c-8ac4-4083-b644-a891120b9c5a","Type":"ContainerDied","Data":"ea9d48db755b912357ca54bf171f158e371c03382908d55f873a026984cc3e5c"}
Sep 17 21:48:41.211079 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.210564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9" event={"ID":"59da9a1c-8ac4-4083-b644-a891120b9c5a","Type":"ContainerStarted","Data":"286a46484509b9198839be140398359c52803c770f80286ef425d256b0b337e4"}
Sep 17 21:48:41.212415 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.212384    2580 generic.go:356] "Generic (PLEG): container finished" podID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerID="edbf0247a453084afa08fab41e7f04ed9835455de1b185f081fdcf36788e2817" exitCode=0
Sep 17 21:48:41.212525 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.212421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4" event={"ID":"32e4d3f8-e93c-4502-8a94-c0063808333a","Type":"ContainerDied","Data":"edbf0247a453084afa08fab41e7f04ed9835455de1b185f081fdcf36788e2817"}
Sep 17 21:48:41.212525 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.212471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4" event={"ID":"32e4d3f8-e93c-4502-8a94-c0063808333a","Type":"ContainerStarted","Data":"a199d38fecca6bba714aa20ea96be3d675fa106d060a018b35dae2eda7b86cc8"}
Sep 17 21:48:41.214066 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.214045    2580 generic.go:356] "Generic (PLEG): container finished" podID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerID="b9723cf789b4184ce3f0c5fdf4a9b4681ab786ac1a18503f1698ac9ffb29e15a" exitCode=0
Sep 17 21:48:41.214140 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.214086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh" event={"ID":"84819d95-22a6-46c6-9768-5ea42fe42c15","Type":"ContainerDied","Data":"b9723cf789b4184ce3f0c5fdf4a9b4681ab786ac1a18503f1698ac9ffb29e15a"}
Sep 17 21:48:41.214140 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.214129    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh" event={"ID":"84819d95-22a6-46c6-9768-5ea42fe42c15","Type":"ContainerStarted","Data":"c00aa981e7d89588aa6aad6c5985627b810f6dcd123005d0c59f6f24a9107624"}
Sep 17 21:48:41.215887 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.215864    2580 generic.go:356] "Generic (PLEG): container finished" podID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerID="92db0fbe057ac56b001fc050af6c860b6ee83227cde2f31f33b276f1a8e796e4" exitCode=0
Sep 17 21:48:41.215981 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.215896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk" event={"ID":"7e4f1610-ef94-4f20-a017-b1f2efad73e8","Type":"ContainerDied","Data":"92db0fbe057ac56b001fc050af6c860b6ee83227cde2f31f33b276f1a8e796e4"}
Sep 17 21:48:41.215981 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:41.215921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk" event={"ID":"7e4f1610-ef94-4f20-a017-b1f2efad73e8","Type":"ContainerStarted","Data":"11d21cc046775bfc3cc08e8434b262a514d38d82495f6a306918819a9504564c"}
Sep 17 21:48:42.224169 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:42.224139    2580 generic.go:356] "Generic (PLEG): container finished" podID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerID="3b739f42b69007903b85bf3e274925ad415aef9820897b62cb4435090847c730" exitCode=0
Sep 17 21:48:42.224619 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:42.224207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4" event={"ID":"32e4d3f8-e93c-4502-8a94-c0063808333a","Type":"ContainerDied","Data":"3b739f42b69007903b85bf3e274925ad415aef9820897b62cb4435090847c730"}
Sep 17 21:48:43.231205 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:43.231171    2580 generic.go:356] "Generic (PLEG): container finished" podID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerID="6ea01953deb2f8e10e70ca5231f084a6f077296e6b9f3058b705dade571ee5bd" exitCode=0
Sep 17 21:48:43.231650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:43.231253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9" event={"ID":"59da9a1c-8ac4-4083-b644-a891120b9c5a","Type":"ContainerDied","Data":"6ea01953deb2f8e10e70ca5231f084a6f077296e6b9f3058b705dade571ee5bd"}
Sep 17 21:48:43.233594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:43.233572    2580 generic.go:356] "Generic (PLEG): container finished" podID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerID="8fda47c1cd2bdc253d4eda05e87112f3617ea9c2a079dd05604fa51012bfeb95" exitCode=0
Sep 17 21:48:43.233720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:43.233673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4" event={"ID":"32e4d3f8-e93c-4502-8a94-c0063808333a","Type":"ContainerDied","Data":"8fda47c1cd2bdc253d4eda05e87112f3617ea9c2a079dd05604fa51012bfeb95"}
Sep 17 21:48:43.235392 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:43.235373    2580 generic.go:356] "Generic (PLEG): container finished" podID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerID="4f0627cf8beb6b95983ef083583e9d0cc0ea46a654a5cbbceabe0ccef6db5767" exitCode=0
Sep 17 21:48:43.235529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:43.235432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk" event={"ID":"7e4f1610-ef94-4f20-a017-b1f2efad73e8","Type":"ContainerDied","Data":"4f0627cf8beb6b95983ef083583e9d0cc0ea46a654a5cbbceabe0ccef6db5767"}
Sep 17 21:48:44.243388 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.243348    2580 generic.go:356] "Generic (PLEG): container finished" podID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerID="3cc0dea29e845e76dace35f8591cc842b8b61c20af57af520dac2fdbd7046d9c" exitCode=0
Sep 17 21:48:44.243859 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.243422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9" event={"ID":"59da9a1c-8ac4-4083-b644-a891120b9c5a","Type":"ContainerDied","Data":"3cc0dea29e845e76dace35f8591cc842b8b61c20af57af520dac2fdbd7046d9c"}
Sep 17 21:48:44.245727 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.245705    2580 generic.go:356] "Generic (PLEG): container finished" podID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerID="4f3919e8bf70b9a7d555f82cfd7a9d8821c0770d37a422d0e6f0f3fa09ea1b0f" exitCode=0
Sep 17 21:48:44.245826 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.245783    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk" event={"ID":"7e4f1610-ef94-4f20-a017-b1f2efad73e8","Type":"ContainerDied","Data":"4f3919e8bf70b9a7d555f82cfd7a9d8821c0770d37a422d0e6f0f3fa09ea1b0f"}
Sep 17 21:48:44.379457 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.379429    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:44.482526 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.482494    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw9jf\" (UniqueName: \"kubernetes.io/projected/32e4d3f8-e93c-4502-8a94-c0063808333a-kube-api-access-gw9jf\") pod \"32e4d3f8-e93c-4502-8a94-c0063808333a\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") "
Sep 17 21:48:44.482728 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.482565    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-util\") pod \"32e4d3f8-e93c-4502-8a94-c0063808333a\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") "
Sep 17 21:48:44.482728 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.482610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-bundle\") pod \"32e4d3f8-e93c-4502-8a94-c0063808333a\" (UID: \"32e4d3f8-e93c-4502-8a94-c0063808333a\") "
Sep 17 21:48:44.483060 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.483033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-bundle" (OuterVolumeSpecName: "bundle") pod "32e4d3f8-e93c-4502-8a94-c0063808333a" (UID: "32e4d3f8-e93c-4502-8a94-c0063808333a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:44.484916 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.484896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e4d3f8-e93c-4502-8a94-c0063808333a-kube-api-access-gw9jf" (OuterVolumeSpecName: "kube-api-access-gw9jf") pod "32e4d3f8-e93c-4502-8a94-c0063808333a" (UID: "32e4d3f8-e93c-4502-8a94-c0063808333a"). InnerVolumeSpecName "kube-api-access-gw9jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:48:44.488021 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.487996    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-util" (OuterVolumeSpecName: "util") pod "32e4d3f8-e93c-4502-8a94-c0063808333a" (UID: "32e4d3f8-e93c-4502-8a94-c0063808333a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:44.583512 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.583483    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:44.583512 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.583510    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw9jf\" (UniqueName: \"kubernetes.io/projected/32e4d3f8-e93c-4502-8a94-c0063808333a-kube-api-access-gw9jf\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:44.583512 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:44.583521    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32e4d3f8-e93c-4502-8a94-c0063808333a-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:45.252444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.252410    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4"
Sep 17 21:48:45.252444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.252437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzqr4" event={"ID":"32e4d3f8-e93c-4502-8a94-c0063808333a","Type":"ContainerDied","Data":"a199d38fecca6bba714aa20ea96be3d675fa106d060a018b35dae2eda7b86cc8"}
Sep 17 21:48:45.253058 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.252488    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a199d38fecca6bba714aa20ea96be3d675fa106d060a018b35dae2eda7b86cc8"
Sep 17 21:48:45.383008 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.382981    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:45.409060 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.409030    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:45.492057 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-bundle\") pod \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") "
Sep 17 21:48:45.492213 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-util\") pod \"59da9a1c-8ac4-4083-b644-a891120b9c5a\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") "
Sep 17 21:48:45.492213 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-util\") pod \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") "
Sep 17 21:48:45.492213 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cg6j\" (UniqueName: \"kubernetes.io/projected/59da9a1c-8ac4-4083-b644-a891120b9c5a-kube-api-access-6cg6j\") pod \"59da9a1c-8ac4-4083-b644-a891120b9c5a\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") "
Sep 17 21:48:45.492213 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492192    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-bundle\") pod \"59da9a1c-8ac4-4083-b644-a891120b9c5a\" (UID: \"59da9a1c-8ac4-4083-b644-a891120b9c5a\") "
Sep 17 21:48:45.492411 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7bb4\" (UniqueName: \"kubernetes.io/projected/7e4f1610-ef94-4f20-a017-b1f2efad73e8-kube-api-access-q7bb4\") pod \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\" (UID: \"7e4f1610-ef94-4f20-a017-b1f2efad73e8\") "
Sep 17 21:48:45.493096 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492679    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-bundle" (OuterVolumeSpecName: "bundle") pod "7e4f1610-ef94-4f20-a017-b1f2efad73e8" (UID: "7e4f1610-ef94-4f20-a017-b1f2efad73e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:45.493096 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.492881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-bundle" (OuterVolumeSpecName: "bundle") pod "59da9a1c-8ac4-4083-b644-a891120b9c5a" (UID: "59da9a1c-8ac4-4083-b644-a891120b9c5a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:45.494691 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.494639    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59da9a1c-8ac4-4083-b644-a891120b9c5a-kube-api-access-6cg6j" (OuterVolumeSpecName: "kube-api-access-6cg6j") pod "59da9a1c-8ac4-4083-b644-a891120b9c5a" (UID: "59da9a1c-8ac4-4083-b644-a891120b9c5a"). InnerVolumeSpecName "kube-api-access-6cg6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:48:45.494970 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.494953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4f1610-ef94-4f20-a017-b1f2efad73e8-kube-api-access-q7bb4" (OuterVolumeSpecName: "kube-api-access-q7bb4") pod "7e4f1610-ef94-4f20-a017-b1f2efad73e8" (UID: "7e4f1610-ef94-4f20-a017-b1f2efad73e8"). InnerVolumeSpecName "kube-api-access-q7bb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:48:45.498800 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.498779    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-util" (OuterVolumeSpecName: "util") pod "7e4f1610-ef94-4f20-a017-b1f2efad73e8" (UID: "7e4f1610-ef94-4f20-a017-b1f2efad73e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:45.499699 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.499677    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-util" (OuterVolumeSpecName: "util") pod "59da9a1c-8ac4-4083-b644-a891120b9c5a" (UID: "59da9a1c-8ac4-4083-b644-a891120b9c5a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:45.593248 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.593224    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:45.593248 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.593248    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cg6j\" (UniqueName: \"kubernetes.io/projected/59da9a1c-8ac4-4083-b644-a891120b9c5a-kube-api-access-6cg6j\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:45.593422 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.593259    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:45.593422 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.593268    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7bb4\" (UniqueName: \"kubernetes.io/projected/7e4f1610-ef94-4f20-a017-b1f2efad73e8-kube-api-access-q7bb4\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:45.593422 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.593276    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e4f1610-ef94-4f20-a017-b1f2efad73e8-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:45.593422 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:45.593285    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59da9a1c-8ac4-4083-b644-a891120b9c5a-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:46.259694 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:46.259643    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9"
Sep 17 21:48:46.259694 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:46.259673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxmrf9" event={"ID":"59da9a1c-8ac4-4083-b644-a891120b9c5a","Type":"ContainerDied","Data":"286a46484509b9198839be140398359c52803c770f80286ef425d256b0b337e4"}
Sep 17 21:48:46.260192 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:46.259723    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="286a46484509b9198839be140398359c52803c770f80286ef425d256b0b337e4"
Sep 17 21:48:46.261835 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:46.261803    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk"
Sep 17 21:48:46.261835 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:46.261817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d767pjk" event={"ID":"7e4f1610-ef94-4f20-a017-b1f2efad73e8","Type":"ContainerDied","Data":"11d21cc046775bfc3cc08e8434b262a514d38d82495f6a306918819a9504564c"}
Sep 17 21:48:46.261993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:46.261853    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11d21cc046775bfc3cc08e8434b262a514d38d82495f6a306918819a9504564c"
Sep 17 21:48:50.923587 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:50.923549    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:48:53.300186 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:53.300145    2580 generic.go:356] "Generic (PLEG): container finished" podID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerID="40c0d14641a86fc9f3d6e74b793dd40bbea1ff29f3fe5eb074cc33d8b8b8d5f8" exitCode=0
Sep 17 21:48:53.300579 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:53.300232    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh" event={"ID":"84819d95-22a6-46c6-9768-5ea42fe42c15","Type":"ContainerDied","Data":"40c0d14641a86fc9f3d6e74b793dd40bbea1ff29f3fe5eb074cc33d8b8b8d5f8"}
Sep 17 21:48:54.307273 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:54.307239    2580 generic.go:356] "Generic (PLEG): container finished" podID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerID="58dac9d4d04af5955e2a3066b1f39a46933b088af3f9778d0e4d8988c2650db9" exitCode=0
Sep 17 21:48:54.307631 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:54.307325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh" event={"ID":"84819d95-22a6-46c6-9768-5ea42fe42c15","Type":"ContainerDied","Data":"58dac9d4d04af5955e2a3066b1f39a46933b088af3f9778d0e4d8988c2650db9"}
Sep 17 21:48:55.437874 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.437850    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:55.484197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.484163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv57c\" (UniqueName: \"kubernetes.io/projected/84819d95-22a6-46c6-9768-5ea42fe42c15-kube-api-access-bv57c\") pod \"84819d95-22a6-46c6-9768-5ea42fe42c15\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") "
Sep 17 21:48:55.484197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.484193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-util\") pod \"84819d95-22a6-46c6-9768-5ea42fe42c15\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") "
Sep 17 21:48:55.484379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.484274    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-bundle\") pod \"84819d95-22a6-46c6-9768-5ea42fe42c15\" (UID: \"84819d95-22a6-46c6-9768-5ea42fe42c15\") "
Sep 17 21:48:55.484955 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.484926    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-bundle" (OuterVolumeSpecName: "bundle") pod "84819d95-22a6-46c6-9768-5ea42fe42c15" (UID: "84819d95-22a6-46c6-9768-5ea42fe42c15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:55.486433 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.486404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84819d95-22a6-46c6-9768-5ea42fe42c15-kube-api-access-bv57c" (OuterVolumeSpecName: "kube-api-access-bv57c") pod "84819d95-22a6-46c6-9768-5ea42fe42c15" (UID: "84819d95-22a6-46c6-9768-5ea42fe42c15"). InnerVolumeSpecName "kube-api-access-bv57c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:48:55.489227 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.489207    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-util" (OuterVolumeSpecName: "util") pod "84819d95-22a6-46c6-9768-5ea42fe42c15" (UID: "84819d95-22a6-46c6-9768-5ea42fe42c15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:48:55.585892 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.585814    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv57c\" (UniqueName: \"kubernetes.io/projected/84819d95-22a6-46c6-9768-5ea42fe42c15-kube-api-access-bv57c\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:55.585892 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.585838    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-util\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:55.585892 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:55.585848    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84819d95-22a6-46c6-9768-5ea42fe42c15-bundle\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:48:56.319047 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:56.319014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh" event={"ID":"84819d95-22a6-46c6-9768-5ea42fe42c15","Type":"ContainerDied","Data":"c00aa981e7d89588aa6aad6c5985627b810f6dcd123005d0c59f6f24a9107624"}
Sep 17 21:48:56.319222 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:56.319064    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c00aa981e7d89588aa6aad6c5985627b810f6dcd123005d0c59f6f24a9107624"
Sep 17 21:48:56.319222 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:56.319021    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahtldh"
Sep 17 21:48:58.899151 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:48:58.899119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:01.736369 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:01.736331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:02.073001 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:02.072968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:02.486457 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:02.486362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:03.436459 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:03.436423    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:05.181722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:05.181683    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:05.288824 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:05.288786    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:05.742600 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:05.742558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:06.245849 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:06.245812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:06.959335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:06.959306    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:08.844354 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:08.844325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:09.052520 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:09.052488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:11.710472 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:11.710438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:11.817696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:11.817649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:13.791538 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:13.791506    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:13.943200 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:13.943171    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:16.889446 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:16.889412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:16.959917 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:16.959878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:17.116122 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:17.116080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:17.215297 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:17.215217    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:17.362101 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:17.362051    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:17.580235 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:17.580206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:25.637564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:25.637536    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:25.861645 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:25.861611    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:28.467032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:28.467002    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:28.571834 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:28.571800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:31.073830 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:31.073794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:31.173928 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:31.173888    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:36.657387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:36.657341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:36.782409 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:36.782371    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:37.053472 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:37.053441    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:37.157971 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:37.157936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:37.579105 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:37.579069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:37.751262 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:37.751214    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:45.583967 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:45.583933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:45.770785 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:45.770749    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:45.877529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:45.877443    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:48.449498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:48.449467    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:48.587619 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:48.587588    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:48.888038 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:48.888001    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:48.989347 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:48.989309    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:56.291703 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:56.291645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:56.394098 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:56.394054    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:56.556606 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:56.556525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:56.635106 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:56.635071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:59.426474 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:59.426366    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:59.595339 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:59.595312    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:49:59.971236 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:49:59.971200    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:00.073168 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073126    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:50:00.073494 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073478    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerName="pull"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073498    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerName="pull"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073507    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerName="pull"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073513    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerName="pull"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073519    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerName="util"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073525    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerName="util"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073531    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerName="extract"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073536    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerName="extract"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073543    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerName="util"
Sep 17 21:50:00.073549 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073548    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerName="util"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073556    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerName="util"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073561    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerName="util"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073569    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerName="pull"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073574    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerName="pull"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073580    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerName="pull"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073585    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerName="pull"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073591    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073595    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073600    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073606    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073640    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerName="util"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073646    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerName="util"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073671    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073677    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073737    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="84819d95-22a6-46c6-9768-5ea42fe42c15" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073743    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e4d3f8-e93c-4502-8a94-c0063808333a" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073748    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e4f1610-ef94-4f20-a017-b1f2efad73e8" containerName="extract"
Sep 17 21:50:00.073862 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.073754    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="59da9a1c-8ac4-4083-b644-a891120b9c5a" containerName="extract"
Sep 17 21:50:00.076511 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.076496    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.079565 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.079542    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 21:50:00.079816 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.079789    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 21:50:00.079927 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.079866    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 21:50:00.081025 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.081007    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rlbmk\""
Sep 17 21:50:00.105503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.105472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:50:00.123695 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.123650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:50:00.134733 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.134704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsmb5\" (UniqueName: \"kubernetes.io/projected/8389e4fc-7b79-4d63-84e6-e57d82f9b4d9-kube-api-access-nsmb5\") pod \"limitador-limitador-84994f7ffc-fpqzq\" (UID: \"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.134828 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.134755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8389e4fc-7b79-4d63-84e6-e57d82f9b4d9-config-file\") pod \"limitador-limitador-84994f7ffc-fpqzq\" (UID: \"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.236271 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.236181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8389e4fc-7b79-4d63-84e6-e57d82f9b4d9-config-file\") pod \"limitador-limitador-84994f7ffc-fpqzq\" (UID: \"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.236271 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.236268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsmb5\" (UniqueName: \"kubernetes.io/projected/8389e4fc-7b79-4d63-84e6-e57d82f9b4d9-kube-api-access-nsmb5\") pod \"limitador-limitador-84994f7ffc-fpqzq\" (UID: \"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.236843 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.236823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8389e4fc-7b79-4d63-84e6-e57d82f9b4d9-config-file\") pod \"limitador-limitador-84994f7ffc-fpqzq\" (UID: \"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.245894 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.245873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsmb5\" (UniqueName: \"kubernetes.io/projected/8389e4fc-7b79-4d63-84e6-e57d82f9b4d9-kube-api-access-nsmb5\") pod \"limitador-limitador-84994f7ffc-fpqzq\" (UID: \"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.387236 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.387201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:00.453477 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.453436    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:00.563871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.563836    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:00.664182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:00.664156    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:50:00.665709 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:50:00.665685    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8389e4fc_7b79_4d63_84e6_e57d82f9b4d9.slice/crio-3cbaf3d84ef589601d722fd71a924ea7bfd7f09b0034f078dc830aa8ea18c96c WatchSource:0}: Error finding container 3cbaf3d84ef589601d722fd71a924ea7bfd7f09b0034f078dc830aa8ea18c96c: Status 404 returned error can't find the container with id 3cbaf3d84ef589601d722fd71a924ea7bfd7f09b0034f078dc830aa8ea18c96c
Sep 17 21:50:01.660997 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:01.660961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq" event={"ID":"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9","Type":"ContainerStarted","Data":"3cbaf3d84ef589601d722fd71a924ea7bfd7f09b0034f078dc830aa8ea18c96c"}
Sep 17 21:50:10.715866 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:10.715823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq" event={"ID":"8389e4fc-7b79-4d63-84e6-e57d82f9b4d9","Type":"ContainerStarted","Data":"0dfa2eb40cd9ac387233885736e87b98d98837c5a39c8e373b1a6d11a8fc6ccc"}
Sep 17 21:50:10.716254 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:10.715926    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:10.738970 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:10.738918    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq" podStartSLOduration=1.5517764619999999 podStartE2EDuration="10.738902716s" totalImagesPullingTime="9.187126254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:50:10.736375409 +0000 UTC m=+544.257940339" watchObservedRunningTime="2026-09-17 21:50:10.738902716 +0000 UTC m=+544.260467676"
Sep 17 21:50:21.721867 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:21.721836    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"
Sep 17 21:50:25.651144 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:25.651065    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:25.999354 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:25.999260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:26.275384 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:26.275350    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:38.706217 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:38.706181    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:38.943146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:38.943113    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:46.150475 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:46.150442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:46.248134 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:46.248104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:46.352389 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:46.352343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:46.452852 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:46.452757    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:49.952974 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:49.952932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:50.068901 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:50.068860    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:50:56.091982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:50:56.091948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:08.368525 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:08.368415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:51:08.372604 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:08.369475    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:51:21.565711 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:21.565647    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:21.644577 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:21.644524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:24.972573 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:24.972532    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:25.067784 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:25.067756    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:26.580415 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:26.580378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:26.680403 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:26.680366    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:26.781777 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:26.781732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:27.003686 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:27.003576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:27.132809 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:27.132778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:27.233615 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:27.233586    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:27.695344 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:27.695311    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:51:37.777021 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:37.776922    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:38.981092 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:38.981050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:47.139138 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:47.139106    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:51:47.798169 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:51:47.798135    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:52:19.463518 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:19.463485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:52:20.467680 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:20.467622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:52:25.444854 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:25.444817    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:52:37.140734 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.140698    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"]
Sep 17 21:52:37.144369 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.144343    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.154048 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.154021    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v95hl\""
Sep 17 21:52:37.154731 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.154695    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 21:52:37.154945 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.154924    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 21:52:37.155069 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.154924    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 17 21:52:37.157241 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.157218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"]
Sep 17 21:52:37.185762 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.185724    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:52:37.291109 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.291065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.291296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.291116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.291296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.291173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.291296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.291234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.291296 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.291293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e65646a-b852-47f9-803b-ff30b08c0248-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.291458 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.291316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6629x\" (UniqueName: \"kubernetes.io/projected/6e65646a-b852-47f9-803b-ff30b08c0248-kube-api-access-6629x\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392123 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392123 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e65646a-b852-47f9-803b-ff30b08c0248-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6629x\" (UniqueName: \"kubernetes.io/projected/6e65646a-b852-47f9-803b-ff30b08c0248-kube-api-access-6629x\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.392731 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.392711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.394703 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.394682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e65646a-b852-47f9-803b-ff30b08c0248-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.394984 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.394964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e65646a-b852-47f9-803b-ff30b08c0248-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.401022 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.400993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6629x\" (UniqueName: \"kubernetes.io/projected/6e65646a-b852-47f9-803b-ff30b08c0248-kube-api-access-6629x\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b\" (UID: \"6e65646a-b852-47f9-803b-ff30b08c0248\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.464096 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.464052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:37.743650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.743622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"]
Sep 17 21:52:37.745529 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:52:37.745501    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e65646a_b852_47f9_803b_ff30b08c0248.slice/crio-b89ddb5b17a0708b5dd229f5fa48a1ecd7bb3a5ea54d8b369c5d0ba4edab6090 WatchSource:0}: Error finding container b89ddb5b17a0708b5dd229f5fa48a1ecd7bb3a5ea54d8b369c5d0ba4edab6090: Status 404 returned error can't find the container with id b89ddb5b17a0708b5dd229f5fa48a1ecd7bb3a5ea54d8b369c5d0ba4edab6090
Sep 17 21:52:37.746923 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:37.746905    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 21:52:38.161829 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:38.161795    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:52:38.488594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:38.488503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b" event={"ID":"6e65646a-b852-47f9-803b-ff30b08c0248","Type":"ContainerStarted","Data":"b89ddb5b17a0708b5dd229f5fa48a1ecd7bb3a5ea54d8b369c5d0ba4edab6090"}
Sep 17 21:52:39.495961 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:39.495925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b" event={"ID":"6e65646a-b852-47f9-803b-ff30b08c0248","Type":"ContainerStarted","Data":"5bbd2f2545bdeb4ca6d7373b2ef0073c86647216e56bfb7bba5fcfcc0c26f206"}
Sep 17 21:52:39.516957 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:39.516898    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b" podStartSLOduration=1.508196648 podStartE2EDuration="2.51688034s" totalImagesPullingTime="1.008683692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:52:39.514818484 +0000 UTC m=+693.036383425" watchObservedRunningTime="2026-09-17 21:52:39.51688034 +0000 UTC m=+693.038445270"
Sep 17 21:52:47.464767 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:47.464729    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:47.465174 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:47.464785    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:47.477341 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:47.477309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:47.551844 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:47.551815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b"
Sep 17 21:52:58.652345 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:52:58.652260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:53:00.114249 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:00.114215    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:53:07.784342 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:07.784301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:53:09.460320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:09.460276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:53:24.307799 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:24.307757    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:53:24.905373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:24.905339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:53:27.165592 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:27.165562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:53:52.134313 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:52.134280    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:53:54.585444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:53:54.585410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:54:08.467439 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:54:08.467402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:54:38.418954 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:54:38.418854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:14.667038 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:14.667005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:14.896282 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:14.896248    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:15.710928 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:15.710893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:15.813087 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:15.813058    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:18.169597 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:18.169562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:18.271510 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:18.271477    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:31.621413 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:31.621375    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:31.733226 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:31.733196    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:31.849060 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:31.849016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:32.074544 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.074513    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:32.298491 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.298457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:32.352323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.352248    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"]
Sep 17 21:55:32.355738 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.355723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.381423 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.381401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-dbe8a7-openshift-default-dockercfg-txswm\""
Sep 17 21:55:32.428744 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-data\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.428938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-envoy\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.428938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-certs\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.428938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvhnq\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-kube-api-access-qvhnq\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.428938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-socket\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.428938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istiod-ca-cert\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.428938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-podinfo\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.428938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-credential-socket\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.429189 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.428965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-token\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.529496 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.529462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"]
Sep 17 21:55:32.529852 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.529818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-data\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.529961 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.529887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-envoy\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.529961 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.529915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-certs\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.529961 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.529935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvhnq\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-kube-api-access-qvhnq\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.529961 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.529952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-socket\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.530187 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.529973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istiod-ca-cert\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.530187 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.530101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-podinfo\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.530187 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.530150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-credential-socket\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.530187 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.530175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-token\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.530394 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.530329    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-certs\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.530999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.530977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istiod-ca-cert\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.530999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.530998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-data\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.531233 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.531210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-credential-socket\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.531328 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.531289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-socket\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.532618 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.532595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-envoy\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.533258 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.533233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-podinfo\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.544182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.544160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvhnq\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-kube-api-access-qvhnq\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.545676 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.545632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-token\") pod \"e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") " pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.562490 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.562455    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:32.665888 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.665809    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:32.784329 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.784292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:32.955320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:32.955291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"]
Sep 17 21:55:32.957127 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:55:32.957091    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacadecce_4d1b_4169_812a_b2d1f1b6c5d1.slice/crio-e3fc1d7024dabfb7871cf4e8dfb4ea5ac464e01d72684c24aef6d6825ed6679e WatchSource:0}: Error finding container e3fc1d7024dabfb7871cf4e8dfb4ea5ac464e01d72684c24aef6d6825ed6679e: Status 404 returned error can't find the container with id e3fc1d7024dabfb7871cf4e8dfb4ea5ac464e01d72684c24aef6d6825ed6679e
Sep 17 21:55:33.203712 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.203638    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:33.328361 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.328326    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:33.413358 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.413325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" event={"ID":"acadecce-4d1b-4169-812a-b2d1f1b6c5d1","Type":"ContainerStarted","Data":"e3fc1d7024dabfb7871cf4e8dfb4ea5ac464e01d72684c24aef6d6825ed6679e"}
Sep 17 21:55:33.687039 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.686951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:33.745735 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.745697    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7832-c2a191"]
Sep 17 21:55:33.749626 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.749605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:33.752767 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.752747    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lbp7g\""
Sep 17 21:55:33.759690 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.759635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7832-c2a191"]
Sep 17 21:55:33.840224 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.840182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jzck\" (UniqueName: \"kubernetes.io/projected/0cb54272-11e4-4eeb-977c-aa5a88285073-kube-api-access-9jzck\") pod \"test-curl-7832-c2a191\" (UID: \"0cb54272-11e4-4eeb-977c-aa5a88285073\") " pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:33.941104 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.941017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jzck\" (UniqueName: \"kubernetes.io/projected/0cb54272-11e4-4eeb-977c-aa5a88285073-kube-api-access-9jzck\") pod \"test-curl-7832-c2a191\" (UID: \"0cb54272-11e4-4eeb-977c-aa5a88285073\") " pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:33.956186 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:33.956159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jzck\" (UniqueName: \"kubernetes.io/projected/0cb54272-11e4-4eeb-977c-aa5a88285073-kube-api-access-9jzck\") pod \"test-curl-7832-c2a191\" (UID: \"0cb54272-11e4-4eeb-977c-aa5a88285073\") " pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:34.062384 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:34.062353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:34.356970 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:34.356944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7832-c2a191"]
Sep 17 21:55:34.359728 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:55:34.359684    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cb54272_11e4_4eeb_977c_aa5a88285073.slice/crio-008cf526f8ee637095f74acd747490d0454c98837c554c4ad1ec7b34e6cdcb61 WatchSource:0}: Error finding container 008cf526f8ee637095f74acd747490d0454c98837c554c4ad1ec7b34e6cdcb61: Status 404 returned error can't find the container with id 008cf526f8ee637095f74acd747490d0454c98837c554c4ad1ec7b34e6cdcb61
Sep 17 21:55:34.421954 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:34.421918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7832-c2a191" event={"ID":"0cb54272-11e4-4eeb-977c-aa5a88285073","Type":"ContainerStarted","Data":"008cf526f8ee637095f74acd747490d0454c98837c554c4ad1ec7b34e6cdcb61"}
Sep 17 21:55:35.610387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:35.610349    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:35.610720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:35.610428    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:35.610720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:35.610457    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:35.650893 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:35.650852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:35.771392 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:35.771353    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:35.865557 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:35.865398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:36.304768 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:36.304735    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:55:36.435532 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:36.435489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" event={"ID":"acadecce-4d1b-4169-812a-b2d1f1b6c5d1","Type":"ContainerStarted","Data":"f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2"}
Sep 17 21:55:36.437134 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:36.437109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7832-c2a191" event={"ID":"0cb54272-11e4-4eeb-977c-aa5a88285073","Type":"ContainerStarted","Data":"3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23"}
Sep 17 21:55:36.516237 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:36.516181    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podStartSLOduration=1.865285789 podStartE2EDuration="4.516164284s" totalImagesPullingTime="2.650878495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:55:36.510889939 +0000 UTC m=+870.032454869" watchObservedRunningTime="2026-09-17 21:55:36.516164284 +0000 UTC m=+870.037729213"
Sep 17 21:55:36.548046 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:36.547991    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7832-c2a191" podStartSLOduration=2.302873064 podStartE2EDuration="3.547975972s" totalImagesPullingTime="1.245102908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:55:36.546272592 +0000 UTC m=+870.067837518" watchObservedRunningTime="2026-09-17 21:55:36.547975972 +0000 UTC m=+870.069540956"
Sep 17 21:55:36.666282 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:36.666202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:36.671114 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:36.671088    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:37.018404 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.018373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:37.262537 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.262505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:37.443130 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.443030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:37.443947 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.443930    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:55:37.540214 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.540179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:37.554694 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.554637    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7832-c2a191"]
Sep 17 21:55:37.566257 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.566228    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7832-c2a191"]
Sep 17 21:55:37.731193 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.731104    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7832-9b3ec6"]
Sep 17 21:55:37.731564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.731467    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" containerName="test-curl-7832-c2a191"
Sep 17 21:55:37.731564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.731478    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" containerName="test-curl-7832-c2a191"
Sep 17 21:55:37.731564 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.731544    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" containerName="test-curl-7832-c2a191"
Sep 17 21:55:37.734695 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.734650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:37.760511 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.760480    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7832-9b3ec6"]
Sep 17 21:55:37.779713 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.779652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp6gq\" (UniqueName: \"kubernetes.io/projected/63e810c1-6d5b-46f8-a647-280c41d2ea25-kube-api-access-mp6gq\") pod \"test-curl-7832-9b3ec6\" (UID: \"63e810c1-6d5b-46f8-a647-280c41d2ea25\") " pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:37.880514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.880473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6gq\" (UniqueName: \"kubernetes.io/projected/63e810c1-6d5b-46f8-a647-280c41d2ea25-kube-api-access-mp6gq\") pod \"test-curl-7832-9b3ec6\" (UID: \"63e810c1-6d5b-46f8-a647-280c41d2ea25\") " pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:37.897717 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:37.897693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp6gq\" (UniqueName: \"kubernetes.io/projected/63e810c1-6d5b-46f8-a647-280c41d2ea25-kube-api-access-mp6gq\") pod \"test-curl-7832-9b3ec6\" (UID: \"63e810c1-6d5b-46f8-a647-280c41d2ea25\") " pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:38.043475 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.043443    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:38.159197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.159165    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:38.293630 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.293542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:38.329987 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.329956    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7832-9b3ec6"]
Sep 17 21:55:38.332973 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:55:38.332934    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63e810c1_6d5b_46f8_a647_280c41d2ea25.slice/crio-a0a2916e3f86eb9493df98359be4fda852171d60134e7a183929d02a19f12790 WatchSource:0}: Error finding container a0a2916e3f86eb9493df98359be4fda852171d60134e7a183929d02a19f12790: Status 404 returned error can't find the container with id a0a2916e3f86eb9493df98359be4fda852171d60134e7a183929d02a19f12790
Sep 17 21:55:38.450897 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.450859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7832-9b3ec6" event={"ID":"63e810c1-6d5b-46f8-a647-280c41d2ea25","Type":"ContainerStarted","Data":"a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1"}
Sep 17 21:55:38.451106 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.450905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7832-9b3ec6" event={"ID":"63e810c1-6d5b-46f8-a647-280c41d2ea25","Type":"ContainerStarted","Data":"a0a2916e3f86eb9493df98359be4fda852171d60134e7a183929d02a19f12790"}
Sep 17 21:55:38.451106 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.450917    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7832-c2a191" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" containerName="test-curl-7832-c2a191" containerID="cri-o://3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23" gracePeriod=2
Sep 17 21:55:38.514289 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:38.514250    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7832-c2a191\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:38.515948 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.515897    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7832-9b3ec6" podStartSLOduration=1.5158773920000002 podStartE2EDuration="1.515877392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:55:38.511937846 +0000 UTC m=+872.033502788" watchObservedRunningTime="2026-09-17 21:55:38.515877392 +0000 UTC m=+872.037442322"
Sep 17 21:55:38.516913 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:38.516886    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7832-c2a191\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:38.965152 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.965069    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"]
Sep 17 21:55:38.968718 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.968693    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:38.974206 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.974183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6a6c05-serving-cert\""
Sep 17 21:55:38.974631 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.974547    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bvxx5\""
Sep 17 21:55:38.974631 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:38.974568    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7832-c2a191\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:38.974631 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.974619    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 21:55:38.974878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.974600    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 21:55:38.978680 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.975626    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 21:55:38.989171 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.989140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-metrics-certs\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:38.989301 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.989177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:38.989301 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.989289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00397f4d-a2c4-427d-b229-cc29d990a9fb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:38.989377 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:38.989325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xll5t\" (UniqueName: \"kubernetes.io/projected/00397f4d-a2c4-427d-b229-cc29d990a9fb-kube-api-access-xll5t\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.004526 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.004485    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"]
Sep 17 21:55:39.020853 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.020809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:39.090414 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.090375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00397f4d-a2c4-427d-b229-cc29d990a9fb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.090414 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.090418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xll5t\" (UniqueName: \"kubernetes.io/projected/00397f4d-a2c4-427d-b229-cc29d990a9fb-kube-api-access-xll5t\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.090716 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.090458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-metrics-certs\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.090716 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.090485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.090716 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:39.090575    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-serving-cert: secret "maas-api-e2e-inf-a-6a6c05-serving-cert" not found
Sep 17 21:55:39.090716 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:39.090634    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls podName:00397f4d-a2c4-427d-b229-cc29d990a9fb nodeName:}" failed. No retries permitted until 2026-09-17 21:55:39.590615305 +0000 UTC m=+873.112180215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls") pod "maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh" (UID: "00397f4d-a2c4-427d-b229-cc29d990a9fb") : secret "maas-api-e2e-inf-a-6a6c05-serving-cert" not found
Sep 17 21:55:39.091206 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.091150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00397f4d-a2c4-427d-b229-cc29d990a9fb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.093213 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.093184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-metrics-certs\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.113804 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.113772    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xll5t\" (UniqueName: \"kubernetes.io/projected/00397f4d-a2c4-427d-b229-cc29d990a9fb-kube-api-access-xll5t\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.211424 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.211386    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:39.441931 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.441893    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7832-9b3ec6"]
Sep 17 21:55:39.458383 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.458354    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7832-9b3ec6"]
Sep 17 21:55:39.592941 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.592907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:39.594950 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.594926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.597553 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.597531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls\") pod \"maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:39.882506 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:39.882461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:40.227747 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.227721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"]
Sep 17 21:55:40.229202 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:55:40.229177    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00397f4d_a2c4_427d_b229_cc29d990a9fb.slice/crio-780682b08f7356d53d53c71fb696c90358335a5cf7cd91b23e08d2015e58bed6 WatchSource:0}: Error finding container 780682b08f7356d53d53c71fb696c90358335a5cf7cd91b23e08d2015e58bed6: Status 404 returned error can't find the container with id 780682b08f7356d53d53c71fb696c90358335a5cf7cd91b23e08d2015e58bed6
Sep 17 21:55:40.263473 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.263441    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:40.463952 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.463919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh" event={"ID":"00397f4d-a2c4-427d-b229-cc29d990a9fb","Type":"ContainerStarted","Data":"780682b08f7356d53d53c71fb696c90358335a5cf7cd91b23e08d2015e58bed6"}
Sep 17 21:55:40.464089 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.464002    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7832-9b3ec6" podUID="63e810c1-6d5b-46f8-a647-280c41d2ea25" containerName="test-curl-7832-9b3ec6" containerID="cri-o://a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1" gracePeriod=2
Sep 17 21:55:40.466446 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:40.466419    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7832-9b3ec6\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" podUID="63e810c1-6d5b-46f8-a647-280c41d2ea25" pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:40.642102 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.642077    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:40.660511 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:40.660465    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7832-9b3ec6\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" podUID="63e810c1-6d5b-46f8-a647-280c41d2ea25" pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:40.704509 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.704476    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jzck\" (UniqueName: \"kubernetes.io/projected/0cb54272-11e4-4eeb-977c-aa5a88285073-kube-api-access-9jzck\") pod \"0cb54272-11e4-4eeb-977c-aa5a88285073\" (UID: \"0cb54272-11e4-4eeb-977c-aa5a88285073\") "
Sep 17 21:55:40.707216 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.707183    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cb54272-11e4-4eeb-977c-aa5a88285073-kube-api-access-9jzck" (OuterVolumeSpecName: "kube-api-access-9jzck") pod "0cb54272-11e4-4eeb-977c-aa5a88285073" (UID: "0cb54272-11e4-4eeb-977c-aa5a88285073"). InnerVolumeSpecName "kube-api-access-9jzck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:55:40.805848 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.805804    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jzck\" (UniqueName: \"kubernetes.io/projected/0cb54272-11e4-4eeb-977c-aa5a88285073-kube-api-access-9jzck\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:55:40.935783 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:40.935735    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:41.029016 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:41.028980    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cb54272-11e4-4eeb-977c-aa5a88285073" path="/var/lib/kubelet/pods/0cb54272-11e4-4eeb-977c-aa5a88285073/volumes"
Sep 17 21:55:41.282002 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:41.281968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:41.472326 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:41.472290    2580 generic.go:356] "Generic (PLEG): container finished" podID="0cb54272-11e4-4eeb-977c-aa5a88285073" containerID="3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23" exitCode=137
Sep 17 21:55:41.472516 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:41.472336    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-c2a191"
Sep 17 21:55:41.472516 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:41.472398    2580 scope.go:117] "RemoveContainer" containerID="3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23"
Sep 17 21:55:41.523816 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:41.523700    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:42.489567 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.489412    2580 scope.go:117] "RemoveContainer" containerID="3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23"
Sep 17 21:55:42.489918 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:42.489772    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23\": container with ID starting with 3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23 not found: ID does not exist" containerID="3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23"
Sep 17 21:55:42.489918 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.489798    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23"} err="failed to get container status \"3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23\": rpc error: code = NotFound desc = could not find container \"3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23\": container with ID starting with 3ccff732bb8606b15293737ac3ef1cf496269661b4ee2d60512ce650df27ed23 not found: ID does not exist"
Sep 17 21:55:42.642153 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.642117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:42.681254 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.681227    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:42.727028 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.726947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp6gq\" (UniqueName: \"kubernetes.io/projected/63e810c1-6d5b-46f8-a647-280c41d2ea25-kube-api-access-mp6gq\") pod \"63e810c1-6d5b-46f8-a647-280c41d2ea25\" (UID: \"63e810c1-6d5b-46f8-a647-280c41d2ea25\") "
Sep 17 21:55:42.729230 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.729201    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e810c1-6d5b-46f8-a647-280c41d2ea25-kube-api-access-mp6gq" (OuterVolumeSpecName: "kube-api-access-mp6gq") pod "63e810c1-6d5b-46f8-a647-280c41d2ea25" (UID: "63e810c1-6d5b-46f8-a647-280c41d2ea25"). InnerVolumeSpecName "kube-api-access-mp6gq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:55:42.828520 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.828482    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp6gq\" (UniqueName: \"kubernetes.io/projected/63e810c1-6d5b-46f8-a647-280c41d2ea25-kube-api-access-mp6gq\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:55:42.849225 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.849187    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:42.975789 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:42.975750    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:43.031110 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.031074    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e810c1-6d5b-46f8-a647-280c41d2ea25" path="/var/lib/kubelet/pods/63e810c1-6d5b-46f8-a647-280c41d2ea25/volumes"
Sep 17 21:55:43.485510 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.485405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh" event={"ID":"00397f4d-a2c4-427d-b229-cc29d990a9fb","Type":"ContainerStarted","Data":"ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8"}
Sep 17 21:55:43.485773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.485567    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:43.486747 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.486717    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e810c1-6d5b-46f8-a647-280c41d2ea25" containerID="a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1" exitCode=137
Sep 17 21:55:43.486858 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.486758    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7832-9b3ec6"
Sep 17 21:55:43.486858 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.486808    2580 scope.go:117] "RemoveContainer" containerID="a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1"
Sep 17 21:55:43.496100 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.495882    2580 scope.go:117] "RemoveContainer" containerID="a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1"
Sep 17 21:55:43.496345 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:43.496197    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1\": container with ID starting with a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1 not found: ID does not exist" containerID="a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1"
Sep 17 21:55:43.496345 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.496221    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1"} err="failed to get container status \"a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1\": rpc error: code = NotFound desc = could not find container \"a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1\": container with ID starting with a2f84437101a3df011c863e5dce3e7f5a453d6a63ec9d926d0e04985b67379c1 not found: ID does not exist"
Sep 17 21:55:43.536406 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:43.536354    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh" podStartSLOduration=3.223371407 podStartE2EDuration="5.536338058s" totalImagesPullingTime="2.312966651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:55:43.534639426 +0000 UTC m=+877.056204376" watchObservedRunningTime="2026-09-17 21:55:43.536338058 +0000 UTC m=+877.057903026"
Sep 17 21:55:44.032845 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:44.032754    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:44.349433 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:44.349337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:45.109974 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:45.109937    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:45.392572 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:45.392486    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:45.584387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:45.584358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:48.696690 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:48.696640    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:49.391989 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:49.391956    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:49.499669 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:49.499629    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 21:55:49.693697 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:49.693590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:49.991842 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:49.991749    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:50.140571 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.140538    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"]
Sep 17 21:55:50.140910 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.140896    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e810c1-6d5b-46f8-a647-280c41d2ea25" containerName="test-curl-7832-9b3ec6"
Sep 17 21:55:50.140960 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.140912    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e810c1-6d5b-46f8-a647-280c41d2ea25" containerName="test-curl-7832-9b3ec6"
Sep 17 21:55:50.140996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.140985    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e810c1-6d5b-46f8-a647-280c41d2ea25" containerName="test-curl-7832-9b3ec6"
Sep 17 21:55:50.144151 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.144134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.147715 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.147696    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4b89cb58-openshift-default-dockercfg-crq45\""
Sep 17 21:55:50.186392 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.186360    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"]
Sep 17 21:55:50.197817 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.197791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-envoy\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.197954 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.197823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-podinfo\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.197954 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.197890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-token\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.197954 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.197917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljkf\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-kube-api-access-jljkf\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.198075 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.197994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-certs\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.198075 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.198033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-data\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.198148 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.198102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-socket\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.198148 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.198127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-credential-socket\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.198233 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.198151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istiod-ca-cert\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.272208 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.272174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:50.298795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.298761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-socket\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.298795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.298794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-credential-socket\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299024 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.298812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istiod-ca-cert\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299024 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.298929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-envoy\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299024 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.298948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-podinfo\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299184 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-token\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299184 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljkf\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-kube-api-access-jljkf\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299184 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-certs\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299184 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-data\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-socket\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299373 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-credential-socket\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299719 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-data\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299816 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istiod-ca-cert\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.299816 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.299785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-certs\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.301276 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.301257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-envoy\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.301608 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.301590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-podinfo\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.351332 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.351297    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljkf\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-kube-api-access-jljkf\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.365024 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.364996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-token\") pod \"e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") " pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.454219 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.454184    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:50.760711 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.760615    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"]
Sep 17 21:55:50.763748 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:55:50.763721    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7a94d9_6fcb_4203_ac42_1600a5ede7fb.slice/crio-6a909302c4c88d082e230ae426204d0827877e2774b92865d0b0d8ab1c6f710a WatchSource:0}: Error finding container 6a909302c4c88d082e230ae426204d0827877e2774b92865d0b0d8ab1c6f710a: Status 404 returned error can't find the container with id 6a909302c4c88d082e230ae426204d0827877e2774b92865d0b0d8ab1c6f710a
Sep 17 21:55:50.766074 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.766045    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:50.766153 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.766106    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:50.766153 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.766134    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:50.773780 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.773758    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:50.915262 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:50.915212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:51.387809 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:51.387781    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:51.532981 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:51.532892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" event={"ID":"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb","Type":"ContainerStarted","Data":"c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40"}
Sep 17 21:55:51.532981 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:51.532948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" event={"ID":"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb","Type":"ContainerStarted","Data":"6a909302c4c88d082e230ae426204d0827877e2774b92865d0b0d8ab1c6f710a"}
Sep 17 21:55:51.594852 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:51.594819    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:51.596116 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:51.596077    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podStartSLOduration=1.596063249 podStartE2EDuration="1.596063249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:55:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:55:51.594942634 +0000 UTC m=+885.116507567" watchObservedRunningTime="2026-09-17 21:55:51.596063249 +0000 UTC m=+885.117628178"
Sep 17 21:55:52.455175 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.455144    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:52.460251 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.460223    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:52.538448 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.538416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:52.539331 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.539310    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:55:52.655997 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.655968    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"]
Sep 17 21:55:52.659467 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.659450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.671413 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.671391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-9e9409-serving-cert\""
Sep 17 21:55:52.699943 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.699915    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"]
Sep 17 21:55:52.724457 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.724368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-metrics-certs\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.724457 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.724426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e86b5-f430-49a7-9706-132a24174ead-openshift-service-ca\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.724641 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.724518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.724641 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.724583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8r6\" (UniqueName: \"kubernetes.io/projected/2b0e86b5-f430-49a7-9706-132a24174ead-kube-api-access-kr8r6\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.825467 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.825427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-metrics-certs\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.825724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.825493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e86b5-f430-49a7-9706-132a24174ead-openshift-service-ca\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.825724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.825533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.825724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.825572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8r6\" (UniqueName: \"kubernetes.io/projected/2b0e86b5-f430-49a7-9706-132a24174ead-kube-api-access-kr8r6\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.825724 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:52.825699    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-serving-cert: secret "maas-api-e2e-autores-9e9409-serving-cert" not found
Sep 17 21:55:52.825939 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:52.825779    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls podName:2b0e86b5-f430-49a7-9706-132a24174ead nodeName:}" failed. No retries permitted until 2026-09-17 21:55:53.325757053 +0000 UTC m=+886.847321963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls") pod "maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t" (UID: "2b0e86b5-f430-49a7-9706-132a24174ead") : secret "maas-api-e2e-autores-9e9409-serving-cert" not found
Sep 17 21:55:52.826269 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.826250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e86b5-f430-49a7-9706-132a24174ead-openshift-service-ca\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.828106 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.828083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-metrics-certs\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.842942 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.842914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8r6\" (UniqueName: \"kubernetes.io/projected/2b0e86b5-f430-49a7-9706-132a24174ead-kube-api-access-kr8r6\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:52.965362 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:52.965324    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:53.331543 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:53.331488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:53.334287 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:53.334255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls\") pod \"maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:53.385407 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:53.385365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:53.569378 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:53.569342    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:53.918390 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:55:53.918329    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0e86b5_f430_49a7_9706_132a24174ead.slice/crio-4293cd75ff925388c479a276405030c2b456de51caefe96bf9a3351c68469c56 WatchSource:0}: Error finding container 4293cd75ff925388c479a276405030c2b456de51caefe96bf9a3351c68469c56: Status 404 returned error can't find the container with id 4293cd75ff925388c479a276405030c2b456de51caefe96bf9a3351c68469c56
Sep 17 21:55:53.928224 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:53.928194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"]
Sep 17 21:55:53.945143 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:53.945115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:54.190700 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:54.190579    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:54.553303 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:54.553262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t" event={"ID":"2b0e86b5-f430-49a7-9706-132a24174ead","Type":"ContainerStarted","Data":"a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9"}
Sep 17 21:55:54.553478 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:54.553458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:55:54.553521 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:54.553489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t" event={"ID":"2b0e86b5-f430-49a7-9706-132a24174ead","Type":"ContainerStarted","Data":"4293cd75ff925388c479a276405030c2b456de51caefe96bf9a3351c68469c56"}
Sep 17 21:55:54.603039 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:54.602986    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t" podStartSLOduration=2.264411533 podStartE2EDuration="2.602968444s" totalImagesPullingTime="338.556911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:55:54.600782559 +0000 UTC m=+888.122347506" watchObservedRunningTime="2026-09-17 21:55:54.602968444 +0000 UTC m=+888.124533741"
Sep 17 21:55:55.049070 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:55.049037    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:55.226300 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:55.226265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:55.754264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:55.754230    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:56.124760 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.124732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:56.500644 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.500550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:56.689555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.689524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:56.769832 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.769806    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"]
Sep 17 21:55:56.774172 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.774153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.784157 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:56.784132    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.784258 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:55:56.784164    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-inf-b-3d5c73-openshift-default-dockercfg-r25gg\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3d5c73-openshift-default-dockercfg-r25gg\"" type="*v1.Secret"
Sep 17 21:55:56.822226 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.822197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"]
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.866904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-credential-socket\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.866997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-certs\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.867090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45cc95e-2333-4f36-8ce7-3ef938109542-istiod-ca-cert\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.867163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbnp6\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-kube-api-access-cbnp6\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.867272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-socket\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.867303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-data\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.867327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-podinfo\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.867372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-envoy\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.867517 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.867437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-token\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45cc95e-2333-4f36-8ce7-3ef938109542-istiod-ca-cert\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968408 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbnp6\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-kube-api-access-cbnp6\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968408 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-socket\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968551 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-data\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968551 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-podinfo\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968551 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-envoy\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968551 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-token\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968777 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-credential-socket\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968777 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-certs\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968867 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-data\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.968935 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.968893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-socket\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.969049 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.969026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45cc95e-2333-4f36-8ce7-3ef938109542-istiod-ca-cert\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.969187 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.969048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-credential-socket\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.969245 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.969202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-certs\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.971018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.970998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-envoy\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.971092 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.971029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-podinfo\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.991850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.991822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-token\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:56.994924 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:56.994896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbnp6\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-kube-api-access-cbnp6\") pod \"e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") " pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:57.039557 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.039457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:57.298716 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.298608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:57.656423 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.656346    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3d5c73-openshift-default-dockercfg-r25gg\""
Sep 17 21:55:57.666598 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.666572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:57.969242 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.969217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"]
Sep 17 21:55:57.971109 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:55:57.971080    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45cc95e_2333_4f36_8ce7_3ef938109542.slice/crio-5525a9294962d848c002aa91a1174134a78ceaabae3dc7cb794850087d199f0f WatchSource:0}: Error finding container 5525a9294962d848c002aa91a1174134a78ceaabae3dc7cb794850087d199f0f: Status 404 returned error can't find the container with id 5525a9294962d848c002aa91a1174134a78ceaabae3dc7cb794850087d199f0f
Sep 17 21:55:57.973268 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.973233    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:57.973346 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.973302    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:57.973346 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:57.973330    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:55:58.295470 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:58.295395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:58.577020 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:58.576921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" event={"ID":"f45cc95e-2333-4f36-8ce7-3ef938109542","Type":"ContainerStarted","Data":"bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047"}
Sep 17 21:55:58.577020 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:58.576973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" event={"ID":"f45cc95e-2333-4f36-8ce7-3ef938109542","Type":"ContainerStarted","Data":"5525a9294962d848c002aa91a1174134a78ceaabae3dc7cb794850087d199f0f"}
Sep 17 21:55:58.653741 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:58.653688    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podStartSLOduration=2.653672194 podStartE2EDuration="2.653672194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:55:58.648768412 +0000 UTC m=+892.170333359" watchObservedRunningTime="2026-09-17 21:55:58.653672194 +0000 UTC m=+892.175237114"
Sep 17 21:55:58.667362 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:58.667330    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:55:58.862391 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:58.862299    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:55:59.417260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:59.417223    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:55:59.672949 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:55:59.672875    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:56:00.565859 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:00.565825    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:56:00.588785 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:00.588755    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:56:00.589760 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:00.589737    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:56:01.398054 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:01.398017    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:01.804142 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:01.804100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:02.363415 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:02.363369    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:03.951157 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:03.951117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:04.197557 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:04.197514    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:04.485716 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:04.485649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:04.832514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:04.832477    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:06.009720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:06.009683    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:06.261470 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:06.261384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:07.303585 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:07.303529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:08.413236 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:08.413211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:56:08.417198 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:08.417173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 21:56:08.484882 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:08.484847    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 21:56:08.485058 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:08.484928    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 21:56:09.227436 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:09.227404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:10.595032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:10.594992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:10.655474 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:10.655389    2580 generic.go:356] "Generic (PLEG): container finished" podID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerID="f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2" exitCode=0
Sep 17 21:56:10.655474 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:10.655458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" event={"ID":"acadecce-4d1b-4169-812a-b2d1f1b6c5d1","Type":"ContainerDied","Data":"f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2"}
Sep 17 21:56:10.655935 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:10.655909    2580 scope.go:117] "RemoveContainer" containerID="f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2"
Sep 17 21:56:10.657197 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:10.657162    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:10.657276 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:10.657262    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:10.657323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:10.657297    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:11.662916 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.662881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" event={"ID":"acadecce-4d1b-4169-812a-b2d1f1b6c5d1","Type":"ContainerStarted","Data":"2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87"}
Sep 17 21:56:11.666370 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.666351    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:56:11.666640 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.666618    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 17 21:56:11.666755 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.666688    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 17 21:56:11.803839 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.803798    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"]
Sep 17 21:56:11.807425 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.807401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:11.811058 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.811033    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3d5c73-serving-cert\""
Sep 17 21:56:11.829251 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.829218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"]
Sep 17 21:56:11.857059 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.857023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:11.914784 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.914686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6dsc\" (UniqueName: \"kubernetes.io/projected/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-kube-api-access-f6dsc\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:11.914962 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.914801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:11.914962 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.914893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:11.914962 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.914922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-metrics-certs\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:11.982165 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:11.982128    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:12.015727 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.015684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.015919 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.015794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.015919 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.015831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-metrics-certs\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.015919 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:56:12.015857    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-serving-cert: secret "maas-api-e2e-inf-b-3d5c73-serving-cert" not found
Sep 17 21:56:12.015919 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.015884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6dsc\" (UniqueName: \"kubernetes.io/projected/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-kube-api-access-f6dsc\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.016171 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:56:12.015952    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls podName:bf3e0217-8b4f-4a65-ad8c-f73faddfb586 nodeName:}" failed. No retries permitted until 2026-09-17 21:56:12.515925323 +0000 UTC m=+906.037490233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls") pod "maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm" (UID: "bf3e0217-8b4f-4a65-ad8c-f73faddfb586") : secret "maas-api-e2e-inf-b-3d5c73-serving-cert" not found
Sep 17 21:56:12.016860 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.016830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.019496 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.019462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-metrics-certs\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.049245 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.049211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6dsc\" (UniqueName: \"kubernetes.io/projected/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-kube-api-access-f6dsc\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.310670 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.310613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:12.520866 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.520815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.524317 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.524275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls\") pod \"maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.666317 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.666227    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 17 21:56:12.666317 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.666279    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 17 21:56:12.720915 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.720869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:12.794071 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.794033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:12.930253 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:12.930157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:13.040596 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:13.040564    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"]
Sep 17 21:56:13.040799 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:56:13.040779    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3e0217_8b4f_4a65_ad8c_f73faddfb586.slice/crio-158192c69be4889c122f32f7027694dd56b20c507fa568d41318f2ba90525617 WatchSource:0}: Error finding container 158192c69be4889c122f32f7027694dd56b20c507fa568d41318f2ba90525617: Status 404 returned error can't find the container with id 158192c69be4889c122f32f7027694dd56b20c507fa568d41318f2ba90525617
Sep 17 21:56:13.666699 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:13.666557    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 17 21:56:13.666699 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:13.666619    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 17 21:56:13.676344 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:13.676284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm" event={"ID":"bf3e0217-8b4f-4a65-ad8c-f73faddfb586","Type":"ContainerStarted","Data":"4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed"}
Sep 17 21:56:13.676498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:13.676360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:13.676498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:13.676380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm" event={"ID":"bf3e0217-8b4f-4a65-ad8c-f73faddfb586","Type":"ContainerStarted","Data":"158192c69be4889c122f32f7027694dd56b20c507fa568d41318f2ba90525617"}
Sep 17 21:56:13.731903 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:13.731843    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm" podStartSLOduration=2.374301625 podStartE2EDuration="2.731820623s" totalImagesPullingTime="357.518998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:56:13.727806312 +0000 UTC m=+907.249371245" watchObservedRunningTime="2026-09-17 21:56:13.731820623 +0000 UTC m=+907.253385553"
Sep 17 21:56:14.123434 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:14.123372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:14.667111 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:14.667077    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 17 21:56:14.667494 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:14.667127    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 17 21:56:15.159617 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:15.159578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:15.602960 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:15.602918    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:15.667212 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:15.667180    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 17 21:56:15.667621 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:15.667233    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 17 21:56:16.667169 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:16.667127    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 17 21:56:16.667357 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:16.667190    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 17 21:56:17.133353 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:17.133314    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:17.741895 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:17.741860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:56:17.742330 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:17.742246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:56:17.743822 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:17.743801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 21:56:18.745075 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:18.745041    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:19.687674 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:19.687630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 21:56:20.103650 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:20.103619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:20.707974 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:20.707934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:20.835505 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:20.835473    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:20.972900 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:20.972784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:21.393525 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:21.393488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:22.678589 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:22.678507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:23.394874 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.394689    2580 patch_prober.go:28] interesting pod/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:40588->10.132.0.48:15021: read: connection reset by peer" start-of-body=
Sep 17 21:56:23.394874 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.394780    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:40588->10.132.0.48:15021: read: connection reset by peer"
Sep 17 21:56:23.635147 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.635067    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:56:23.740291 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.740212    2580 generic.go:356] "Generic (PLEG): container finished" podID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerID="c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40" exitCode=0
Sep 17 21:56:23.740291 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.740283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" event={"ID":"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb","Type":"ContainerDied","Data":"c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40"}
Sep 17 21:56:23.740724 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.740685    2580 scope.go:117] "RemoveContainer" containerID="c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40"
Sep 17 21:56:23.742009 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.741979    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:23.742093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.742049    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:23.742093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:23.742080    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:24.253299 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:24.253191    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:24.748157 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:24.748123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" event={"ID":"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb","Type":"ContainerStarted","Data":"796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6"}
Sep 17 21:56:25.440835 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:25.440793    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:25.455592 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:25.455560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:56:25.455819 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:25.455710    2580 patch_prober.go:28] interesting pod/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 17 21:56:25.455819 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:25.455771    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 17 21:56:26.248006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:26.247963    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:26.454601 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:26.454561    2580 patch_prober.go:28] interesting pod/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 17 21:56:26.454806 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:26.454618    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 17 21:56:26.848529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:26.848491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:27.454947 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:27.454901    2580 patch_prober.go:28] interesting pod/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 17 21:56:27.455470 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:27.454955    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 17 21:56:27.991836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:27.991800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:28.455488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:28.455437    2580 patch_prober.go:28] interesting pod/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 17 21:56:28.456001 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:28.455504    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 17 21:56:28.775506 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:28.775480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:28.889236 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:28.889210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:28.990021 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:28.989995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:29.148714 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:29.148592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:29.454736 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:29.454613    2580 patch_prober.go:28] interesting pod/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 17 21:56:29.454736 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:29.454708    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 17 21:56:29.751983 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:29.751891    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:30.459102 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:30.459068    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:56:30.459490 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:30.459465    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:56:30.460195 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:30.460172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:56:30.773094 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:30.773061    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:31.630851 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:31.630807    2580 patch_prober.go:28] interesting pod/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 21:56:31.631031 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:31.630904    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 21:56:31.733896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:31.733857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:33.806815 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:33.806731    2580 generic.go:356] "Generic (PLEG): container finished" podID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerID="bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047" exitCode=0
Sep 17 21:56:33.806815 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:33.806795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" event={"ID":"f45cc95e-2333-4f36-8ce7-3ef938109542","Type":"ContainerDied","Data":"bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047"}
Sep 17 21:56:33.807276 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:33.807234    2580 scope.go:117] "RemoveContainer" containerID="bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047"
Sep 17 21:56:33.808412 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:33.808382    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:33.808496 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:33.808451    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:33.808496 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:33.808479    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:34.818982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:34.818943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" event={"ID":"f45cc95e-2333-4f36-8ce7-3ef938109542","Type":"ContainerStarted","Data":"8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902"}
Sep 17 21:56:35.667585 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:35.667547    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:56:35.667838 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:35.667821    2580 patch_prober.go:28] interesting pod/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 17 21:56:35.667898 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:35.667873    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 17 21:56:35.839063 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:35.839029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:35.946788 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:35.946650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:36.061783 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.061748    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:36.160850 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.160823    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:36.256019 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.255918    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:36.345235 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.345200    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"]
Sep 17 21:56:36.345421 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.345387    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy" containerID="cri-o://796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6" gracePeriod=30
Sep 17 21:56:36.396514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.396484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:36.663184 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.663148    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:36.667516 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.667491    2580 patch_prober.go:28] interesting pod/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 17 21:56:36.667642 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.667543    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 17 21:56:36.886765 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:36.886725    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:37.096848 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.096813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:37.269940 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.269904    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:37.593784 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.593745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:37.639377 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.639348    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"]
Sep 17 21:56:37.642339 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.642306    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.648215 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.648194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a0a97fdf-gw-openshift-default-dockercfg-2dlm4\""
Sep 17 21:56:37.667544 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.667504    2580 patch_prober.go:28] interesting pod/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 17 21:56:37.667755 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.667570    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 17 21:56:37.669939 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.669914    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"]
Sep 17 21:56:37.772594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.772558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-certs\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.772594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.772596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-token\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.772887 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.772621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-podinfo\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.772887 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.772715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-data\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.772887 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.772850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-socket\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.773051 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.772930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-credential-socket\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.773051 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.772972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b6efa7-89c8-4858-a37a-e37028ed6160-istiod-ca-cert\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.773051 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.773022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krxz2\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-kube-api-access-krxz2\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.773235 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.773059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-envoy\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.820685 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.816508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:37.874689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-certs\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-token\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-podinfo\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-data\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-socket\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-credential-socket\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b6efa7-89c8-4858-a37a-e37028ed6160-istiod-ca-cert\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krxz2\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-kube-api-access-krxz2\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.874993 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.874873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-envoy\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.875255 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.875055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-certs\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.875255 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.875148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-socket\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.875342 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.875320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-data\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.875406 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.875356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-credential-socket\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.875563 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.875544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b6efa7-89c8-4858-a37a-e37028ed6160-istiod-ca-cert\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.877193 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.877174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-envoy\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.877335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.877318    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-podinfo\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.896946 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.896912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krxz2\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-kube-api-access-krxz2\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.897359 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.897165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-token\") pod \"e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") " pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:37.954544 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:37.954505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:38.130352 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.130265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:38.263299 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.263267    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"]
Sep 17 21:56:38.267003 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:56:38.266974    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b6efa7_89c8_4858_a37a_e37028ed6160.slice/crio-6ec875e1f813b294f5cf1e79581087b33190a75ab58765ff9f1adba21d36ec47 WatchSource:0}: Error finding container 6ec875e1f813b294f5cf1e79581087b33190a75ab58765ff9f1adba21d36ec47: Status 404 returned error can't find the container with id 6ec875e1f813b294f5cf1e79581087b33190a75ab58765ff9f1adba21d36ec47
Sep 17 21:56:38.269406 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.269373    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:38.269467 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.269443    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:38.269516 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.269475    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:56:38.314430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.314356    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:38.667348 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.667319    2580 patch_prober.go:28] interesting pod/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 17 21:56:38.667538 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.667370    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 17 21:56:38.852332 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.852294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" event={"ID":"c2b6efa7-89c8-4858-a37a-e37028ed6160","Type":"ContainerStarted","Data":"1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a"}
Sep 17 21:56:38.852518 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.852345    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" event={"ID":"c2b6efa7-89c8-4858-a37a-e37028ed6160","Type":"ContainerStarted","Data":"6ec875e1f813b294f5cf1e79581087b33190a75ab58765ff9f1adba21d36ec47"}
Sep 17 21:56:38.880894 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.880841    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" podStartSLOduration=1.880825883 podStartE2EDuration="1.880825883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:56:38.879908708 +0000 UTC m=+932.401473654" watchObservedRunningTime="2026-09-17 21:56:38.880825883 +0000 UTC m=+932.402390812"
Sep 17 21:56:38.955047 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:38.954969    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:39.468637 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:39.468600    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:39.667017 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:39.666979    2580 patch_prober.go:28] interesting pod/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 17 21:56:39.667225 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:39.667047    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 17 21:56:39.961145 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:39.961116    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:40.671362 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:40.671319    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:56:40.671685 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:40.671638    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:56:40.672504 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:40.672482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 21:56:40.865385 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:40.865349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:40.866251 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:40.866233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:56:40.882651 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:40.882622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:56:40.896687 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:40.896623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:41.593879 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.593856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:56:41.672722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.672628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:41.713698 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713643    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-envoy\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.713876 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-certs\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.713876 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713780    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istiod-ca-cert\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.713876 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713819    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-socket\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.713876 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-token\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.714091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713906    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-data\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.714091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713990    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-podinfo\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.714091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.713986    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:56:41.714091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714017    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-credential-socket\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.714091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714051    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljkf\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-kube-api-access-jljkf\") pod \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\" (UID: \"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb\") "
Sep 17 21:56:41.714320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714131    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:56:41.714320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714188    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:56:41.714320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:56:41.714320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714298    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:56:41.714529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714483    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.714529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714502    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.714529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714516    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.714529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714529    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.714931 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.714542    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.716503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.716479    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 21:56:41.716623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.716479    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:56:41.716623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.716522    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:56:41.716623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.716546    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-kube-api-access-jljkf" (OuterVolumeSpecName: "kube-api-access-jljkf") pod "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" (UID: "cc7a94d9-6fcb-4203-ac42-1600a5ede7fb"). InnerVolumeSpecName "kube-api-access-jljkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:56:41.815108 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.815068    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.815108 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.815101    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.815108 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.815113    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljkf\" (UniqueName: \"kubernetes.io/projected/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-kube-api-access-jljkf\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.815342 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.815123    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:56:41.873053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.873023    2580 generic.go:356] "Generic (PLEG): container finished" podID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerID="796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6" exitCode=0
Sep 17 21:56:41.873227 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.873095    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"
Sep 17 21:56:41.873227 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.873105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" event={"ID":"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb","Type":"ContainerDied","Data":"796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6"}
Sep 17 21:56:41.873227 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.873199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb" event={"ID":"cc7a94d9-6fcb-4203-ac42-1600a5ede7fb","Type":"ContainerDied","Data":"6a909302c4c88d082e230ae426204d0827877e2774b92865d0b0d8ab1c6f710a"}
Sep 17 21:56:41.873377 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.873242    2580 scope.go:117] "RemoveContainer" containerID="796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6"
Sep 17 21:56:41.883813 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.883789    2580 scope.go:117] "RemoveContainer" containerID="c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40"
Sep 17 21:56:41.893200 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.893179    2580 scope.go:117] "RemoveContainer" containerID="796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6"
Sep 17 21:56:41.893503 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:56:41.893482    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6\": container with ID starting with 796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6 not found: ID does not exist" containerID="796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6"
Sep 17 21:56:41.893579 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.893518    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6"} err="failed to get container status \"796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6\": rpc error: code = NotFound desc = could not find container \"796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6\": container with ID starting with 796791588e82739ee60a098c9a552b59ad5a9db8580c9f09f3e6ff370a1324c6 not found: ID does not exist"
Sep 17 21:56:41.893579 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.893543    2580 scope.go:117] "RemoveContainer" containerID="c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40"
Sep 17 21:56:41.893871 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:56:41.893855    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40\": container with ID starting with c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40 not found: ID does not exist" containerID="c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40"
Sep 17 21:56:41.893929 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.893878    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40"} err="failed to get container status \"c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40\": rpc error: code = NotFound desc = could not find container \"c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40\": container with ID starting with c69e3b609891e110066667d0a8fb31b1522f0326dc58af48e5a1fbe8f8d8fd40 not found: ID does not exist"
Sep 17 21:56:41.925551 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.925466    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"]
Sep 17 21:56:41.936419 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:41.936375    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4b89cb58-openshift-default-b4885c7db-c6pmb"]
Sep 17 21:56:42.909243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:42.909205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:43.024409 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.024374    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" path="/var/lib/kubelet/pods/cc7a94d9-6fcb-4203-ac42-1600a5ede7fb/volumes"
Sep 17 21:56:43.845466 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.845435    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"]
Sep 17 21:56:43.845951 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.845932    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy"
Sep 17 21:56:43.846086 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.845953    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy"
Sep 17 21:56:43.846086 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.845976    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy"
Sep 17 21:56:43.846086 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.845985    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy"
Sep 17 21:56:43.846245 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.846097    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy"
Sep 17 21:56:43.846245 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.846111    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7a94d9-6fcb-4203-ac42-1600a5ede7fb" containerName="istio-proxy"
Sep 17 21:56:43.849287 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.849266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:43.852330 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.852312    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a0a97fdf-serving-cert\""
Sep 17 21:56:43.863446 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.863423    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"]
Sep 17 21:56:43.892510 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.892470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:43.936918 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.936888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-maas-api-tls\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:43.937301 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.936932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-openshift-service-ca\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:43.937301 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.936976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-metrics-certs\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:43.937301 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.937011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzscc\" (UniqueName: \"kubernetes.io/projected/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-kube-api-access-dzscc\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:43.987258 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:43.987225    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:44.038442 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.038397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-metrics-certs\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.038752 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.038727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzscc\" (UniqueName: \"kubernetes.io/projected/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-kube-api-access-dzscc\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.038964 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.038947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-maas-api-tls\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.039108 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.039093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-openshift-service-ca\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.039953 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.039870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-openshift-service-ca\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.043432 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.043395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-metrics-certs\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.043734 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.043688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-maas-api-tls\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.058590 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.058561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzscc\" (UniqueName: \"kubernetes.io/projected/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-kube-api-access-dzscc\") pod \"maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.105404 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.105323    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:44.159437 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.159399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:44.438268 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.438245    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"]
Sep 17 21:56:44.439975 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:56:44.439949    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a9b8d9_b87c_4901_bfce_8dc3f24d4e6f.slice/crio-8da6469ab8b5fc81063414e0d06d6616644c0f00773a887cbc765749b8063138 WatchSource:0}: Error finding container 8da6469ab8b5fc81063414e0d06d6616644c0f00773a887cbc765749b8063138: Status 404 returned error can't find the container with id 8da6469ab8b5fc81063414e0d06d6616644c0f00773a887cbc765749b8063138
Sep 17 21:56:44.631679 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.631628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:44.760772 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.760648    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:44.895625 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:44.895597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8" event={"ID":"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f","Type":"ContainerStarted","Data":"8da6469ab8b5fc81063414e0d06d6616644c0f00773a887cbc765749b8063138"}
Sep 17 21:56:45.308190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:45.308159    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:45.903435 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:45.903333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8" event={"ID":"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f","Type":"ContainerStarted","Data":"2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07"}
Sep 17 21:56:45.903435 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:45.903391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:56:45.924824 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:45.924776    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8" podStartSLOduration=2.532153373 podStartE2EDuration="2.924760641s" totalImagesPullingTime="392.607268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:56:45.922282317 +0000 UTC m=+939.443847257" watchObservedRunningTime="2026-09-17 21:56:45.924760641 +0000 UTC m=+939.446325571"
Sep 17 21:56:46.244777 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:46.244687    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:47.055122 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:47.055088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:48.285048 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:48.285007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:50.298084 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:50.298047    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:50.396115 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:50.396086    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:56:51.927318 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:56:51.927272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:57:00.877175 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:00.877142    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:57:00.990044 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:00.990011    2580 generic.go:356] "Generic (PLEG): container finished" podID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerID="1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a" exitCode=0
Sep 17 21:57:00.990206 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:00.990084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" event={"ID":"c2b6efa7-89c8-4858-a37a-e37028ed6160","Type":"ContainerDied","Data":"1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a"}
Sep 17 21:57:00.990493 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:00.990479    2580 scope.go:117] "RemoveContainer" containerID="1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a"
Sep 17 21:57:00.991673 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:00.991626    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:00.991790 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:00.991729    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:00.991790 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:00.991778    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:01.997482 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:01.997443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" event={"ID":"c2b6efa7-89c8-4858-a37a-e37028ed6160","Type":"ContainerStarted","Data":"1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f"}
Sep 17 21:57:02.955404 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:02.955364    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:57:02.955754 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:02.955729    2580 patch_prober.go:28] interesting pod/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 21:57:02.955816 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:02.955796    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 21:57:03.955337 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:03.955296    2580 patch_prober.go:28] interesting pod/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 21:57:03.955782 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:03.955370    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 21:57:04.955284 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:04.955248    2580 patch_prober.go:28] interesting pod/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 21:57:04.955471 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:04.955310    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 21:57:05.955957 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:05.955919    2580 patch_prober.go:28] interesting pod/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 21:57:05.956447 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:05.955979    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 21:57:06.954971 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:06.954929    2580 patch_prober.go:28] interesting pod/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 21:57:06.955174 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:06.954992    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 21:57:07.959335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:07.959305    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:57:07.959756 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:07.959586    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:57:07.960335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:07.960320    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:57:09.288646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:09.288613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:11.077027 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:11.076990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:12.227779 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:12.227745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:13.098917 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:13.098879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:14.201255 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:14.201212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:15.125104 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:15.125073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:16.262573 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:16.262542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:17.181140 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:17.181080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:19.815415 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:19.815375    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:22.483457 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.483423    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"]
Sep 17 21:57:22.483898 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.483614    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8" podUID="48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" containerName="maas-api" containerID="cri-o://2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07" gracePeriod=30
Sep 17 21:57:22.594462 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.594399    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:22.693590 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.693560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:22.761498 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.761475    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:57:22.818179 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.818145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:22.827080 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.827048    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-metrics-certs\") pod \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") "
Sep 17 21:57:22.827080 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.827082    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzscc\" (UniqueName: \"kubernetes.io/projected/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-kube-api-access-dzscc\") pod \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") "
Sep 17 21:57:22.827323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.827188    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-maas-api-tls\") pod \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") "
Sep 17 21:57:22.827323 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.827216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-openshift-service-ca\") pod \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\" (UID: \"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f\") "
Sep 17 21:57:22.827677 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.827624    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" (UID: "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:57:22.829519 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.829492    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" (UID: "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:57:22.829638 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.829514    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" (UID: "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:57:22.829769 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.829636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-kube-api-access-dzscc" (OuterVolumeSpecName: "kube-api-access-dzscc") pod "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" (UID: "48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f"). InnerVolumeSpecName "kube-api-access-dzscc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:57:22.928627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.928594    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:22.928627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.928620    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzscc\" (UniqueName: \"kubernetes.io/projected/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-kube-api-access-dzscc\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:22.928627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.928630    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:22.928881 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.928639    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:22.930744 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:22.930717    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:23.082038 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.082006    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:23.134410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.133752    2580 generic.go:356] "Generic (PLEG): container finished" podID="48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" containerID="2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07" exitCode=0
Sep 17 21:57:23.134410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.133881    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"
Sep 17 21:57:23.134410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.133951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8" event={"ID":"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f","Type":"ContainerDied","Data":"2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07"}
Sep 17 21:57:23.134410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.134035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8" event={"ID":"48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f","Type":"ContainerDied","Data":"8da6469ab8b5fc81063414e0d06d6616644c0f00773a887cbc765749b8063138"}
Sep 17 21:57:23.134410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.134065    2580 scope.go:117] "RemoveContainer" containerID="2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07"
Sep 17 21:57:23.146915 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.146896    2580 scope.go:117] "RemoveContainer" containerID="2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07"
Sep 17 21:57:23.147218 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:57:23.147198    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07\": container with ID starting with 2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07 not found: ID does not exist" containerID="2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07"
Sep 17 21:57:23.147275 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.147228    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07"} err="failed to get container status \"2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07\": rpc error: code = NotFound desc = could not find container \"2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07\": container with ID starting with 2b4b8f4a6d950f80aa36547a4dc69d0834561a45de52fad6fbda2312e2d37b07 not found: ID does not exist"
Sep 17 21:57:23.164514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.164479    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"]
Sep 17 21:57:23.164731 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.164713    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy" containerID="cri-o://1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f" gracePeriod=30
Sep 17 21:57:23.171783 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.171761    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"]
Sep 17 21:57:23.180028 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.180005    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0a97fdf-75b57dbd9c-m9dr8"]
Sep 17 21:57:23.193975 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.193954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:23.713835 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.713786    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:23.866258 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:23.866230    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:24.213594 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.213559    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"]
Sep 17 21:57:24.213979 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.213967    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" containerName="maas-api"
Sep 17 21:57:24.214037 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.213981    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" containerName="maas-api"
Sep 17 21:57:24.214083 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.214045    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" containerName="maas-api"
Sep 17 21:57:24.217267 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.217240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.271496 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.271114    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a9151699-openshift-default-dockercfg-gndm9\""
Sep 17 21:57:24.275858 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.275826    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"]
Sep 17 21:57:24.349731 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.349698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-token\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.349895 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.349741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istiod-ca-cert\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.349895 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.349847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-data\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.349895 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.349879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-certs\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.350018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.349907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-credential-socket\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.350018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.349969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wj69\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-kube-api-access-2wj69\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.350018 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.349994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-envoy\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.350121 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.350025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-socket\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.350121 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.350048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-podinfo\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.353866 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.353841    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:24.451103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-data\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451308 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-certs\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451308 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-credential-socket\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451441 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj69\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-kube-api-access-2wj69\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451441 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-envoy\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451441 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-socket\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451591 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-podinfo\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451591 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-certs\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451591 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-token\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451591 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-data\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451591 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istiod-ca-cert\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451882 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-credential-socket\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.451882 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.451814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-socket\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.452263 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.452239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istiod-ca-cert\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.453784 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.453757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-envoy\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.453967 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.453948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-podinfo\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.469153 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.469101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-token\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.476587 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.476559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wj69\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-kube-api-access-2wj69\") pod \"e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") " pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.533058 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.533020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:24.617687 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.617635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:24.843912 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.843881    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"]
Sep 17 21:57:24.845014 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:57:24.844988    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff62c3d_ab19_4ba4_b6ba_f6c2df22c097.slice/crio-7eebdca7fc6ad7efb4f41d022b90caf40ec2459a1df67cf9ffaedf215bb7fdab WatchSource:0}: Error finding container 7eebdca7fc6ad7efb4f41d022b90caf40ec2459a1df67cf9ffaedf215bb7fdab: Status 404 returned error can't find the container with id 7eebdca7fc6ad7efb4f41d022b90caf40ec2459a1df67cf9ffaedf215bb7fdab
Sep 17 21:57:24.847250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.847213    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:24.847349 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.847287    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:24.847349 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:24.847316    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:25.027374 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:25.027339    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f" path="/var/lib/kubelet/pods/48a9b8d9-b87c-4901-bfce-8dc3f24d4e6f/volumes"
Sep 17 21:57:25.149397 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:25.149310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" event={"ID":"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097","Type":"ContainerStarted","Data":"8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14"}
Sep 17 21:57:25.149397 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:25.149361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" event={"ID":"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097","Type":"ContainerStarted","Data":"7eebdca7fc6ad7efb4f41d022b90caf40ec2459a1df67cf9ffaedf215bb7fdab"}
Sep 17 21:57:25.533730 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:25.533696    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:25.539172 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:25.539145    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:25.621202 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:25.621144    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podStartSLOduration=1.621125376 podStartE2EDuration="1.621125376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:57:25.19833861 +0000 UTC m=+978.719903542" watchObservedRunningTime="2026-09-17 21:57:25.621125376 +0000 UTC m=+979.142690305"
Sep 17 21:57:25.722609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:25.722571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:26.154999 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:26.154971    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:26.155818 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:26.155800    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:26.877684 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:26.877627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:27.099525 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:27.099484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:28.024164 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.024105    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:28.370552 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.370519    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:57:28.415529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.415504    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:57:28.594996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.594905    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-envoy\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.594996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.594980    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-podinfo\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-credential-socket\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-token\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595067    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-data\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595083    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-certs\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-socket\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595159    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krxz2\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-kube-api-access-krxz2\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595235    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b6efa7-89c8-4858-a37a-e37028ed6160-istiod-ca-cert\") pod \"c2b6efa7-89c8-4858-a37a-e37028ed6160\" (UID: \"c2b6efa7-89c8-4858-a37a-e37028ed6160\") "
Sep 17 21:57:28.595602 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595380    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:57:28.595602 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595392    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:57:28.595602 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595467    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:57:28.595602 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595516    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:57:28.596032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595633    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.596032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595650    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.596032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595685    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.596032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595694    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.596032 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.595712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b6efa7-89c8-4858-a37a-e37028ed6160-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:57:28.597508 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.597465    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 21:57:28.597508 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.597495    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-kube-api-access-krxz2" (OuterVolumeSpecName: "kube-api-access-krxz2") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "kube-api-access-krxz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:57:28.597871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.597850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:57:28.597871 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.597856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2b6efa7-89c8-4858-a37a-e37028ed6160" (UID: "c2b6efa7-89c8-4858-a37a-e37028ed6160"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:57:28.696778 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.696743    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b6efa7-89c8-4858-a37a-e37028ed6160-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.696778 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.696773    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.696778 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.696785    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.696992 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.696794    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:28.696992 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:28.696804    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krxz2\" (UniqueName: \"kubernetes.io/projected/c2b6efa7-89c8-4858-a37a-e37028ed6160-kube-api-access-krxz2\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:57:29.173085 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.173046    2580 generic.go:356] "Generic (PLEG): container finished" podID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerID="1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f" exitCode=0
Sep 17 21:57:29.173488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.173095    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"
Sep 17 21:57:29.173488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.173123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" event={"ID":"c2b6efa7-89c8-4858-a37a-e37028ed6160","Type":"ContainerDied","Data":"1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f"}
Sep 17 21:57:29.173488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.173173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r" event={"ID":"c2b6efa7-89c8-4858-a37a-e37028ed6160","Type":"ContainerDied","Data":"6ec875e1f813b294f5cf1e79581087b33190a75ab58765ff9f1adba21d36ec47"}
Sep 17 21:57:29.173488 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.173194    2580 scope.go:117] "RemoveContainer" containerID="1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f"
Sep 17 21:57:29.182793 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.182772    2580 scope.go:117] "RemoveContainer" containerID="1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a"
Sep 17 21:57:29.191210 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.191192    2580 scope.go:117] "RemoveContainer" containerID="1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f"
Sep 17 21:57:29.191488 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:57:29.191470    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f\": container with ID starting with 1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f not found: ID does not exist" containerID="1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f"
Sep 17 21:57:29.191554 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.191494    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f"} err="failed to get container status \"1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f\": rpc error: code = NotFound desc = could not find container \"1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f\": container with ID starting with 1158439d3083ce5527a1893bc463908cb3bdbbebcdfc6b3897efb8c167ef834f not found: ID does not exist"
Sep 17 21:57:29.191554 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.191511    2580 scope.go:117] "RemoveContainer" containerID="1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a"
Sep 17 21:57:29.191777 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:57:29.191762    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a\": container with ID starting with 1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a not found: ID does not exist" containerID="1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a"
Sep 17 21:57:29.191824 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.191782    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a"} err="failed to get container status \"1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a\": rpc error: code = NotFound desc = could not find container \"1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a\": container with ID starting with 1d9f512b72cdbb8dcbf21516e4cec90e0249f554ea87e6c2d825f8acdf1a765a not found: ID does not exist"
Sep 17 21:57:29.208521 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.208500    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"]
Sep 17 21:57:29.210720 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:29.210700    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a0a97fdf-gw-openshift-default-7dbd987688-hnl4r"]
Sep 17 21:57:30.083623 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:30.083591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:31.024906 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:31.024874    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" path="/var/lib/kubelet/pods/c2b6efa7-89c8-4858-a37a-e37028ed6160/volumes"
Sep 17 21:57:31.975757 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:31.975720    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:33.295774 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:33.295739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:35.029376 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.029346    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"]
Sep 17 21:57:35.029812 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.029797    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy"
Sep 17 21:57:35.029863 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.029814    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy"
Sep 17 21:57:35.029902 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.029896    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy"
Sep 17 21:57:35.032108 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.032093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.035776 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.035759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a9151699-serving-cert\""
Sep 17 21:57:35.059745 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.059718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c31ff-2a0d-4064-a7b1-41f9de513277-openshift-service-ca\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.059868 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.059851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-metrics-certs\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.059928 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.059893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.060015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.059994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wflqv\" (UniqueName: \"kubernetes.io/projected/8e3c31ff-2a0d-4064-a7b1-41f9de513277-kube-api-access-wflqv\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.133025 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.132995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:35.161124 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.161089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.161314 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.161143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wflqv\" (UniqueName: \"kubernetes.io/projected/8e3c31ff-2a0d-4064-a7b1-41f9de513277-kube-api-access-wflqv\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.161314 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.161193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c31ff-2a0d-4064-a7b1-41f9de513277-openshift-service-ca\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.161314 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.161218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-metrics-certs\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.161314 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:57:35.161265    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-serving-cert: secret "maas-api-e2e-ait-a9151699-serving-cert" not found
Sep 17 21:57:35.161525 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:57:35.161377    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls podName:8e3c31ff-2a0d-4064-a7b1-41f9de513277 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:35.661353733 +0000 UTC m=+989.182918660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls") pod "maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx" (UID: "8e3c31ff-2a0d-4064-a7b1-41f9de513277") : secret "maas-api-e2e-ait-a9151699-serving-cert" not found
Sep 17 21:57:35.161976 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.161954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c31ff-2a0d-4064-a7b1-41f9de513277-openshift-service-ca\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.163942 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.163923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-metrics-certs\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.194407 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.194359    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"]
Sep 17 21:57:35.203015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.202987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wflqv\" (UniqueName: \"kubernetes.io/projected/8e3c31ff-2a0d-4064-a7b1-41f9de513277-kube-api-access-wflqv\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.366977 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.366879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:35.599601 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.599571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:35.665588 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.665504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.668074 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.668046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls\") pod \"maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:35.941703 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:35.941588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:36.191030 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:36.191000    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:36.242853 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:36.242823    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"]
Sep 17 21:57:36.244535 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:57:36.244508    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3c31ff_2a0d_4064_a7b1_41f9de513277.slice/crio-aba56ab5382cede75a87ac300d28e209f918bd88501912b4c253581b9c01eefe WatchSource:0}: Error finding container aba56ab5382cede75a87ac300d28e209f918bd88501912b4c253581b9c01eefe: Status 404 returned error can't find the container with id aba56ab5382cede75a87ac300d28e209f918bd88501912b4c253581b9c01eefe
Sep 17 21:57:36.339465 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:36.339428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:37.221437 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:37.221395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx" event={"ID":"8e3c31ff-2a0d-4064-a7b1-41f9de513277","Type":"ContainerStarted","Data":"939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f"}
Sep 17 21:57:37.221952 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:37.221460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx" event={"ID":"8e3c31ff-2a0d-4064-a7b1-41f9de513277","Type":"ContainerStarted","Data":"aba56ab5382cede75a87ac300d28e209f918bd88501912b4c253581b9c01eefe"}
Sep 17 21:57:37.221952 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:37.221492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:37.240176 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:37.240145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:37.257422 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:37.257373    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx" podStartSLOduration=2.910020921 podStartE2EDuration="3.257353397s" totalImagesPullingTime="347.332476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:57:37.255588054 +0000 UTC m=+990.777153003" watchObservedRunningTime="2026-09-17 21:57:37.257353397 +0000 UTC m=+990.778918326"
Sep 17 21:57:38.172079 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:38.172039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:38.280503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:38.280457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:39.590980 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:39.590927    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:43.233073 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:43.233046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:57:53.960243 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:53.960153    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:54.320973 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:54.320939    2580 generic.go:356] "Generic (PLEG): container finished" podID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerID="8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14" exitCode=0
Sep 17 21:57:54.321158 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:54.321011    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" event={"ID":"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097","Type":"ContainerDied","Data":"8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14"}
Sep 17 21:57:54.321439 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:54.321426    2580 scope.go:117] "RemoveContainer" containerID="8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14"
Sep 17 21:57:54.322634 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:54.322602    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:54.322703 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:54.322693    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:54.322764 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:54.322749    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:57:54.948425 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:54.948390    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:55.328953 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:55.328921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" event={"ID":"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097","Type":"ContainerStarted","Data":"8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c"}
Sep 17 21:57:55.533324 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:55.533280    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:55.534535 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:55.534512    2580 patch_prober.go:28] interesting pod/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 21:57:55.534651 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:55.534561    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 21:57:55.848154 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:55.848119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:56.155923 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:56.155830    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:57:56.534012 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:56.533977    2580 patch_prober.go:28] interesting pod/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 21:57:56.534625 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:56.534038    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 21:57:56.717683 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:56.714731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:57.324811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:57.324780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:57.533641 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:57.533600    2580 patch_prober.go:28] interesting pod/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 21:57:57.533807 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:57.533675    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 21:57:57.558629 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:57.558598    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:57:57.674974 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:57.674884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:58.516438 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:58.516404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:58.534603 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:58.534570    2580 patch_prober.go:28] interesting pod/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 21:57:58.534905 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:58.534871    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 21:57:59.526646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:59.526591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:57:59.533541 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:59.533517    2580 patch_prober.go:28] interesting pod/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 21:57:59.533763 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:57:59.533744    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 21:58:00.429921 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:00.429892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:00.534154 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:00.534106    2580 patch_prober.go:28] interesting pod/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 21:58:00.534562 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:00.534169    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 21:58:01.160529 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:01.160495    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:01.554274 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:01.554237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:58:01.557230 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:01.557205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:58:01.933523 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:01.933421    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:03.074158 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:03.074121    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:04.047362 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:04.047330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:04.835176 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:04.835142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:05.741415 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:05.741373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:06.580977 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:06.580935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:07.294982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.294947    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"]
Sep 17 21:58:07.295249 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.295158    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t" podUID="2b0e86b5-f430-49a7-9706-132a24174ead" containerName="maas-api" containerID="cri-o://a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9" gracePeriod=30
Sep 17 21:58:07.313375 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.313343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:07.387335 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.387302    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:07.467239 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.467062    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:07.567264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.567237    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:58:07.572108 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.572071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:07.600342 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.600315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls\") pod \"2b0e86b5-f430-49a7-9706-132a24174ead\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") "
Sep 17 21:58:07.600805 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.600350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e86b5-f430-49a7-9706-132a24174ead-openshift-service-ca\") pod \"2b0e86b5-f430-49a7-9706-132a24174ead\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") "
Sep 17 21:58:07.600805 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.600398    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-metrics-certs\") pod \"2b0e86b5-f430-49a7-9706-132a24174ead\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") "
Sep 17 21:58:07.600805 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.600421    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr8r6\" (UniqueName: \"kubernetes.io/projected/2b0e86b5-f430-49a7-9706-132a24174ead-kube-api-access-kr8r6\") pod \"2b0e86b5-f430-49a7-9706-132a24174ead\" (UID: \"2b0e86b5-f430-49a7-9706-132a24174ead\") "
Sep 17 21:58:07.600805 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.600724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b0e86b5-f430-49a7-9706-132a24174ead-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b0e86b5-f430-49a7-9706-132a24174ead" (UID: "2b0e86b5-f430-49a7-9706-132a24174ead"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:58:07.602584 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.602560    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b0e86b5-f430-49a7-9706-132a24174ead" (UID: "2b0e86b5-f430-49a7-9706-132a24174ead"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:58:07.603145 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.603122    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b0e86b5-f430-49a7-9706-132a24174ead" (UID: "2b0e86b5-f430-49a7-9706-132a24174ead"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:58:07.603241 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.603203    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0e86b5-f430-49a7-9706-132a24174ead-kube-api-access-kr8r6" (OuterVolumeSpecName: "kube-api-access-kr8r6") pod "2b0e86b5-f430-49a7-9706-132a24174ead" (UID: "2b0e86b5-f430-49a7-9706-132a24174ead"). InnerVolumeSpecName "kube-api-access-kr8r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:58:07.654702 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.654646    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:07.705128 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.705092    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:07.705982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.705359    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e86b5-f430-49a7-9706-132a24174ead-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:07.705982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.705382    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b0e86b5-f430-49a7-9706-132a24174ead-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:07.705982 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.705398    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr8r6\" (UniqueName: \"kubernetes.io/projected/2b0e86b5-f430-49a7-9706-132a24174ead-kube-api-access-kr8r6\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:07.825729 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.825627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:07.927345 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:07.927308    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:08.412075 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.412029    2580 generic.go:356] "Generic (PLEG): container finished" podID="2b0e86b5-f430-49a7-9706-132a24174ead" containerID="a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9" exitCode=0
Sep 17 21:58:08.412554 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.412533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t" event={"ID":"2b0e86b5-f430-49a7-9706-132a24174ead","Type":"ContainerDied","Data":"a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9"}
Sep 17 21:58:08.412896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.412862    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t" event={"ID":"2b0e86b5-f430-49a7-9706-132a24174ead","Type":"ContainerDied","Data":"4293cd75ff925388c479a276405030c2b456de51caefe96bf9a3351c68469c56"}
Sep 17 21:58:08.412896 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.412888    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"
Sep 17 21:58:08.413081 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.412894    2580 scope.go:117] "RemoveContainer" containerID="a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9"
Sep 17 21:58:08.423627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.423605    2580 scope.go:117] "RemoveContainer" containerID="a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9"
Sep 17 21:58:08.423958 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:08.423937    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9\": container with ID starting with a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9 not found: ID does not exist" containerID="a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9"
Sep 17 21:58:08.424030 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.423966    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9"} err="failed to get container status \"a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9\": rpc error: code = NotFound desc = could not find container \"a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9\": container with ID starting with a2067a3dd6f18cda6cd2d44214b2a06e4420f16d493681827811a4df5cbcdcd9 not found: ID does not exist"
Sep 17 21:58:08.438063 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.438031    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"]
Sep 17 21:58:08.441237 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.441209    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e9409-68f98bf64f-tdd9t"]
Sep 17 21:58:08.755583 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:08.755502    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:09.024620 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:09.024587    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0e86b5-f430-49a7-9706-132a24174ead" path="/var/lib/kubelet/pods/2b0e86b5-f430-49a7-9706-132a24174ead/volumes"
Sep 17 21:58:09.596473 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:09.596412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:10.438515 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:10.438470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:11.357381 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:11.357343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:12.233924 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:12.233871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:13.299600 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:13.299566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:14.387338 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.387296    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"]
Sep 17 21:58:14.387864 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.387587    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx" podUID="8e3c31ff-2a0d-4064-a7b1-41f9de513277" containerName="maas-api" containerID="cri-o://939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f" gracePeriod=30
Sep 17 21:58:14.458065 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.458032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:14.587801 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.587768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:14.648514 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.648453    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:58:14.669675 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.669638    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c31ff-2a0d-4064-a7b1-41f9de513277-openshift-service-ca\") pod \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") "
Sep 17 21:58:14.669855 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.669720    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wflqv\" (UniqueName: \"kubernetes.io/projected/8e3c31ff-2a0d-4064-a7b1-41f9de513277-kube-api-access-wflqv\") pod \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") "
Sep 17 21:58:14.669855 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.669769    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-metrics-certs\") pod \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") "
Sep 17 21:58:14.669996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.669906    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls\") pod \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\" (UID: \"8e3c31ff-2a0d-4064-a7b1-41f9de513277\") "
Sep 17 21:58:14.669996 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.669970    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e3c31ff-2a0d-4064-a7b1-41f9de513277-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e3c31ff-2a0d-4064-a7b1-41f9de513277" (UID: "8e3c31ff-2a0d-4064-a7b1-41f9de513277"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:58:14.670773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.670750    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c31ff-2a0d-4064-a7b1-41f9de513277-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:14.672149 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.672079    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e3c31ff-2a0d-4064-a7b1-41f9de513277-kube-api-access-wflqv" (OuterVolumeSpecName: "kube-api-access-wflqv") pod "8e3c31ff-2a0d-4064-a7b1-41f9de513277" (UID: "8e3c31ff-2a0d-4064-a7b1-41f9de513277"). InnerVolumeSpecName "kube-api-access-wflqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:58:14.672263 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.672157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e3c31ff-2a0d-4064-a7b1-41f9de513277" (UID: "8e3c31ff-2a0d-4064-a7b1-41f9de513277"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:58:14.672320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.672302    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8e3c31ff-2a0d-4064-a7b1-41f9de513277" (UID: "8e3c31ff-2a0d-4064-a7b1-41f9de513277"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:58:14.695256 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.695182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:14.771500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.771466    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:14.771500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.771494    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e3c31ff-2a0d-4064-a7b1-41f9de513277-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:14.771500 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.771503    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wflqv\" (UniqueName: \"kubernetes.io/projected/8e3c31ff-2a0d-4064-a7b1-41f9de513277-kube-api-access-wflqv\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:14.790621 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.790583    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:14.893545 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.893468    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:14.982848 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:14.982754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:58:15.425221 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.425179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:15.453119 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.453085    2580 generic.go:356] "Generic (PLEG): container finished" podID="8e3c31ff-2a0d-4064-a7b1-41f9de513277" containerID="939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f" exitCode=0
Sep 17 21:58:15.453264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.453126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx" event={"ID":"8e3c31ff-2a0d-4064-a7b1-41f9de513277","Type":"ContainerDied","Data":"939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f"}
Sep 17 21:58:15.453264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.453142    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"
Sep 17 21:58:15.453264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.453178    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx" event={"ID":"8e3c31ff-2a0d-4064-a7b1-41f9de513277","Type":"ContainerDied","Data":"aba56ab5382cede75a87ac300d28e209f918bd88501912b4c253581b9c01eefe"}
Sep 17 21:58:15.453264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.453199    2580 scope.go:117] "RemoveContainer" containerID="939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f"
Sep 17 21:58:15.463288 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.463272    2580 scope.go:117] "RemoveContainer" containerID="939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f"
Sep 17 21:58:15.463566 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:15.463546    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f\": container with ID starting with 939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f not found: ID does not exist" containerID="939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f"
Sep 17 21:58:15.463622 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.463573    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f"} err="failed to get container status \"939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f\": rpc error: code = NotFound desc = could not find container \"939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f\": container with ID starting with 939623d85f0e78789c54b3a6f9d9a4037ffda10ae3293625a17d9d952df9ce0f not found: ID does not exist"
Sep 17 21:58:15.495214 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.495185    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"]
Sep 17 21:58:15.500371 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:15.500345    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9151699-579bd87b9f-lgjmx"]
Sep 17 21:58:16.105585 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.105549    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"]
Sep 17 21:58:16.105804 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.105782    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" containerID="cri-o://8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c" gracePeriod=30
Sep 17 21:58:16.160015 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.159979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:16.557002 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.556969    2580 patch_prober.go:28] interesting pod/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 17 21:58:16.557355 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.557038    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 21:58:16.627283 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.627254    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:16.909401 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.909313    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:16.972732 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.972689    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"]
Sep 17 21:58:16.973148 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973129    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy"
Sep 17 21:58:16.973238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973150    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy"
Sep 17 21:58:16.973238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973161    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0e86b5-f430-49a7-9706-132a24174ead" containerName="maas-api"
Sep 17 21:58:16.973238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973169    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0e86b5-f430-49a7-9706-132a24174ead" containerName="maas-api"
Sep 17 21:58:16.973238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973183    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e3c31ff-2a0d-4064-a7b1-41f9de513277" containerName="maas-api"
Sep 17 21:58:16.973238 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973191    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e3c31ff-2a0d-4064-a7b1-41f9de513277" containerName="maas-api"
Sep 17 21:58:16.974000 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973302    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b6efa7-89c8-4858-a37a-e37028ed6160" containerName="istio-proxy"
Sep 17 21:58:16.974000 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973314    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0e86b5-f430-49a7-9706-132a24174ead" containerName="maas-api"
Sep 17 21:58:16.974000 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.973325    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e3c31ff-2a0d-4064-a7b1-41f9de513277" containerName="maas-api"
Sep 17 21:58:16.975620 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.975601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:16.980039 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.980012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c85107f9-openshift-default-dockercfg-9lbd6\""
Sep 17 21:58:16.994702 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:16.994678    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"]
Sep 17 21:58:17.030138 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.030103    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e3c31ff-2a0d-4064-a7b1-41f9de513277" path="/var/lib/kubelet/pods/8e3c31ff-2a0d-4064-a7b1-41f9de513277/volumes"
Sep 17 21:58:17.055956 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.055924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:17.094261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cmm\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-kube-api-access-48cmm\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094261 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-podinfo\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094472 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-certs\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094472 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-envoy\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094472 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-data\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094574 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-socket\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094645 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-credential-socket\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094738 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-token\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.094775 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.094759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istiod-ca-cert\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.195795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.195708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-credential-socket\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.195795 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.195759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-token\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196025 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.195874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istiod-ca-cert\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196025 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.195916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cmm\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-kube-api-access-48cmm\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196025 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.195942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-podinfo\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196025 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.195979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-certs\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196025 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-envoy\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196280 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-data\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196280 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-credential-socket\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196280 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-socket\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196440 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196350    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-certs\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196440 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-data\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196561 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-socket\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.196687 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.196634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istiod-ca-cert\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.198424 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.198403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-envoy\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.198648 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.198632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-podinfo\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.206158 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.206137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-token\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.210417 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.210397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cmm\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-kube-api-access-48cmm\") pod \"e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") " pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.286387 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.286340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:17.445285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.445250    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:17.592941 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.592906    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"]
Sep 17 21:58:17.600537 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:58:17.600513    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10bf7c0_26e7_430c_a17f_1462fc3db1c2.slice/crio-900590ae8e4ede563909a3ae487edc5fb1efbb72bd5c08e0b381164745f67dc9 WatchSource:0}: Error finding container 900590ae8e4ede563909a3ae487edc5fb1efbb72bd5c08e0b381164745f67dc9: Status 404 returned error can't find the container with id 900590ae8e4ede563909a3ae487edc5fb1efbb72bd5c08e0b381164745f67dc9
Sep 17 21:58:17.602807 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.602774    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:17.602858 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.602844    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:17.602910 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.602875    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:17.694233 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:17.694199    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:18.076557 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.076522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:18.471607 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.471512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" event={"ID":"e10bf7c0-26e7-430c-a17f-1462fc3db1c2","Type":"ContainerStarted","Data":"5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460"}
Sep 17 21:58:18.471607 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.471576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" event={"ID":"e10bf7c0-26e7-430c-a17f-1462fc3db1c2","Type":"ContainerStarted","Data":"900590ae8e4ede563909a3ae487edc5fb1efbb72bd5c08e0b381164745f67dc9"}
Sep 17 21:58:18.548765 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.548709    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" podStartSLOduration=2.548687314 podStartE2EDuration="2.548687314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:18.544587613 +0000 UTC m=+1032.066152580" watchObservedRunningTime="2026-09-17 21:58:18.548687314 +0000 UTC m=+1032.070252243"
Sep 17 21:58:18.584409 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.584380    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:18.783599 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.783564    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:18.870065 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.870031    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"]
Sep 17 21:58:18.872507 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.872490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.880120 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.880094    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-4bd0ef-openshift-default-dockercfg-njrwh\""
Sep 17 21:58:18.912008 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.911977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-token\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912202 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istiod-ca-cert\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912202 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-socket\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912202 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-data\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912202 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-envoy\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912202 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-certs\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912446 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-credential-socket\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912446 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-podinfo\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.912446 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.912348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk9s2\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-kube-api-access-xk9s2\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:18.916501 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.916472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"]
Sep 17 21:58:18.957578 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:18.957528    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:19.013936 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.013904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-podinfo\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.013936 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.013943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk9s2\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-kube-api-access-xk9s2\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.013997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-token\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istiod-ca-cert\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-socket\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-data\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-envoy\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014182 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-certs\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014503 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-credential-socket\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014651 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-certs\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014760 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-credential-socket\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014760 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-socket\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.014958 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istiod-ca-cert\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.015026 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.014940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-data\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.016767 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.016744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-podinfo\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.016847 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.016785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-envoy\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.028555 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.028527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk9s2\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-kube-api-access-xk9s2\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.030481 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.030458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-token\") pod \"e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") " pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.183956 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.183858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:19.287577 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.287542    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:19.292719 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.292651    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:19.426180 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.426125    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:19.477559 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.477469    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:19.478622 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.478602    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:19.580627 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.580182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"]
Sep 17 21:58:19.582852 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.582809    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:19.582972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.582892    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:19.582972 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:19.582932    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:20.445050 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:20.445014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:20.484441 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:20.484414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" event={"ID":"113b7500-83fc-4bc2-b9a2-cdd42d7e9656","Type":"ContainerStarted","Data":"bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582"}
Sep 17 21:58:20.484441 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:20.484461    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" event={"ID":"113b7500-83fc-4bc2-b9a2-cdd42d7e9656","Type":"ContainerStarted","Data":"bd339288c05532fa8b682936fc61df7b3a463502d3192d1c53cb1fdbc3622630"}
Sep 17 21:58:20.674504 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:20.674469    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:21.160836 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.160800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:21.184768 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.184739    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:21.189913 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.189891    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:21.253124 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.253066    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podStartSLOduration=3.253048341 podStartE2EDuration="3.253048341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:20.578175384 +0000 UTC m=+1034.099740334" watchObservedRunningTime="2026-09-17 21:58:21.253048341 +0000 UTC m=+1034.774613302"
Sep 17 21:58:21.368612 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.368586    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:58:21.438646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438559    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wj69\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-kube-api-access-2wj69\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.438646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438617    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-podinfo\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.438646 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438646    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-socket\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.438938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438745    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-credential-socket\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.438938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-data\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.438938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-certs\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.438938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438834    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-token\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.438938 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istiod-ca-cert\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.439204 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.438939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-envoy\") pod \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\" (UID: \"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097\") "
Sep 17 21:58:21.439204 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439045    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:58:21.439204 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:58:21.439204 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439126    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:58:21.439412 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439296    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-data" (OuterVolumeSpecName: "istio-data") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:58:21.439412 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439374    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:58:21.439412 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439377    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.439762 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439416    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.439762 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.439435    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.441219 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.441193    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 21:58:21.441342 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.441226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-token" (OuterVolumeSpecName: "istio-token") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:58:21.441342 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.441274    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-kube-api-access-2wj69" (OuterVolumeSpecName: "kube-api-access-2wj69") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "kube-api-access-2wj69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:58:21.441342 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.441303    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" (UID: "fff62c3d-ab19-4ba4-b6ba-f6c2df22c097"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:58:21.491376 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.491337    2580 generic.go:356] "Generic (PLEG): container finished" podID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerID="8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c" exitCode=0
Sep 17 21:58:21.491831 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.491389    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"
Sep 17 21:58:21.491831 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.491416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" event={"ID":"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097","Type":"ContainerDied","Data":"8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c"}
Sep 17 21:58:21.491831 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.491465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8" event={"ID":"fff62c3d-ab19-4ba4-b6ba-f6c2df22c097","Type":"ContainerDied","Data":"7eebdca7fc6ad7efb4f41d022b90caf40ec2459a1df67cf9ffaedf215bb7fdab"}
Sep 17 21:58:21.491831 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.491486    2580 scope.go:117] "RemoveContainer" containerID="8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c"
Sep 17 21:58:21.492081 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.492063    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:21.493367 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.493343    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:21.501774 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.501755    2580 scope.go:117] "RemoveContainer" containerID="8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14"
Sep 17 21:58:21.510617 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.510595    2580 scope.go:117] "RemoveContainer" containerID="8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c"
Sep 17 21:58:21.510927 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:21.510908    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c\": container with ID starting with 8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c not found: ID does not exist" containerID="8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c"
Sep 17 21:58:21.510989 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.510937    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c"} err="failed to get container status \"8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c\": rpc error: code = NotFound desc = could not find container \"8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c\": container with ID starting with 8fe153207dd79ef453464bdba0c4c799c90d250845342f5f465bf16ea96e219c not found: ID does not exist"
Sep 17 21:58:21.510989 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.510955    2580 scope.go:117] "RemoveContainer" containerID="8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14"
Sep 17 21:58:21.511236 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:21.511221    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14\": container with ID starting with 8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14 not found: ID does not exist" containerID="8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14"
Sep 17 21:58:21.511283 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.511238    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14"} err="failed to get container status \"8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14\": rpc error: code = NotFound desc = could not find container \"8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14\": container with ID starting with 8398c5415101f252ef6f2b3677ad685d5310b83010f2d47b305181df4d579e14 not found: ID does not exist"
Sep 17 21:58:21.540475 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.540441    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.540475 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.540474    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.540689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.540486    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.540689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.540494    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.540689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.540503    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.540689 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.540512    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wj69\" (UniqueName: \"kubernetes.io/projected/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097-kube-api-access-2wj69\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:21.631955 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.631923    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"]
Sep 17 21:58:21.658268 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:21.658236    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a9151699-openshift-default-5ddc78cf9d-v25n8"]
Sep 17 21:58:23.025093 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:23.025059    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" path="/var/lib/kubelet/pods/fff62c3d-ab19-4ba4-b6ba-f6c2df22c097/volumes"
Sep 17 21:58:23.466104 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:23.466002    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:23.669155 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:23.669114    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:25.718918 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.718882    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"]
Sep 17 21:58:25.719285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.719254    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy"
Sep 17 21:58:25.719285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.719264    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy"
Sep 17 21:58:25.719285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.719279    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy"
Sep 17 21:58:25.719285 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.719284    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy"
Sep 17 21:58:25.719430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.719363    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy"
Sep 17 21:58:25.719430 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.719374    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff62c3d-ab19-4ba4-b6ba-f6c2df22c097" containerName="istio-proxy"
Sep 17 21:58:25.722427 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.722405    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.738259 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:25.738226    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" podUID="2a1fc5dd-7627-4036-bab8-38876c424601" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.738259 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:25.738248    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-e2e-derive-c85107f9-serving-cert\" is forbidden: User \"system:node:ip-10-0-138-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-138-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c85107f9-serving-cert\"" type="*v1.Secret"
Sep 17 21:58:25.784407 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.784363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgz84\" (UniqueName: \"kubernetes.io/projected/2a1fc5dd-7627-4036-bab8-38876c424601-kube-api-access-vgz84\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.784609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.784431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.784609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.784462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1fc5dd-7627-4036-bab8-38876c424601-openshift-service-ca\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.784609 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.784569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-metrics-certs\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.811980 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.811941    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"]
Sep 17 21:58:25.843668 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.843618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:25.886022 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.885986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgz84\" (UniqueName: \"kubernetes.io/projected/2a1fc5dd-7627-4036-bab8-38876c424601-kube-api-access-vgz84\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.886231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.886037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.886231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.886066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1fc5dd-7627-4036-bab8-38876c424601-openshift-service-ca\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.886231 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.886110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-metrics-certs\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.886811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.886788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1fc5dd-7627-4036-bab8-38876c424601-openshift-service-ca\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.888890 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.888864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-metrics-certs\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:25.962029 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:25.961991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgz84\" (UniqueName: \"kubernetes.io/projected/2a1fc5dd-7627-4036-bab8-38876c424601-kube-api-access-vgz84\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:26.192246 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:26.192206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:26.515114 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:26.515003    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:26.887226 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:26.887191    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-serving-cert: failed to sync secret cache: timed out waiting for the condition
Sep 17 21:58:26.887693 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:26.887274    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls podName:2a1fc5dd-7627-4036-bab8-38876c424601 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.387256039 +0000 UTC m=+1040.908820947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls") pod "maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf" (UID: "2a1fc5dd-7627-4036-bab8-38876c424601") : failed to sync secret cache: timed out waiting for the condition
Sep 17 21:58:26.966052 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:26.966023    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c85107f9-serving-cert\""
Sep 17 21:58:27.404561 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:27.404514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:27.407156 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:27.407126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls\") pod \"maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:27.443576 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:27.443541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:27.534964 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:27.534926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:27.637442 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:27.637398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:27.854746 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:27.854722    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"]
Sep 17 21:58:27.856708 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:58:27.856644    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1fc5dd_7627_4036_bab8_38876c424601.slice/crio-652d4fa99070580ab290e6a804f335629cc74c862afc7e33733d1b77c6ba0f03 WatchSource:0}: Error finding container 652d4fa99070580ab290e6a804f335629cc74c862afc7e33733d1b77c6ba0f03: Status 404 returned error can't find the container with id 652d4fa99070580ab290e6a804f335629cc74c862afc7e33733d1b77c6ba0f03
Sep 17 21:58:27.858463 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:27.858430    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 21:58:28.537726 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:28.537678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf" event={"ID":"2a1fc5dd-7627-4036-bab8-38876c424601","Type":"ContainerStarted","Data":"81f983b771dab05e58e80d10d6e8fea988a98b43f1e685538a86096917bd5df6"}
Sep 17 21:58:28.538161 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:28.537747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf" event={"ID":"2a1fc5dd-7627-4036-bab8-38876c424601","Type":"ContainerStarted","Data":"652d4fa99070580ab290e6a804f335629cc74c862afc7e33733d1b77c6ba0f03"}
Sep 17 21:58:28.538161 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:28.537799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:28.916019 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:28.915981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:30.686103 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:30.686073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:32.163544 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:32.163499    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:33.566866 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.566814    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf" podStartSLOduration=8.079419154 podStartE2EDuration="8.566797173s" totalImagesPullingTime="487.378019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:28.587149004 +0000 UTC m=+1042.108713933" watchObservedRunningTime="2026-09-17 21:58:33.566797173 +0000 UTC m=+1047.088362103"
Sep 17 21:58:33.569280 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.569261    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"]
Sep 17 21:58:33.571835 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.571819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.575559 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.575538    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-4bd0ef-serving-cert\""
Sep 17 21:58:33.637773 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.637739    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"]
Sep 17 21:58:33.661722 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.661681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-openshift-service-ca\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.661880 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.661735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlf4m\" (UniqueName: \"kubernetes.io/projected/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-kube-api-access-hlf4m\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.661880 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.661764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.661880 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.661782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-metrics-certs\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.736464 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.736419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:33.763143 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.763109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-openshift-service-ca\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.763297 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.763153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlf4m\" (UniqueName: \"kubernetes.io/projected/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-kube-api-access-hlf4m\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.763297 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.763185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.763297 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.763208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-metrics-certs\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.763448 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:33.763349    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-serving-cert: secret "maas-api-e2e-explicit-4bd0ef-serving-cert" not found
Sep 17 21:58:33.763448 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:58:33.763426    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls podName:36e6df07-6138-434e-8ee6-a0ce76c7a1cf nodeName:}" failed. No retries permitted until 2026-09-17 21:58:34.263408566 +0000 UTC m=+1047.784973474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls") pod "maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4" (UID: "36e6df07-6138-434e-8ee6-a0ce76c7a1cf") : secret "maas-api-e2e-explicit-4bd0ef-serving-cert" not found
Sep 17 21:58:33.763859 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.763842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-openshift-service-ca\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.765922 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.765902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-metrics-certs\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.784290 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.784255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlf4m\" (UniqueName: \"kubernetes.io/projected/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-kube-api-access-hlf4m\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:33.934201 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:33.934110    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:34.269001 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:34.268879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:34.271490 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:34.271465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls\") pod \"maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:34.275304 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:34.275278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:34.483333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:34.483175    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:34.551887 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:34.550892    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:34.802878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:34.802856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"]
Sep 17 21:58:34.804761 ip-10-0-138-7 kubenswrapper[2580]: W0917 21:58:34.804735    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e6df07_6138_434e_8ee6_a0ce76c7a1cf.slice/crio-cb4eff72f8ab115c4960667be89ee1ceb5a9c901e5e92d69b73295a56f135612 WatchSource:0}: Error finding container cb4eff72f8ab115c4960667be89ee1ceb5a9c901e5e92d69b73295a56f135612: Status 404 returned error can't find the container with id cb4eff72f8ab115c4960667be89ee1ceb5a9c901e5e92d69b73295a56f135612
Sep 17 21:58:35.007309 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:35.007274    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:35.318358 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:35.318323    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:35.580132 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:35.580103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4" event={"ID":"36e6df07-6138-434e-8ee6-a0ce76c7a1cf","Type":"ContainerStarted","Data":"b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4"}
Sep 17 21:58:35.580298 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:35.580150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4" event={"ID":"36e6df07-6138-434e-8ee6-a0ce76c7a1cf","Type":"ContainerStarted","Data":"cb4eff72f8ab115c4960667be89ee1ceb5a9c901e5e92d69b73295a56f135612"}
Sep 17 21:58:35.580298 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:35.580209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:36.073811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:36.073778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:37.364537 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:37.364499    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:38.445697 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:38.445641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:39.389445 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:39.389386    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4" podStartSLOduration=6.061751384 podStartE2EDuration="6.38936839s" totalImagesPullingTime="327.617006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:35.648049842 +0000 UTC m=+1049.169614790" watchObservedRunningTime="2026-09-17 21:58:39.38936839 +0000 UTC m=+1052.910933320"
Sep 17 21:58:39.391909 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:39.391887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:58:39.539491 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:39.539463    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:40.568742 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:40.568705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:41.550301 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:41.550264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:41.592729 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:41.592703    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 21:58:42.385072 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:42.385042    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:43.188338 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:43.188311    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:44.147014 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:44.146869    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:44.919967 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:44.919933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:45.935867 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:45.935765    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:46.868042 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:46.868009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:47.825218 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:47.825178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:47.923190 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:47.923145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:49.063935 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:49.063853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:50.162775 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.162737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:50.519844 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.519800    2580 patch_prober.go:28] interesting pod/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 21:58:50.521006 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.519882    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 21:58:50.696764 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.696731    2580 generic.go:356] "Generic (PLEG): container finished" podID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerID="bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582" exitCode=0
Sep 17 21:58:50.696977 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.696807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" event={"ID":"113b7500-83fc-4bc2-b9a2-cdd42d7e9656","Type":"ContainerDied","Data":"bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582"}
Sep 17 21:58:50.697406 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.697350    2580 scope.go:117] "RemoveContainer" containerID="bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582"
Sep 17 21:58:50.698694 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.698649    2580 generic.go:356] "Generic (PLEG): container finished" podID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerID="5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460" exitCode=0
Sep 17 21:58:50.698811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.698693    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:50.698811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.698720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" event={"ID":"e10bf7c0-26e7-430c-a17f-1462fc3db1c2","Type":"ContainerDied","Data":"5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460"}
Sep 17 21:58:50.698811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.698766    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:50.698811 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.698803    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:50.699058 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.699045    2580 scope.go:117] "RemoveContainer" containerID="5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460"
Sep 17 21:58:50.700220 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.700194    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:50.700316 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.700269    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:50.700381 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:50.700322    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 21:58:51.192476 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:51.192383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:51.492611 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:51.492525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:51.706536 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:51.706504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" event={"ID":"113b7500-83fc-4bc2-b9a2-cdd42d7e9656","Type":"ContainerStarted","Data":"d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a"}
Sep 17 21:58:51.708479 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:51.708457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" event={"ID":"e10bf7c0-26e7-430c-a17f-1462fc3db1c2","Type":"ContainerStarted","Data":"b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21"}
Sep 17 21:58:52.185009 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:52.184976    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:52.186063 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:52.186039    2580 patch_prober.go:28] interesting pod/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 17 21:58:52.186179 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:52.186092    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 17 21:58:52.287333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:52.287296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:58:52.287748 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:52.287528    2580 patch_prober.go:28] interesting pod/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 21:58:52.287748 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:52.287567    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 21:58:52.381107 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:52.381066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:53.184456 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.184415    2580 patch_prober.go:28] interesting pod/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 17 21:58:53.184682 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.184472    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 17 21:58:53.287091 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.287055    2580 patch_prober.go:28] interesting pod/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 21:58:53.287281 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.287124    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 21:58:53.479132 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.479012    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"]
Sep 17 21:58:53.479921 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.479887    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf" podUID="2a1fc5dd-7627-4036-bab8-38876c424601" containerName="maas-api" containerID="cri-o://81f983b771dab05e58e80d10d6e8fea988a98b43f1e685538a86096917bd5df6" gracePeriod=30
Sep 17 21:58:53.535418 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.535221    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:53.668260 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.668184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:53.770543 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.770074    2580 generic.go:356] "Generic (PLEG): container finished" podID="2a1fc5dd-7627-4036-bab8-38876c424601" containerID="81f983b771dab05e58e80d10d6e8fea988a98b43f1e685538a86096917bd5df6" exitCode=0
Sep 17 21:58:53.770543 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.770291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf" event={"ID":"2a1fc5dd-7627-4036-bab8-38876c424601","Type":"ContainerDied","Data":"81f983b771dab05e58e80d10d6e8fea988a98b43f1e685538a86096917bd5df6"}
Sep 17 21:58:53.824319 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.824238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:53.879854 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.879821    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:53.969522 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.969496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:53.972829 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.972802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1fc5dd-7627-4036-bab8-38876c424601-openshift-service-ca\") pod \"2a1fc5dd-7627-4036-bab8-38876c424601\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") "
Sep 17 21:58:53.973040 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.973022    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgz84\" (UniqueName: \"kubernetes.io/projected/2a1fc5dd-7627-4036-bab8-38876c424601-kube-api-access-vgz84\") pod \"2a1fc5dd-7627-4036-bab8-38876c424601\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") "
Sep 17 21:58:53.973167 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.973145    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a1fc5dd-7627-4036-bab8-38876c424601-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a1fc5dd-7627-4036-bab8-38876c424601" (UID: "2a1fc5dd-7627-4036-bab8-38876c424601"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:58:53.973289 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.973158    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-metrics-certs\") pod \"2a1fc5dd-7627-4036-bab8-38876c424601\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") "
Sep 17 21:58:53.973456 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.973443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls\") pod \"2a1fc5dd-7627-4036-bab8-38876c424601\" (UID: \"2a1fc5dd-7627-4036-bab8-38876c424601\") "
Sep 17 21:58:53.973737 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.973724    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a1fc5dd-7627-4036-bab8-38876c424601-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:53.975941 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.975921    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a1fc5dd-7627-4036-bab8-38876c424601" (UID: "2a1fc5dd-7627-4036-bab8-38876c424601"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:58:53.976055 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.975948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1fc5dd-7627-4036-bab8-38876c424601-kube-api-access-vgz84" (OuterVolumeSpecName: "kube-api-access-vgz84") pod "2a1fc5dd-7627-4036-bab8-38876c424601" (UID: "2a1fc5dd-7627-4036-bab8-38876c424601"). InnerVolumeSpecName "kube-api-access-vgz84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:58:53.976131 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:53.975963    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2a1fc5dd-7627-4036-bab8-38876c424601" (UID: "2a1fc5dd-7627-4036-bab8-38876c424601"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:58:54.075122 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.075029    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:54.075349 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.075332    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgz84\" (UniqueName: \"kubernetes.io/projected/2a1fc5dd-7627-4036-bab8-38876c424601-kube-api-access-vgz84\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:54.075469 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.075456    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a1fc5dd-7627-4036-bab8-38876c424601-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:58:54.078165 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.077385    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"]
Sep 17 21:58:54.078165 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.077602    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy" containerID="cri-o://b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21" gracePeriod=30
Sep 17 21:58:54.130694 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.130482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:54.184272 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.184233    2580 patch_prober.go:28] interesting pod/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 17 21:58:54.184468 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.184294    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 17 21:58:54.213897 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.213854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:54.397043 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.396933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:54.777861 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.777835    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf" event={"ID":"2a1fc5dd-7627-4036-bab8-38876c424601","Type":"ContainerDied","Data":"652d4fa99070580ab290e6a804f335629cc74c862afc7e33733d1b77c6ba0f03"}
Sep 17 21:58:54.778379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.777892    2580 scope.go:117] "RemoveContainer" containerID="81f983b771dab05e58e80d10d6e8fea988a98b43f1e685538a86096917bd5df6"
Sep 17 21:58:54.778379 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.777992    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"
Sep 17 21:58:54.833816 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.833780    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"]
Sep 17 21:58:54.846068 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.846038    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c85107f9-779f96bbdd-wh4vf"]
Sep 17 21:58:54.882009 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:54.881977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:55.051738 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:55.047974    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a1fc5dd-7627-4036-bab8-38876c424601" path="/var/lib/kubelet/pods/2a1fc5dd-7627-4036-bab8-38876c424601/volumes"
Sep 17 21:58:55.102782 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:55.102726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:55.185084 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:55.185044    2580 patch_prober.go:28] interesting pod/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 17 21:58:55.185264 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:55.185108    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 17 21:58:55.824582 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:55.824547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:56.185223 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:56.185145    2580 patch_prober.go:28] interesting pod/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 17 21:58:56.185223 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:56.185204    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 17 21:58:56.469919 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:56.469831    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:56.857250 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:56.857217    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:57.184553 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:57.184473    2580 patch_prober.go:28] interesting pod/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 17 21:58:57.184786 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:57.184755    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 17 21:58:57.782575 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:57.782529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:58.189274 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:58.189196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:58.189748 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:58.189594    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:58.190320 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:58.190304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 21:58:58.983776 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:58.983741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:59.966699 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:58:59.966643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:00.868573 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:00.868543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:00.888240 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:00.888201    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:59:03.134054 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.134032    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:59:03.160524 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.160444    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:03.277252 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277217    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istiod-ca-cert\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-socket\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-token\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277386    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-envoy\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277423    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-credential-socket\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277693 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277452    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48cmm\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-kube-api-access-48cmm\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277693 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277491    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-data\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277693 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277537    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-certs\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277693 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277577    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-podinfo\") pod \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\" (UID: \"e10bf7c0-26e7-430c-a17f-1462fc3db1c2\") "
Sep 17 21:59:03.277920 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:59:03.277920 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:59:03.277920 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:59:03.277920 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.277859    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:59:03.278148 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.278014    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:59:03.278148 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.278034    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.278148 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.278091    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.278490 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.278182    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.278490 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.278244    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.279744 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.279718    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:59:03.280028 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.280012    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 21:59:03.280333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.280301    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-kube-api-access-48cmm" (OuterVolumeSpecName: "kube-api-access-48cmm") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "kube-api-access-48cmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:59:03.280333 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.280313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e10bf7c0-26e7-430c-a17f-1462fc3db1c2" (UID: "e10bf7c0-26e7-430c-a17f-1462fc3db1c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:59:03.295696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.295633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:03.379053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.379016    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.379053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.379045    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.379053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.379054    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48cmm\" (UniqueName: \"kubernetes.io/projected/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-kube-api-access-48cmm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.379053 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.379064    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.379318 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.379072    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10bf7c0-26e7-430c-a17f-1462fc3db1c2-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 21:59:03.446574 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.446477    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:03.832510 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.832477    2580 generic.go:356] "Generic (PLEG): container finished" podID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerID="b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21" exitCode=0
Sep 17 21:59:03.832696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.832534    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"
Sep 17 21:59:03.832696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.832545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" event={"ID":"e10bf7c0-26e7-430c-a17f-1462fc3db1c2","Type":"ContainerDied","Data":"b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21"}
Sep 17 21:59:03.832696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.832593    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4" event={"ID":"e10bf7c0-26e7-430c-a17f-1462fc3db1c2","Type":"ContainerDied","Data":"900590ae8e4ede563909a3ae487edc5fb1efbb72bd5c08e0b381164745f67dc9"}
Sep 17 21:59:03.832696 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.832617    2580 scope.go:117] "RemoveContainer" containerID="b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21"
Sep 17 21:59:03.842362 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.842345    2580 scope.go:117] "RemoveContainer" containerID="5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460"
Sep 17 21:59:03.851410 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.851394    2580 scope.go:117] "RemoveContainer" containerID="b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21"
Sep 17 21:59:03.851709 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:59:03.851688    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21\": container with ID starting with b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21 not found: ID does not exist" containerID="b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21"
Sep 17 21:59:03.851759 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.851719    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21"} err="failed to get container status \"b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21\": rpc error: code = NotFound desc = could not find container \"b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21\": container with ID starting with b80887961f5bcbc90e92b01fd8b5cefe469d6c68de97cddf3d5defce9c30df21 not found: ID does not exist"
Sep 17 21:59:03.851759 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.851737    2580 scope.go:117] "RemoveContainer" containerID="5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460"
Sep 17 21:59:03.851988 ip-10-0-138-7 kubenswrapper[2580]: E0917 21:59:03.851970    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460\": container with ID starting with 5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460 not found: ID does not exist" containerID="5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460"
Sep 17 21:59:03.852037 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.851995    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460"} err="failed to get container status \"5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460\": rpc error: code = NotFound desc = could not find container \"5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460\": container with ID starting with 5c73c311958623bc0da50a56f2dcf8be1f4cd7883aa5486bc37133e049975460 not found: ID does not exist"
Sep 17 21:59:03.869835 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.869812    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"]
Sep 17 21:59:03.877080 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.877058    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c85107f9-openshift-default-c66465fb4-tbsl4"]
Sep 17 21:59:03.948145 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:03.948115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:05.024341 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:05.024312    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" path="/var/lib/kubelet/pods/e10bf7c0-26e7-430c-a17f-1462fc3db1c2/volumes"
Sep 17 21:59:08.529878 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:08.529837    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:13.829171 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:13.829133    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:26.952382 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:26.952345    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:59:29.920641 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:29.920608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:36.307444 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:36.307409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:36.456898 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:36.456857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:36.554077 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:36.554043    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:38.419146 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:38.419113    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:44.876615 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:44.876580    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 21:59:45.109789 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:45.109756    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:52.405039 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:52.404999    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 21:59:57.943115 ip-10-0-138-7 kubenswrapper[2580]: I0917 21:59:57.943069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:00.199005 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.198969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"]
Sep 17 22:00:00.199598 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.199578    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy"
Sep 17 22:00:00.199724 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.199601    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy"
Sep 17 22:00:00.199724 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.199637    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1fc5dd-7627-4036-bab8-38876c424601" containerName="maas-api"
Sep 17 22:00:00.199724 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.199645    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1fc5dd-7627-4036-bab8-38876c424601" containerName="maas-api"
Sep 17 22:00:00.199896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.199754    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy"
Sep 17 22:00:00.199896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.199773    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy"
Sep 17 22:00:00.199896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.199784    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a1fc5dd-7627-4036-bab8-38876c424601" containerName="maas-api"
Sep 17 22:00:00.202292 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.202246    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"
Sep 17 22:00:00.222844 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.222816    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nmdbp\""
Sep 17 22:00:00.233241 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.233219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"
Sep 17 22:00:00.248403 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.248363    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"]
Sep 17 22:00:00.517600 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.517564    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"]
Sep 17 22:00:00.518948 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:00:00.518924    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edd563e_2650_4c2f_b5a1_f4bba4b7fc81.slice/crio-3b0b60e0b32d2fc8da9b664c0f4f20cfefa8bd918715783649b26206919cb99f WatchSource:0}: Error finding container 3b0b60e0b32d2fc8da9b664c0f4f20cfefa8bd918715783649b26206919cb99f: Status 404 returned error can't find the container with id 3b0b60e0b32d2fc8da9b664c0f4f20cfefa8bd918715783649b26206919cb99f
Sep 17 22:00:00.836410 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.836378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:00.942470 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:00.942438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:01.038022 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:01.037989    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:01.165238 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:01.165154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw" event={"ID":"1edd563e-2650-4c2f-b5a1-f4bba4b7fc81","Type":"ContainerStarted","Data":"3b0b60e0b32d2fc8da9b664c0f4f20cfefa8bd918715783649b26206919cb99f"}
Sep 17 22:00:04.185323 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:04.185289    2580 generic.go:356] "Generic (PLEG): container finished" podID="1edd563e-2650-4c2f-b5a1-f4bba4b7fc81" containerID="22f62bd15fd33be19655b24f6a1e2b4520a030abbde49e89db1db325586a86a3" exitCode=0
Sep 17 22:00:04.185718 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:04.185348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw" event={"ID":"1edd563e-2650-4c2f-b5a1-f4bba4b7fc81","Type":"ContainerDied","Data":"22f62bd15fd33be19655b24f6a1e2b4520a030abbde49e89db1db325586a86a3"}
Sep 17 22:00:05.323973 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:05.323946    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"
Sep 17 22:00:06.197190 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:06.197154    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"
Sep 17 22:00:06.197190 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:06.197169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw" event={"ID":"1edd563e-2650-4c2f-b5a1-f4bba4b7fc81","Type":"ContainerDied","Data":"3b0b60e0b32d2fc8da9b664c0f4f20cfefa8bd918715783649b26206919cb99f"}
Sep 17 22:00:06.197419 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:06.197219    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b0b60e0b32d2fc8da9b664c0f4f20cfefa8bd918715783649b26206919cb99f"
Sep 17 22:00:08.859843 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:08.859804    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:00:11.553542 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:11.553502    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:12.359752 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:12.359704    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:18.627433 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:18.627393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:18.785500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:18.785462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:18.890257 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:18.890155    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:19.708231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:19.708193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:19.816792 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:19.816751    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:21.543841 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:21.543799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:28.121781 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:28.121725    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:28.191466 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:28.191413    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:28.776031 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:28.775990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:29.404286 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:29.404243    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:00:32.338809 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:32.338775    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:33.684302 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:33.684267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:34.689618 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:34.689579    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:35.670257 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:35.670228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:36.218278 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.218242    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:36.322484 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.322447    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:36.474490 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.474406    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:36.783517 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.783478    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"]
Sep 17 22:00:36.783988 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.783970    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1edd563e-2650-4c2f-b5a1-f4bba4b7fc81" containerName="cleanup"
Sep 17 22:00:36.784087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.783990    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1edd563e-2650-4c2f-b5a1-f4bba4b7fc81" containerName="cleanup"
Sep 17 22:00:36.784087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.784007    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy"
Sep 17 22:00:36.784087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.784014    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10bf7c0-26e7-430c-a17f-1462fc3db1c2" containerName="istio-proxy"
Sep 17 22:00:36.784246 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.784122    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1edd563e-2650-4c2f-b5a1-f4bba4b7fc81" containerName="cleanup"
Sep 17 22:00:36.792583 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.792552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.798446 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.798375    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-93af11bc-openshift-default-dockercfg-hx9jj\""
Sep 17 22:00:36.803744 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.803720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"]
Sep 17 22:00:36.896433 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-socket\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896612 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-data\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896612 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7adc2d48-337f-49c3-9c44-54a1dd40741c-istiod-ca-cert\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896612 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-token\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896764 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-envoy\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896764 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-credential-socket\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896764 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-podinfo\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896764 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-certs\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.896895 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.896782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqw5h\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-kube-api-access-bqw5h\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.997556 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-token\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.997817 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-envoy\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.997817 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-credential-socket\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.997817 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-podinfo\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.997817 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-certs\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.997817 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqw5h\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-kube-api-access-bqw5h\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.997817 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-socket\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.998149 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-data\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.998149 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.997929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7adc2d48-337f-49c3-9c44-54a1dd40741c-istiod-ca-cert\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.998149 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.998053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-credential-socket\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.998314 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.998151    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-certs\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.998314 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.998194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-socket\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.998414 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.998338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-data\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:36.998855 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:36.998833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7adc2d48-337f-49c3-9c44-54a1dd40741c-istiod-ca-cert\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:37.000152 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.000135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-envoy\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:37.000465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.000443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-podinfo\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:37.014155 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.014130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-token\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:37.014288 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.014207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqw5h\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-kube-api-access-bqw5h\") pod \"e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") " pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:37.104685 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.104566    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:37.659441 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.659404    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"]
Sep 17 22:00:37.664520 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:00:37.664495    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adc2d48_337f_49c3_9c44_54a1dd40741c.slice/crio-16acba4f7e0c1ec6e3efc96dd2ff364605f280371e831ead047a03062475d088 WatchSource:0}: Error finding container 16acba4f7e0c1ec6e3efc96dd2ff364605f280371e831ead047a03062475d088: Status 404 returned error can't find the container with id 16acba4f7e0c1ec6e3efc96dd2ff364605f280371e831ead047a03062475d088
Sep 17 22:00:37.666865 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.666829    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:00:37.666961 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.666902    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:00:37.666961 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.666930    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:00:37.723181 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.723146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:37.836647 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:37.836610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:38.303712 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:38.303640    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:38.382207 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:38.382170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" event={"ID":"7adc2d48-337f-49c3-9c44-54a1dd40741c","Type":"ContainerStarted","Data":"6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d"}
Sep 17 22:00:38.382402 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:38.382218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" event={"ID":"7adc2d48-337f-49c3-9c44-54a1dd40741c","Type":"ContainerStarted","Data":"16acba4f7e0c1ec6e3efc96dd2ff364605f280371e831ead047a03062475d088"}
Sep 17 22:00:38.425418 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:38.425339    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podStartSLOduration=2.425314393 podStartE2EDuration="2.425314393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:38.424339853 +0000 UTC m=+1171.945904834" watchObservedRunningTime="2026-09-17 22:00:38.425314393 +0000 UTC m=+1171.946879325"
Sep 17 22:00:39.104863 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:39.104823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:39.110443 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:39.110406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:39.295178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:39.295145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:39.387433 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:39.387354    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:39.388319 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:39.388302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:00:42.038473 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.038428    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"]
Sep 17 22:00:42.038929 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.038711    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4" podUID="36e6df07-6138-434e-8ee6-a0ce76c7a1cf" containerName="maas-api" containerID="cri-o://b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4" gracePeriod=30
Sep 17 22:00:42.299956 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.299876    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 22:00:42.406280 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.406250    2580 generic.go:356] "Generic (PLEG): container finished" podID="36e6df07-6138-434e-8ee6-a0ce76c7a1cf" containerID="b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4" exitCode=0
Sep 17 22:00:42.406475 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.406296    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"
Sep 17 22:00:42.406475 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.406338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4" event={"ID":"36e6df07-6138-434e-8ee6-a0ce76c7a1cf","Type":"ContainerDied","Data":"b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4"}
Sep 17 22:00:42.406475 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.406428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4" event={"ID":"36e6df07-6138-434e-8ee6-a0ce76c7a1cf","Type":"ContainerDied","Data":"cb4eff72f8ab115c4960667be89ee1ceb5a9c901e5e92d69b73295a56f135612"}
Sep 17 22:00:42.406475 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.406453    2580 scope.go:117] "RemoveContainer" containerID="b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4"
Sep 17 22:00:42.415910 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.415882    2580 scope.go:117] "RemoveContainer" containerID="b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4"
Sep 17 22:00:42.416227 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:00:42.416207    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4\": container with ID starting with b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4 not found: ID does not exist" containerID="b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4"
Sep 17 22:00:42.416297 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.416235    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4"} err="failed to get container status \"b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4\": rpc error: code = NotFound desc = could not find container \"b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4\": container with ID starting with b98954a51ebd9b4476b4ce1228b415abea43419ea48b768590dd2f1d1388d6d4 not found: ID does not exist"
Sep 17 22:00:42.445684 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.445620    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-metrics-certs\") pod \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") "
Sep 17 22:00:42.445896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.445714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls\") pod \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") "
Sep 17 22:00:42.445896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.445749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlf4m\" (UniqueName: \"kubernetes.io/projected/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-kube-api-access-hlf4m\") pod \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") "
Sep 17 22:00:42.445896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.445804    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-openshift-service-ca\") pod \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\" (UID: \"36e6df07-6138-434e-8ee6-a0ce76c7a1cf\") "
Sep 17 22:00:42.446221 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.446191    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36e6df07-6138-434e-8ee6-a0ce76c7a1cf" (UID: "36e6df07-6138-434e-8ee6-a0ce76c7a1cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:00:42.448024 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.447984    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-kube-api-access-hlf4m" (OuterVolumeSpecName: "kube-api-access-hlf4m") pod "36e6df07-6138-434e-8ee6-a0ce76c7a1cf" (UID: "36e6df07-6138-434e-8ee6-a0ce76c7a1cf"). InnerVolumeSpecName "kube-api-access-hlf4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:00:42.448024 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.447997    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "36e6df07-6138-434e-8ee6-a0ce76c7a1cf" (UID: "36e6df07-6138-434e-8ee6-a0ce76c7a1cf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:00:42.448154 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.448067    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36e6df07-6138-434e-8ee6-a0ce76c7a1cf" (UID: "36e6df07-6138-434e-8ee6-a0ce76c7a1cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:00:42.547247 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.547215    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:00:42.547247 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.547246    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:00:42.547460 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.547258    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:00:42.547460 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.547271    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlf4m\" (UniqueName: \"kubernetes.io/projected/36e6df07-6138-434e-8ee6-a0ce76c7a1cf-kube-api-access-hlf4m\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:00:42.625717 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.625606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:42.725326 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.725290    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:42.737289 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.737256    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"]
Sep 17 22:00:42.746804 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.746756    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4bd0ef-699c857c5f-rhqh4"]
Sep 17 22:00:42.920794 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:42.920699    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:43.025030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:43.024995    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36e6df07-6138-434e-8ee6-a0ce76c7a1cf" path="/var/lib/kubelet/pods/36e6df07-6138-434e-8ee6-a0ce76c7a1cf/volumes"
Sep 17 22:00:44.120824 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:44.120790    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:44.759343 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:44.759292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:44.920868 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:44.920832    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:46.212487 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:46.212456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:47.142215 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:47.142163    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:47.916000 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:47.915961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:48.280316 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:48.280277    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:49.221079 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.221045    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"]
Sep 17 22:00:49.221568 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.221544    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e6df07-6138-434e-8ee6-a0ce76c7a1cf" containerName="maas-api"
Sep 17 22:00:49.221718 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.221695    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e6df07-6138-434e-8ee6-a0ce76c7a1cf" containerName="maas-api"
Sep 17 22:00:49.221858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.221843    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36e6df07-6138-434e-8ee6-a0ce76c7a1cf" containerName="maas-api"
Sep 17 22:00:49.226226 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.226202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.229728 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.229708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-93af11bc-serving-cert\""
Sep 17 22:00:49.240909 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.240882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"]
Sep 17 22:00:49.291665 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.291632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:49.315035 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.315004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20c763b-c07e-4a4a-a5ab-621d81111ae2-openshift-service-ca\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.315212 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.315050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf9dc\" (UniqueName: \"kubernetes.io/projected/a20c763b-c07e-4a4a-a5ab-621d81111ae2-kube-api-access-hf9dc\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.315212 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.315110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.315212 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.315129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-metrics-certs\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.417015 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.416947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20c763b-c07e-4a4a-a5ab-621d81111ae2-openshift-service-ca\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.418351 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.418327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf9dc\" (UniqueName: \"kubernetes.io/projected/a20c763b-c07e-4a4a-a5ab-621d81111ae2-kube-api-access-hf9dc\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.418563 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.418546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.418705 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.418688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-metrics-certs\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.419863 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.418235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20c763b-c07e-4a4a-a5ab-621d81111ae2-openshift-service-ca\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.420106 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:00:49.420057    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-serving-cert: secret "maas-api-e2e-mt-93af11bc-serving-cert" not found
Sep 17 22:00:49.420297 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:00:49.420284    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls podName:a20c763b-c07e-4a4a-a5ab-621d81111ae2 nodeName:}" failed. No retries permitted until 2026-09-17 22:00:49.920261045 +0000 UTC m=+1183.441825995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls") pod "maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9" (UID: "a20c763b-c07e-4a4a-a5ab-621d81111ae2") : secret "maas-api-e2e-mt-93af11bc-serving-cert" not found
Sep 17 22:00:49.423850 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.423830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-metrics-certs\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.449861 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.449830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:49.454940 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.454918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf9dc\" (UniqueName: \"kubernetes.io/projected/a20c763b-c07e-4a4a-a5ab-621d81111ae2-kube-api-access-hf9dc\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.805405 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.805370    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:49.924154 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.924102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:49.926705 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:49.926650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls\") pod \"maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:50.011575 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:50.011542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:50.136736 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:50.136597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:50.147452 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:50.147421    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:50.445565 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:50.445526    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"]
Sep 17 22:00:50.448086 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:00:50.448061    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20c763b_c07e_4a4a_a5ab_621d81111ae2.slice/crio-a05acee38a7979bdb488e89e991b669a59b3fd1aa0db1094abd908b5029f4ea1 WatchSource:0}: Error finding container a05acee38a7979bdb488e89e991b669a59b3fd1aa0db1094abd908b5029f4ea1: Status 404 returned error can't find the container with id a05acee38a7979bdb488e89e991b669a59b3fd1aa0db1094abd908b5029f4ea1
Sep 17 22:00:50.460117 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:50.460079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9" event={"ID":"a20c763b-c07e-4a4a-a5ab-621d81111ae2","Type":"ContainerStarted","Data":"a05acee38a7979bdb488e89e991b669a59b3fd1aa0db1094abd908b5029f4ea1"}
Sep 17 22:00:50.805597 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:50.805559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:50.900821 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:50.900783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:51.466739 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:51.466706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9" event={"ID":"a20c763b-c07e-4a4a-a5ab-621d81111ae2","Type":"ContainerStarted","Data":"6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596"}
Sep 17 22:00:51.467137 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:51.466769    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:51.491527 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:51.491477    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9" podStartSLOduration=1.9613883460000001 podStartE2EDuration="2.49146023s" totalImagesPullingTime="530.071884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:51.48726371 +0000 UTC m=+1185.008828640" watchObservedRunningTime="2026-09-17 22:00:51.49146023 +0000 UTC m=+1185.013025160"
Sep 17 22:00:51.829431 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:51.829386    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:52.657882 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:52.657854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:53.616190 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:53.616151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:54.404169 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:54.404137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:00:57.477967 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:57.477937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:00:58.767604 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:00:58.767571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:01.661027 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:01.660990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:01:07.153227 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.153190    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"]
Sep 17 22:01:07.156761 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.156743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.160030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.160007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"openshift-service-ca.crt\""
Sep 17 22:01:07.161104 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.161085    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"default-dockercfg-r9shz\""
Sep 17 22:01:07.161209 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.161168    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"kube-root-ca.crt\""
Sep 17 22:01:07.161306 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.161246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"e2e-conflict-a-ce545ee1-kserve-self-signed-certs\""
Sep 17 22:01:07.167597 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.167573    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"]
Sep 17 22:01:07.274148 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.274111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:07.320682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.320246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-dshm\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.320682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.320347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-home\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.320682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.320388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-model-cache\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.320682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.320415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-tmp-dir\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.320682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.320495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955d6df7-0bac-4db9-98f1-0185d89a7429-tls-certs\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.320682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.320538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvs4j\" (UniqueName: \"kubernetes.io/projected/955d6df7-0bac-4db9-98f1-0185d89a7429-kube-api-access-hvs4j\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.421455 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.421351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-model-cache\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.423155 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.423131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-tmp-dir\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.423391 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.423375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955d6df7-0bac-4db9-98f1-0185d89a7429-tls-certs\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.423524 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.423509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvs4j\" (UniqueName: \"kubernetes.io/projected/955d6df7-0bac-4db9-98f1-0185d89a7429-kube-api-access-hvs4j\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.423673 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.423638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-dshm\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.424460 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.424441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-home\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.424616 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.422104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-model-cache\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.424757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.424064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-tmp-dir\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.425105 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.425086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-home\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.427139 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.427118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955d6df7-0bac-4db9-98f1-0185d89a7429-tls-certs\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.428919 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.428893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-dshm\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.432897 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.432878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvs4j\" (UniqueName: \"kubernetes.io/projected/955d6df7-0bac-4db9-98f1-0185d89a7429-kube-api-access-hvs4j\") pod \"e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.467403 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.467380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:07.785357 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:07.785331    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"]
Sep 17 22:01:07.787165 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:01:07.787133    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod955d6df7_0bac_4db9_98f1_0185d89a7429.slice/crio-cb4c4e6cff4bbdc366c7e477b603121c815aca47b08f4cad0ad65d700354aef3 WatchSource:0}: Error finding container cb4c4e6cff4bbdc366c7e477b603121c815aca47b08f4cad0ad65d700354aef3: Status 404 returned error can't find the container with id cb4c4e6cff4bbdc366c7e477b603121c815aca47b08f4cad0ad65d700354aef3
Sep 17 22:01:08.461605 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:08.461579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:01:08.465940 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:08.465918    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:01:08.575313 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:08.575278    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg" event={"ID":"955d6df7-0bac-4db9-98f1-0185d89a7429","Type":"ContainerStarted","Data":"390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978"}
Sep 17 22:01:08.575524 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:08.575326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg" event={"ID":"955d6df7-0bac-4db9-98f1-0185d89a7429","Type":"ContainerStarted","Data":"cb4c4e6cff4bbdc366c7e477b603121c815aca47b08f4cad0ad65d700354aef3"}
Sep 17 22:01:08.599994 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:08.599942    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg" podStartSLOduration=1.5999257980000001 podStartE2EDuration="1.599925798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:01:08.598483942 +0000 UTC m=+1202.120048873" watchObservedRunningTime="2026-09-17 22:01:08.599925798 +0000 UTC m=+1202.121490728"
Sep 17 22:01:10.428918 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:10.428868    2580 patch_prober.go:28] interesting pod/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 22:01:10.429352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:10.428968    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 22:01:12.604818 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:12.604780    2580 generic.go:356] "Generic (PLEG): container finished" podID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerID="6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d" exitCode=0
Sep 17 22:01:12.605254 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:12.604856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" event={"ID":"7adc2d48-337f-49c3-9c44-54a1dd40741c","Type":"ContainerDied","Data":"6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d"}
Sep 17 22:01:12.605316 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:12.605302    2580 scope.go:117] "RemoveContainer" containerID="6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d"
Sep 17 22:01:12.606526 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:12.606495    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:12.606619 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:12.606564    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:12.606619 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:12.606595    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:13.434169 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:13.434131    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:13.617874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:13.617834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" event={"ID":"7adc2d48-337f-49c3-9c44-54a1dd40741c","Type":"ContainerStarted","Data":"ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4"}
Sep 17 22:01:14.105247 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:14.105173    2580 patch_prober.go:28] interesting pod/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 17 22:01:14.105621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:14.105588    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 17 22:01:14.105851 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:14.105523    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:01:14.783113 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:14.783074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:15.106183 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:15.106079    2580 patch_prober.go:28] interesting pod/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 17 22:01:15.106183 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:15.106155    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 17 22:01:15.277635 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:15.277598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:15.718586 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:15.718552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:15.816955 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:15.816922    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:15.922976 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:15.922942    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:16.105940 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:16.105898    2580 patch_prober.go:28] interesting pod/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 17 22:01:16.106150 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:16.105972    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 17 22:01:16.403728 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:16.403609    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:17.105352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:17.105315    2580 patch_prober.go:28] interesting pod/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 17 22:01:17.105989 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:17.105956    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 17 22:01:17.468113 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:17.468030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:17.468113 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:17.468074    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:17.481731 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:17.481710    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:17.545680 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:17.545629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:17.659053 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:17.659020    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:01:18.105324 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:18.105286    2580 patch_prober.go:28] interesting pod/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 17 22:01:18.105623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:18.105589    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 17 22:01:18.854368 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:18.854331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:19.111014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:19.110926    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:01:19.111453 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:19.111310    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:01:19.112330 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:19.112301    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:01:19.773590 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:19.773554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:20.662519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:20.662482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:22.853303 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:22.853267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:22.976498 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:22.976457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:24.223171 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:24.223137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:25.019711 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:25.019676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:25.999179 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:25.999139    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:26.363723 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:26.363651    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:26.709919 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:26.709833    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"]
Sep 17 22:01:26.710073 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:26.710036    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" containerID="cri-o://d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a" gracePeriod=30
Sep 17 22:01:26.804996 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:26.804957    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:27.060032 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.059998    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:27.145415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.145382    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"]
Sep 17 22:01:27.148506 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.148476    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:27.149851 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.149834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.155300 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.155267    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f996ae\"/\"kube-root-ca.crt\""
Sep 17 22:01:27.155792 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.155767    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f996ae\"/\"default-dockercfg-tqvp5\""
Sep 17 22:01:27.155913 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.155793    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f996ae\"/\"openshift-service-ca.crt\""
Sep 17 22:01:27.155913 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.155773    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f996ae\"/\"distinct-w0-f996ae-kserve-self-signed-certs\""
Sep 17 22:01:27.163839 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.163818    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"]
Sep 17 22:01:27.243536 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.243505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tls-certs\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.243715 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.243549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-model-cache\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.243715 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.243685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-home\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.243826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.243739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tmp-dir\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.243826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.243771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-kube-api-access-785nl\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.243826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.243810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-dshm\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.264443 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.264414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:27.345417 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-dshm\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.345417 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tls-certs\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.345691 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-model-cache\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.345691 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-home\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.345691 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tmp-dir\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.345691 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-kube-api-access-785nl\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.345937 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-model-cache\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.345937 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tmp-dir\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.346034 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.345991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-home\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.348521 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.348496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-dshm\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.348746 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.348728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tls-certs\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.363395 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.363372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-kube-api-access-785nl\") pod \"distinct-w0-f996ae-kserve-6d45f8c875-lb6w6\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") " pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.452467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.452431    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"]
Sep 17 22:01:27.456216 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.456200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.458840 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.458818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:27.465222 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.465205    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-2d1bcf-openshift-default-dockercfg-8bkjm\""
Sep 17 22:01:27.482934 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.482904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"]
Sep 17 22:01:27.489416 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.489357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.547880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-socket\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.547960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfpj\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-kube-api-access-djfpj\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.548006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-envoy\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.548040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-istio-token\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.548086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bf4206-3c5e-41db-856d-97147d3df9da-istio-podinfo\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.548112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bf4206-3c5e-41db-856d-97147d3df9da-istiod-ca-cert\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.548144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-data\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.548199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-credential-socket\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.548440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.548244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-certs\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.648962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.648867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-istio-token\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.648962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.648912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bf4206-3c5e-41db-856d-97147d3df9da-istio-podinfo\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.648962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.648928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bf4206-3c5e-41db-856d-97147d3df9da-istiod-ca-cert\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.648962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.648952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-data\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.648994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-credential-socket\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-certs\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-socket\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfpj\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-kube-api-access-djfpj\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-envoy\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649616 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-data\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649616 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-socket\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649993 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bf4206-3c5e-41db-856d-97147d3df9da-istiod-ca-cert\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649993 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-certs\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.649993 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.649819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-credential-socket\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.651599 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.651577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-envoy\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.651720 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.651705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bf4206-3c5e-41db-856d-97147d3df9da-istio-podinfo\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.660641 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.660618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-istio-token\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.660864 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.660846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfpj\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-kube-api-access-djfpj\") pod \"e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") " pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.754134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.754104    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"]
Sep 17 22:01:27.755877 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:01:27.755854    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb2f6f6f_4c49_4818_9f3e_4fe671e8eab2.slice/crio-89122a865deada0a3a485627fe52953bf2d53ff39798b6dc1ffcf0501d0dad93 WatchSource:0}: Error finding container 89122a865deada0a3a485627fe52953bf2d53ff39798b6dc1ffcf0501d0dad93: Status 404 returned error can't find the container with id 89122a865deada0a3a485627fe52953bf2d53ff39798b6dc1ffcf0501d0dad93
Sep 17 22:01:27.767735 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.767714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:27.812327 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:27.812284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:28.041830 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.041797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:28.051860 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.051835    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"]
Sep 17 22:01:28.052839 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:01:28.052817    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59bf4206_3c5e_41db_856d_97147d3df9da.slice/crio-476bc2eaa94647d7f30b24b4e0f230a413be9d9a5f16d0b442bf3742017f152e WatchSource:0}: Error finding container 476bc2eaa94647d7f30b24b4e0f230a413be9d9a5f16d0b442bf3742017f152e: Status 404 returned error can't find the container with id 476bc2eaa94647d7f30b24b4e0f230a413be9d9a5f16d0b442bf3742017f152e
Sep 17 22:01:28.055233 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.055201    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:28.055338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.055286    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:28.055338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.055332    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:28.192514 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.192462    2580 patch_prober.go:28] interesting pod/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 22:01:28.192950 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.192543    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 22:01:28.723748 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.723707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6" event={"ID":"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2","Type":"ContainerStarted","Data":"9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a"}
Sep 17 22:01:28.723939 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.723766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6" event={"ID":"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2","Type":"ContainerStarted","Data":"89122a865deada0a3a485627fe52953bf2d53ff39798b6dc1ffcf0501d0dad93"}
Sep 17 22:01:28.725362 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.725336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk" event={"ID":"59bf4206-3c5e-41db-856d-97147d3df9da","Type":"ContainerStarted","Data":"b7fc067c1250a3024ad2ecba7141f2abed0c453d14cf64946212532108c8ee63"}
Sep 17 22:01:28.725498 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.725398    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk" event={"ID":"59bf4206-3c5e-41db-856d-97147d3df9da","Type":"ContainerStarted","Data":"476bc2eaa94647d7f30b24b4e0f230a413be9d9a5f16d0b442bf3742017f152e"}
Sep 17 22:01:28.745074 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.744944    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6" podStartSLOduration=1.744929086 podStartE2EDuration="1.744929086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:01:28.743042827 +0000 UTC m=+1222.264607775" watchObservedRunningTime="2026-09-17 22:01:28.744929086 +0000 UTC m=+1222.266494015"
Sep 17 22:01:28.768061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.768018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:28.770683 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.770616    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk" podStartSLOduration=1.7705975999999999 podStartE2EDuration="1.7705976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:01:28.768006459 +0000 UTC m=+1222.289571403" watchObservedRunningTime="2026-09-17 22:01:28.7705976 +0000 UTC m=+1222.292162532"
Sep 17 22:01:28.880184 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:28.880151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:01:29.078935 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:29.078896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:29.183767 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:29.183725    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:29.319285 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:29.319250    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:29.773768 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:29.773739    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:30.737341 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:30.737310    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:30.738157 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:30.738141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:01:31.978778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:31.978717    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 22:01:32.096188 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096150    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-socket\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096188 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096192    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-data\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-token\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096274    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-podinfo\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-certs\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096382    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istiod-ca-cert\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096412    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk9s2\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-kube-api-access-xk9s2\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096746 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096458    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:32.096746 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-envoy\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096746 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096518    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-credential-socket\") pod \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\" (UID: \"113b7500-83fc-4bc2-b9a2-cdd42d7e9656\") "
Sep 17 22:01:32.096746 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096556    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-data" (OuterVolumeSpecName: "istio-data") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:32.096941 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096776    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:32.096941 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096888    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:32.096941 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:01:32.097087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096951    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.097087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096971    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.097087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.096985    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.098913 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.098886    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-token" (OuterVolumeSpecName: "istio-token") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:01:32.099020 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.098948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-kube-api-access-xk9s2" (OuterVolumeSpecName: "kube-api-access-xk9s2") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "kube-api-access-xk9s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:01:32.099063 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.099041    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:01:32.099138 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.099125    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "113b7500-83fc-4bc2-b9a2-cdd42d7e9656" (UID: "113b7500-83fc-4bc2-b9a2-cdd42d7e9656"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:32.198198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.198159    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.198198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.198190    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk9s2\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-kube-api-access-xk9s2\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.198198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.198202    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.198440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.198214    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.198440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.198226    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.198440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.198236    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/113b7500-83fc-4bc2-b9a2-cdd42d7e9656-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:32.750545 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.750509    2580 generic.go:356] "Generic (PLEG): container finished" podID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerID="d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a" exitCode=0
Sep 17 22:01:32.750761 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.750572    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"
Sep 17 22:01:32.750761 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.750588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" event={"ID":"113b7500-83fc-4bc2-b9a2-cdd42d7e9656","Type":"ContainerDied","Data":"d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a"}
Sep 17 22:01:32.750761 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.750692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb" event={"ID":"113b7500-83fc-4bc2-b9a2-cdd42d7e9656","Type":"ContainerDied","Data":"bd339288c05532fa8b682936fc61df7b3a463502d3192d1c53cb1fdbc3622630"}
Sep 17 22:01:32.750761 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.750715    2580 scope.go:117] "RemoveContainer" containerID="d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a"
Sep 17 22:01:32.760709 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.760691    2580 scope.go:117] "RemoveContainer" containerID="bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582"
Sep 17 22:01:32.769409 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.769392    2580 scope.go:117] "RemoveContainer" containerID="d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a"
Sep 17 22:01:32.769696 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:01:32.769645    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a\": container with ID starting with d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a not found: ID does not exist" containerID="d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a"
Sep 17 22:01:32.769797 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.769708    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a"} err="failed to get container status \"d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a\": rpc error: code = NotFound desc = could not find container \"d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a\": container with ID starting with d13e5eed906ce948a25c60bc0c9c1c1f7cf15dcfedaecd1f9882a35ae9d0ea7a not found: ID does not exist"
Sep 17 22:01:32.769797 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.769731    2580 scope.go:117] "RemoveContainer" containerID="bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582"
Sep 17 22:01:32.769977 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:01:32.769962    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582\": container with ID starting with bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582 not found: ID does not exist" containerID="bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582"
Sep 17 22:01:32.770020 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.769982    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582"} err="failed to get container status \"bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582\": rpc error: code = NotFound desc = could not find container \"bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582\": container with ID starting with bb11d1b84e8d816cdb395ab3b89d0ee220d9d2e2d66951f049191c5a83766582 not found: ID does not exist"
Sep 17 22:01:32.776938 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.776914    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"]
Sep 17 22:01:32.787621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:32.787601    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-4bd0ef-openshift-default-5b4d6c85b8-q55kb"]
Sep 17 22:01:33.025354 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:33.025326    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" path="/var/lib/kubelet/pods/113b7500-83fc-4bc2-b9a2-cdd42d7e9656/volumes"
Sep 17 22:01:33.926017 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:33.925980    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"]
Sep 17 22:01:33.926202 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:33.926179    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9" podUID="a20c763b-c07e-4a4a-a5ab-621d81111ae2" containerName="maas-api" containerID="cri-o://6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596" gracePeriod=30
Sep 17 22:01:33.991845 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:33.991771    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:34.128493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.128451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:34.197178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.197151    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:01:34.250283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.250246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:34.317029 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.317002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf9dc\" (UniqueName: \"kubernetes.io/projected/a20c763b-c07e-4a4a-a5ab-621d81111ae2-kube-api-access-hf9dc\") pod \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") "
Sep 17 22:01:34.317233 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.317132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls\") pod \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") "
Sep 17 22:01:34.317233 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.317196    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20c763b-c07e-4a4a-a5ab-621d81111ae2-openshift-service-ca\") pod \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") "
Sep 17 22:01:34.317355 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.317237    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-metrics-certs\") pod \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\" (UID: \"a20c763b-c07e-4a4a-a5ab-621d81111ae2\") "
Sep 17 22:01:34.317622 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.317595    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20c763b-c07e-4a4a-a5ab-621d81111ae2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a20c763b-c07e-4a4a-a5ab-621d81111ae2" (UID: "a20c763b-c07e-4a4a-a5ab-621d81111ae2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:01:34.319224 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.319202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20c763b-c07e-4a4a-a5ab-621d81111ae2-kube-api-access-hf9dc" (OuterVolumeSpecName: "kube-api-access-hf9dc") pod "a20c763b-c07e-4a4a-a5ab-621d81111ae2" (UID: "a20c763b-c07e-4a4a-a5ab-621d81111ae2"). InnerVolumeSpecName "kube-api-access-hf9dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:01:34.319322 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.319270    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a20c763b-c07e-4a4a-a5ab-621d81111ae2" (UID: "a20c763b-c07e-4a4a-a5ab-621d81111ae2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:01:34.319322 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.319292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a20c763b-c07e-4a4a-a5ab-621d81111ae2" (UID: "a20c763b-c07e-4a4a-a5ab-621d81111ae2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:01:34.381447 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.381402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:34.418238 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.418208    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:34.418238 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.418235    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a20c763b-c07e-4a4a-a5ab-621d81111ae2-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:34.418238 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.418246    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a20c763b-c07e-4a4a-a5ab-621d81111ae2-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:34.418479 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.418255    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf9dc\" (UniqueName: \"kubernetes.io/projected/a20c763b-c07e-4a4a-a5ab-621d81111ae2-kube-api-access-hf9dc\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:34.523141 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.523107    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:34.765395 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.765360    2580 generic.go:356] "Generic (PLEG): container finished" podID="a20c763b-c07e-4a4a-a5ab-621d81111ae2" containerID="6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596" exitCode=0
Sep 17 22:01:34.765578 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.765404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9" event={"ID":"a20c763b-c07e-4a4a-a5ab-621d81111ae2","Type":"ContainerDied","Data":"6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596"}
Sep 17 22:01:34.765578 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.765415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"
Sep 17 22:01:34.765578 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.765455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9" event={"ID":"a20c763b-c07e-4a4a-a5ab-621d81111ae2","Type":"ContainerDied","Data":"a05acee38a7979bdb488e89e991b669a59b3fd1aa0db1094abd908b5029f4ea1"}
Sep 17 22:01:34.765578 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.765485    2580 scope.go:117] "RemoveContainer" containerID="6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596"
Sep 17 22:01:34.776005 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.775986    2580 scope.go:117] "RemoveContainer" containerID="6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596"
Sep 17 22:01:34.776282 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:01:34.776262    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596\": container with ID starting with 6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596 not found: ID does not exist" containerID="6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596"
Sep 17 22:01:34.776331 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.776291    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596"} err="failed to get container status \"6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596\": rpc error: code = NotFound desc = could not find container \"6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596\": container with ID starting with 6823d4b7cdb3b5973c486c21fd7c7c6484c85793689cc8cd5d0a5f46a2d1a596 not found: ID does not exist"
Sep 17 22:01:34.794876 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.794852    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"]
Sep 17 22:01:34.801248 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.801224    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-93af11bc-5454dc65f-l2cm9"]
Sep 17 22:01:34.817750 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.817715    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:34.910893 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:34.910858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:35.024954 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:35.024870    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20c763b-c07e-4a4a-a5ab-621d81111ae2" path="/var/lib/kubelet/pods/a20c763b-c07e-4a4a-a5ab-621d81111ae2/volumes"
Sep 17 22:01:35.965989 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:35.965917    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:37.050673 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:37.050620    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:37.450897 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:37.450805    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:37.459640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:37.459618    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:37.459769 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:37.459689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:37.472530 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:37.472508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:37.794908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:37.794874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:01:37.897242 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:37.897215    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:38.975763 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:38.975730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:41.130239 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:41.130206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:41.392370 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:41.392269    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"]
Sep 17 22:01:41.392556 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:41.392532    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy" containerID="cri-o://ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4" gracePeriod=30
Sep 17 22:01:43.585726 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:43.585688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:46.654745 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.654722    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:01:46.737508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqw5h\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-kube-api-access-bqw5h\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737452    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-credential-socket\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-data\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737504    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-envoy\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737534    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-socket\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737614    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-podinfo\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7adc2d48-337f-49c3-9c44-54a1dd40741c-istiod-ca-cert\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-certs\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.737874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737793    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-token\") pod \"7adc2d48-337f-49c3-9c44-54a1dd40741c\" (UID: \"7adc2d48-337f-49c3-9c44-54a1dd40741c\") "
Sep 17 22:01:46.738096 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737849    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-data" (OuterVolumeSpecName: "istio-data") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:46.738096 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.737880    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:46.738096 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.738079    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:46.738231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.738161    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7adc2d48-337f-49c3-9c44-54a1dd40741c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:01:46.738231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.738175    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.738231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.738193    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.738231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.738206    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.738370 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.738215    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:46.739850 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.739828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:01:46.740147 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.740123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-token" (OuterVolumeSpecName: "istio-token") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:01:46.740356 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.740341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-kube-api-access-bqw5h" (OuterVolumeSpecName: "kube-api-access-bqw5h") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "kube-api-access-bqw5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:01:46.740408 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.740358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7adc2d48-337f-49c3-9c44-54a1dd40741c" (UID: "7adc2d48-337f-49c3-9c44-54a1dd40741c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:01:46.836196 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.836163    2580 generic.go:356] "Generic (PLEG): container finished" podID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerID="ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4" exitCode=0
Sep 17 22:01:46.836412 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.836210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" event={"ID":"7adc2d48-337f-49c3-9c44-54a1dd40741c","Type":"ContainerDied","Data":"ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4"}
Sep 17 22:01:46.836412 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.836248    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l" event={"ID":"7adc2d48-337f-49c3-9c44-54a1dd40741c","Type":"ContainerDied","Data":"16acba4f7e0c1ec6e3efc96dd2ff364605f280371e831ead047a03062475d088"}
Sep 17 22:01:46.836412 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.836271    2580 scope.go:117] "RemoveContainer" containerID="ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4"
Sep 17 22:01:46.836412 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.836212    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"
Sep 17 22:01:46.838614 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.838596    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.838614 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.838615    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqw5h\" (UniqueName: \"kubernetes.io/projected/7adc2d48-337f-49c3-9c44-54a1dd40741c-kube-api-access-bqw5h\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.838789 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.838623    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.838789 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.838632    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7adc2d48-337f-49c3-9c44-54a1dd40741c-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.838789 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.838639    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7adc2d48-337f-49c3-9c44-54a1dd40741c-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.838789 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.838647    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7adc2d48-337f-49c3-9c44-54a1dd40741c-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:01:46.846265 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.846249    2580 scope.go:117] "RemoveContainer" containerID="6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d"
Sep 17 22:01:46.854942 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.854927    2580 scope.go:117] "RemoveContainer" containerID="ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4"
Sep 17 22:01:46.855206 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:01:46.855186    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4\": container with ID starting with ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4 not found: ID does not exist" containerID="ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4"
Sep 17 22:01:46.855250 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.855214    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4"} err="failed to get container status \"ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4\": rpc error: code = NotFound desc = could not find container \"ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4\": container with ID starting with ec82afdc9b1713180e7e4dd223868a8e1f062ad5474a7021146a67bfc9fdfaa4 not found: ID does not exist"
Sep 17 22:01:46.855250 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.855231    2580 scope.go:117] "RemoveContainer" containerID="6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d"
Sep 17 22:01:46.855487 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:01:46.855467    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d\": container with ID starting with 6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d not found: ID does not exist" containerID="6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d"
Sep 17 22:01:46.855541 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.855497    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d"} err="failed to get container status \"6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d\": rpc error: code = NotFound desc = could not find container \"6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d\": container with ID starting with 6efe40a1e5da55472f902d9964c1821f1bc975863e6b414b0a3fbd8f848adb8d not found: ID does not exist"
Sep 17 22:01:46.859946 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.859924    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"]
Sep 17 22:01:46.864797 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:46.864777    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-93af11bc-openshift-default-5cdf9d889b-9bl5l"]
Sep 17 22:01:47.031002 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:47.030969    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" path="/var/lib/kubelet/pods/7adc2d48-337f-49c3-9c44-54a1dd40741c/volumes"
Sep 17 22:01:48.184622 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:48.184589    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:48.342347 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:48.342318    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:48.488005 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:48.487915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:55.140210 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:55.140162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:55.258612 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:55.258563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:55.985381 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:55.985346    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:56.186983 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.186948    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"]
Sep 17 22:01:56.187359 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187346    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy"
Sep 17 22:01:56.187415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187361    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy"
Sep 17 22:01:56.187415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187381    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20c763b-c07e-4a4a-a5ab-621d81111ae2" containerName="maas-api"
Sep 17 22:01:56.187415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187388    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20c763b-c07e-4a4a-a5ab-621d81111ae2" containerName="maas-api"
Sep 17 22:01:56.187415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187394    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy"
Sep 17 22:01:56.187415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187399    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy"
Sep 17 22:01:56.187415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187414    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy"
Sep 17 22:01:56.187590 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187420    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy"
Sep 17 22:01:56.187590 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187485    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy"
Sep 17 22:01:56.187590 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187494    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20c763b-c07e-4a4a-a5ab-621d81111ae2" containerName="maas-api"
Sep 17 22:01:56.187590 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187499    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy"
Sep 17 22:01:56.187590 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.187506    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy"
Sep 17 22:01:56.192338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.192318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.195884 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.195863    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"e2e-conflict-b-ce545ee1-kserve-self-signed-certs\""
Sep 17 22:01:56.203944 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.203919    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"]
Sep 17 22:01:56.226845 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.226814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:56.228923 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.228899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-tmp-dir\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.229047 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.228946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03bc0d3b-f471-47fc-a1e4-9146068f4527-tls-certs\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.229047 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.228963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-model-cache\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.229047 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.228992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfl4m\" (UniqueName: \"kubernetes.io/projected/03bc0d3b-f471-47fc-a1e4-9146068f4527-kube-api-access-vfl4m\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.229047 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.229018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-dshm\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.229047 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.229036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-home\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.329318 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329278    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"]
Sep 17 22:01:56.329788 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03bc0d3b-f471-47fc-a1e4-9146068f4527-tls-certs\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.329858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-model-cache\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.329858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfl4m\" (UniqueName: \"kubernetes.io/projected/03bc0d3b-f471-47fc-a1e4-9146068f4527-kube-api-access-vfl4m\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.329943 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329878    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy"
Sep 17 22:01:56.329943 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329893    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="113b7500-83fc-4bc2-b9a2-cdd42d7e9656" containerName="istio-proxy"
Sep 17 22:01:56.330030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329988    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7adc2d48-337f-49c3-9c44-54a1dd40741c" containerName="istio-proxy"
Sep 17 22:01:56.330030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.329878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-dshm\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.330126 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.330085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-home\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.330239 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.330219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-model-cache\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.330315 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.330294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-tmp-dir\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.330567 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.330546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-home\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.330760 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.330737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-tmp-dir\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.332327 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.332307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-dshm\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.332510 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.332491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03bc0d3b-f471-47fc-a1e4-9146068f4527-tls-certs\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.333861 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.333847    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.337674 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.337641    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-a23afc-openshift-default-dockercfg-fbpxt\""
Sep 17 22:01:56.343058 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.343032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfl4m\" (UniqueName: \"kubernetes.io/projected/03bc0d3b-f471-47fc-a1e4-9146068f4527-kube-api-access-vfl4m\") pod \"e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") " pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.348889 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.348863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"]
Sep 17 22:01:56.374931 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.374901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:56.431803 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.431757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d6ac83-72c5-4025-936a-b44407a32fde-istiod-ca-cert\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.431977 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.431836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-certs\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.431977 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.431875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm9hm\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-kube-api-access-mm9hm\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.432093 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.432000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-credential-socket\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.432093 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.432035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d6ac83-72c5-4025-936a-b44407a32fde-istio-podinfo\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.432093 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.432081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-envoy\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.432283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.432111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-istio-token\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.432283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.432159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-socket\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.432283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.432259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-data\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.502930 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.502896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:01:56.532855 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.532824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-envoy\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.532866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-istio-token\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.532910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-socket\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.532939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-data\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.532964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d6ac83-72c5-4025-936a-b44407a32fde-istiod-ca-cert\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533232 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-certs\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533232 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm9hm\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-kube-api-access-mm9hm\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533232 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-credential-socket\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.533232 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d6ac83-72c5-4025-936a-b44407a32fde-istio-podinfo\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.534246 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-data\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.534246 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-credential-socket\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.534246 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d6ac83-72c5-4025-936a-b44407a32fde-istiod-ca-cert\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.534246 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-socket\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.534246 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.533954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-certs\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.535570 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.535550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-envoy\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.536312 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.536291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d6ac83-72c5-4025-936a-b44407a32fde-istio-podinfo\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.542990 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.542966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-istio-token\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.543534 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.543513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm9hm\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-kube-api-access-mm9hm\") pod \"e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") " pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.582544 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.582472    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:56.668015 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.667978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:56.783897 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.783871    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"]
Sep 17 22:01:56.785847 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:01:56.785816    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03bc0d3b_f471_47fc_a1e4_9146068f4527.slice/crio-bc3e5553f94ea6bd56caa6c0f5626b9ac4cc46c91cca52c3debcbcbf3a63be86 WatchSource:0}: Error finding container bc3e5553f94ea6bd56caa6c0f5626b9ac4cc46c91cca52c3debcbcbf3a63be86: Status 404 returned error can't find the container with id bc3e5553f94ea6bd56caa6c0f5626b9ac4cc46c91cca52c3debcbcbf3a63be86
Sep 17 22:01:56.897237 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.897206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx" event={"ID":"03bc0d3b-f471-47fc-a1e4-9146068f4527","Type":"ContainerStarted","Data":"f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6"}
Sep 17 22:01:56.897237 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.897243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx" event={"ID":"03bc0d3b-f471-47fc-a1e4-9146068f4527","Type":"ContainerStarted","Data":"bc3e5553f94ea6bd56caa6c0f5626b9ac4cc46c91cca52c3debcbcbf3a63be86"}
Sep 17 22:01:56.915266 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.915190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx" podStartSLOduration=0.915168637 podStartE2EDuration="915.168637ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:01:56.914858161 +0000 UTC m=+1250.436423080" watchObservedRunningTime="2026-09-17 22:01:56.915168637 +0000 UTC m=+1250.436733571"
Sep 17 22:01:56.949548 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.949521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"]
Sep 17 22:01:56.950573 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:01:56.950551    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d6ac83_72c5_4025_936a_b44407a32fde.slice/crio-7e6f9eeaaae35aedcef1a57f6e676e695baccb49a185269a8e79144c6fffe579 WatchSource:0}: Error finding container 7e6f9eeaaae35aedcef1a57f6e676e695baccb49a185269a8e79144c6fffe579: Status 404 returned error can't find the container with id 7e6f9eeaaae35aedcef1a57f6e676e695baccb49a185269a8e79144c6fffe579
Sep 17 22:01:56.958725 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.953350    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:56.958725 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.953549    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:56.958725 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:56.953640    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:01:57.905305 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:57.905264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" event={"ID":"70d6ac83-72c5-4025-936a-b44407a32fde","Type":"ContainerStarted","Data":"dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924"}
Sep 17 22:01:57.905305 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:57.905314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" event={"ID":"70d6ac83-72c5-4025-936a-b44407a32fde","Type":"ContainerStarted","Data":"7e6f9eeaaae35aedcef1a57f6e676e695baccb49a185269a8e79144c6fffe579"}
Sep 17 22:01:57.942401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:57.942335    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" podStartSLOduration=1.942318564 podStartE2EDuration="1.942318564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:01:57.938129687 +0000 UTC m=+1251.459694618" watchObservedRunningTime="2026-09-17 22:01:57.942318564 +0000 UTC m=+1251.463883866"
Sep 17 22:01:58.668954 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:58.668868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:58.674013 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:58.673988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:58.911144 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:58.911120    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:58.912093 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:58.912075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:01:58.917954 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:58.917933    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:01:59.258145 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:59.258116    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:59.891503 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:59.891454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:01:59.984289 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:01:59.984255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:00.087113 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:00.087079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:01.274131 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:01.274079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:02.385183 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:02.385144    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:03.501117 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:03.501079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:04.601769 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.601727    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"]
Sep 17 22:02:04.605506 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.605477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.609058 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.609039    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-a23afc-serving-cert\""
Sep 17 22:02:04.631734 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.631707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"]
Sep 17 22:02:04.667036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.666985    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:04.712651 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.712616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.712861 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.712736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.712861 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.712789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.712959 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.712922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlljw\" (UniqueName: \"kubernetes.io/projected/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-kube-api-access-rlljw\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.815274 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.815235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.815585 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.815564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.815775 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.815757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.815982 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.815968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlljw\" (UniqueName: \"kubernetes.io/projected/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-kube-api-access-rlljw\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.817924 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.817899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.821263 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.821236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.822101 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.822076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:04.823854 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.823831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.826450 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.826422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlljw\" (UniqueName: \"kubernetes.io/projected/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-kube-api-access-rlljw\") pod \"maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:04.918587 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:04.918503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:05.202869 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:05.202842    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"]
Sep 17 22:02:05.203802 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:02:05.203779    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ab00f7_ff77_48dd_a708_8345dd8e1cd1.slice/crio-6ba68d5d28fa3e41a048cf7dbf059a69a0dd5df718f0f881b88b4cd29d5d587a WatchSource:0}: Error finding container 6ba68d5d28fa3e41a048cf7dbf059a69a0dd5df718f0f881b88b4cd29d5d587a: Status 404 returned error can't find the container with id 6ba68d5d28fa3e41a048cf7dbf059a69a0dd5df718f0f881b88b4cd29d5d587a
Sep 17 22:02:05.337139 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:05.337103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:05.437138 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:05.437106    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:05.953374 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:05.953337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8" event={"ID":"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1","Type":"ContainerStarted","Data":"6ba68d5d28fa3e41a048cf7dbf059a69a0dd5df718f0f881b88b4cd29d5d587a"}
Sep 17 22:02:06.503562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:06.503528    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:02:06.503826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:06.503599    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:02:06.516586 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:06.516562    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:02:06.962682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:06.962617    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8" event={"ID":"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1","Type":"ContainerStarted","Data":"932319fcb00461c8259ddf8f6e21c7e85f116d9710a1856ccf02de80ab88aaba"}
Sep 17 22:02:06.963078 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:06.962700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:06.974480 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:06.974465    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:02:06.985644 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:06.985597    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8" podStartSLOduration=2.139598671 podStartE2EDuration="2.985583744s" totalImagesPullingTime="845.985073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:02:06.984118321 +0000 UTC m=+1260.505683271" watchObservedRunningTime="2026-09-17 22:02:06.985583744 +0000 UTC m=+1260.507148674"
Sep 17 22:02:12.973639 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:12.973609    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:02:20.439610 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:20.439560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:20.553668 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:20.553632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:22.676057 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:22.676024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:23.074384 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:23.074349    2580 generic.go:356] "Generic (PLEG): container finished" podID="70d6ac83-72c5-4025-936a-b44407a32fde" containerID="dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924" exitCode=0
Sep 17 22:02:23.074638 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:23.074421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" event={"ID":"70d6ac83-72c5-4025-936a-b44407a32fde","Type":"ContainerDied","Data":"dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924"}
Sep 17 22:02:23.074954 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:23.074937    2580 scope.go:117] "RemoveContainer" containerID="dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924"
Sep 17 22:02:23.076132 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:23.076101    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:02:23.076224 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:23.076186    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:02:23.076286 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:23.076260    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:02:24.082669 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:24.082626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" event={"ID":"70d6ac83-72c5-4025-936a-b44407a32fde","Type":"ContainerStarted","Data":"1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c"}
Sep 17 22:02:24.668578 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:24.668544    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:02:24.669698 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:24.669672    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 22:02:24.669826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:24.669724    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 22:02:25.668615 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:25.668578    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 22:02:25.669045 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:25.668634    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 22:02:26.669329 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:26.669291    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 22:02:26.669745 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:26.669361    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 22:02:27.668869 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:27.668830    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 22:02:27.669134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:27.668894    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 22:02:28.668741 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:28.668702    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 22:02:28.669207 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:28.668765    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 22:02:28.911102 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:28.911062    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:02:29.301812 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:29.301772    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:29.679899 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:29.679815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:02:29.680811 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:29.680793    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:02:29.967228 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:29.967120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:30.337121 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.337076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:30.427926 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.427870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:30.717397 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.717317    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"]
Sep 17 22:02:30.720625 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.720607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.728199 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.728182    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-12d586-openshift-default-dockercfg-crnmv\""
Sep 17 22:02:30.736732 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.736706    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"]
Sep 17 22:02:30.760700 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.760650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:30.784046 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-token\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784236 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-envoy\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784236 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-podinfo\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784236 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-certs\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784236 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-socket\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784236 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjqv\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-kube-api-access-lwjqv\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784236 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-credential-socket\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-data\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.784481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.784291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istiod-ca-cert\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.884890 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.884860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-envoy\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.884895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-podinfo\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.884920    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-certs\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.884959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-socket\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjqv\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-kube-api-access-lwjqv\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-credential-socket\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-data\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885404 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istiod-ca-cert\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885404 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-token\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-certs\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-socket\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-credential-socket\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.885747 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.885724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-data\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.886406 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.886384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istiod-ca-cert\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.887511 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.887485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-envoy\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.887758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.887743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-podinfo\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.894571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.894540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-token\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:30.895650 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:30.895628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjqv\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-kube-api-access-lwjqv\") pod \"e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") " pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:31.031897 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:31.031869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:31.304425 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:31.304329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:31.319223 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:31.319196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"]
Sep 17 22:02:31.320125 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:02:31.320100    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e69067_67f5_4b03_a10b_dd17c2d1b7d2.slice/crio-a74fc024799984523039cefba8a3c7efdcd10b7250584f76a24faaf841aa9f11 WatchSource:0}: Error finding container a74fc024799984523039cefba8a3c7efdcd10b7250584f76a24faaf841aa9f11: Status 404 returned error can't find the container with id a74fc024799984523039cefba8a3c7efdcd10b7250584f76a24faaf841aa9f11
Sep 17 22:02:31.322549 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:31.322507    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:02:31.322629 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:31.322608    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:02:31.322711 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:31.322685    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:02:31.914747 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:31.914718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:32.076971 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:32.076931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:02:32.141731 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:32.141695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" event={"ID":"51e69067-67f5-4b03-a10b-dd17c2d1b7d2","Type":"ContainerStarted","Data":"f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b"}
Sep 17 22:02:32.141908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:32.141756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" event={"ID":"51e69067-67f5-4b03-a10b-dd17c2d1b7d2","Type":"ContainerStarted","Data":"a74fc024799984523039cefba8a3c7efdcd10b7250584f76a24faaf841aa9f11"}
Sep 17 22:02:32.174249 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:32.174144    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podStartSLOduration=2.174127242 podStartE2EDuration="2.174127242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:02:32.169742012 +0000 UTC m=+1285.691306973" watchObservedRunningTime="2026-09-17 22:02:32.174127242 +0000 UTC m=+1285.695692171"
Sep 17 22:02:32.550266 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:32.550233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:33.034018 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:33.033978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:33.037983 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:33.037955    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:33.170891 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:33.170834    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:33.173404 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:33.173379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:02:34.023340 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:34.023294    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:34.317016 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:34.316923    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:34.515029 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:34.514993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:35.934839 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:35.934804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:37.796630 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.796596    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"]
Sep 17 22:02:37.800473 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.800451    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.803774 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.803752    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-12d586-serving-cert\""
Sep 17 22:02:37.817271 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.817244    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"]
Sep 17 22:02:37.863583 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.863543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.863583 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.863582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bswg\" (UniqueName: \"kubernetes.io/projected/9e648961-7526-40c8-b99e-17cb4a1989ab-kube-api-access-5bswg\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.863875 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.863709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e648961-7526-40c8-b99e-17cb4a1989ab-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.863875 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.863779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.883642 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.883593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:37.965326 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.965287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e648961-7526-40c8-b99e-17cb4a1989ab-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.965532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.965354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.965532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.965435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.965532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.965469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bswg\" (UniqueName: \"kubernetes.io/projected/9e648961-7526-40c8-b99e-17cb4a1989ab-kube-api-access-5bswg\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.965841 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:02:37.965576    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-serving-cert: secret "maas-api-e2e-shared-b-w2-12d586-serving-cert" not found
Sep 17 22:02:37.965841 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:02:37.965641    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls podName:9e648961-7526-40c8-b99e-17cb4a1989ab nodeName:}" failed. No retries permitted until 2026-09-17 22:02:38.465624698 +0000 UTC m=+1291.987189605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls") pod "maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2" (UID: "9e648961-7526-40c8-b99e-17cb4a1989ab") : secret "maas-api-e2e-shared-b-w2-12d586-serving-cert" not found
Sep 17 22:02:37.966129 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.966107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e648961-7526-40c8-b99e-17cb4a1989ab-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.968139 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.968119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:37.978467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:37.978431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bswg\" (UniqueName: \"kubernetes.io/projected/9e648961-7526-40c8-b99e-17cb4a1989ab-kube-api-access-5bswg\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:38.005701 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.005635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:38.449274 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.449236    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:38.472017 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.471982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:38.474764 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.474738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:38.552694 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.552594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:38.649965 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.649936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:38.712984 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.712894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:38.996979 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:38.996896    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"]
Sep 17 22:02:39.035589 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:39.035558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:39.205731 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:39.205692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2" event={"ID":"9e648961-7526-40c8-b99e-17cb4a1989ab","Type":"ContainerStarted","Data":"5def39eb6e8465eedb5ea64a6560945e8a66349774e6b2f588ef619f47db79dc"}
Sep 17 22:02:39.978644 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:39.978535    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:40.214417 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:40.214376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2" event={"ID":"9e648961-7526-40c8-b99e-17cb4a1989ab","Type":"ContainerStarted","Data":"3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4"}
Sep 17 22:02:40.214886 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:40.214525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:40.238570 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:40.238449    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2" podStartSLOduration=2.704737737 podStartE2EDuration="3.238424283s" totalImagesPullingTime="533.686546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:02:40.236631931 +0000 UTC m=+1293.758196863" watchObservedRunningTime="2026-09-17 22:02:40.238424283 +0000 UTC m=+1293.759989212"
Sep 17 22:02:41.072367 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:41.072325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:41.909901 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:41.909864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:42.758911 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:42.758875    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:44.072291 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:44.072259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:45.069776 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:45.069735    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:46.026245 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:46.026210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:46.226491 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:46.226465    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:02:46.844170 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:46.844125    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:47.772264 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:47.772231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:47.880220 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:47.880186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:48.666866 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:48.666825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:49.724186 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:49.724150    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:51.323809 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:51.323772    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:52.377292 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:52.377250    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:53.501033 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:53.501000    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:54.134683 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:54.134614    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:54.697118 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:54.697082    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:55.812028 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:55.811981    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"]
Sep 17 22:02:55.812551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:55.812231    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh" podUID="00397f4d-a2c4-427d-b229-cc29d990a9fb" containerName="maas-api" containerID="cri-o://ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8" gracePeriod=30
Sep 17 22:02:55.925685 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:55.920573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:56.094542 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.094519    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 22:02:56.159869 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.159831    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:56.260183 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.260139    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls\") pod \"00397f4d-a2c4-427d-b229-cc29d990a9fb\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") "
Sep 17 22:02:56.260393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.260250    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xll5t\" (UniqueName: \"kubernetes.io/projected/00397f4d-a2c4-427d-b229-cc29d990a9fb-kube-api-access-xll5t\") pod \"00397f4d-a2c4-427d-b229-cc29d990a9fb\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") "
Sep 17 22:02:56.260393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.260311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00397f4d-a2c4-427d-b229-cc29d990a9fb-openshift-service-ca\") pod \"00397f4d-a2c4-427d-b229-cc29d990a9fb\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") "
Sep 17 22:02:56.260393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.260375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-metrics-certs\") pod \"00397f4d-a2c4-427d-b229-cc29d990a9fb\" (UID: \"00397f4d-a2c4-427d-b229-cc29d990a9fb\") "
Sep 17 22:02:56.260735 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.260708    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00397f4d-a2c4-427d-b229-cc29d990a9fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00397f4d-a2c4-427d-b229-cc29d990a9fb" (UID: "00397f4d-a2c4-427d-b229-cc29d990a9fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:02:56.262587 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.262564    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00397f4d-a2c4-427d-b229-cc29d990a9fb" (UID: "00397f4d-a2c4-427d-b229-cc29d990a9fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:02:56.262692 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.262622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00397f4d-a2c4-427d-b229-cc29d990a9fb-kube-api-access-xll5t" (OuterVolumeSpecName: "kube-api-access-xll5t") pod "00397f4d-a2c4-427d-b229-cc29d990a9fb" (UID: "00397f4d-a2c4-427d-b229-cc29d990a9fb"). InnerVolumeSpecName "kube-api-access-xll5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:02:56.262692 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.262641    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "00397f4d-a2c4-427d-b229-cc29d990a9fb" (UID: "00397f4d-a2c4-427d-b229-cc29d990a9fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:02:56.308195 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.308160    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:56.318184 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.316136    2580 generic.go:356] "Generic (PLEG): container finished" podID="00397f4d-a2c4-427d-b229-cc29d990a9fb" containerID="ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8" exitCode=0
Sep 17 22:02:56.318184 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.316279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh" event={"ID":"00397f4d-a2c4-427d-b229-cc29d990a9fb","Type":"ContainerDied","Data":"ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8"}
Sep 17 22:02:56.318184 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.316335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh" event={"ID":"00397f4d-a2c4-427d-b229-cc29d990a9fb","Type":"ContainerDied","Data":"780682b08f7356d53d53c71fb696c90358335a5cf7cd91b23e08d2015e58bed6"}
Sep 17 22:02:56.318184 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.316366    2580 scope.go:117] "RemoveContainer" containerID="ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8"
Sep 17 22:02:56.318184 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.316529    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"
Sep 17 22:02:56.339843 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.339820    2580 scope.go:117] "RemoveContainer" containerID="ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8"
Sep 17 22:02:56.340567 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:02:56.340542    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8\": container with ID starting with ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8 not found: ID does not exist" containerID="ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8"
Sep 17 22:02:56.340680 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.340575    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8"} err="failed to get container status \"ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8\": rpc error: code = NotFound desc = could not find container \"ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8\": container with ID starting with ef9dd982b1426df266d49e5e655ba54e987bdca550d37f8be06eb922e0d03cb8 not found: ID does not exist"
Sep 17 22:02:56.359742 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.359710    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"]
Sep 17 22:02:56.361394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.361374    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xll5t\" (UniqueName: \"kubernetes.io/projected/00397f4d-a2c4-427d-b229-cc29d990a9fb-kube-api-access-xll5t\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:02:56.361442 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.361400    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00397f4d-a2c4-427d-b229-cc29d990a9fb-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:02:56.361442 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.361411    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:02:56.361442 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.361420    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00397f4d-a2c4-427d-b229-cc29d990a9fb-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:02:56.369722 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.369698    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6a6c05-85f8b4959b-9hgbh"]
Sep 17 22:02:56.421772 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.421740    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:56.716684 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:56.716565    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:57.034044 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:57.034009    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00397f4d-a2c4-427d-b229-cc29d990a9fb" path="/var/lib/kubelet/pods/00397f4d-a2c4-427d-b229-cc29d990a9fb/volumes"
Sep 17 22:02:57.149420 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:57.149384    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"]
Sep 17 22:02:57.149639 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:57.149593    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk" podUID="59bf4206-3c5e-41db-856d-97147d3df9da" containerName="istio-proxy" containerID="cri-o://b7fc067c1250a3024ad2ecba7141f2abed0c453d14cf64946212532108c8ee63" gracePeriod=30
Sep 17 22:02:57.169814 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:57.169777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:57.395777 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:57.395686    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:57.498119 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:57.498087    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:57.622953 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:57.622914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:58.436563 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:58.436531    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:02:59.450004 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:02:59.449967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:00.446983 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:00.446942    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:00.740271 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:00.740188    2580 patch_prober.go:28] interesting pod/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 22:03:00.740271 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:00.740246    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk" podUID="59bf4206-3c5e-41db-856d-97147d3df9da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 22:03:01.394408 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:01.394378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:01.774787 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:01.774752    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:02.258835 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.258777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:02.371702 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.371645    2580 generic.go:356] "Generic (PLEG): container finished" podID="59bf4206-3c5e-41db-856d-97147d3df9da" containerID="b7fc067c1250a3024ad2ecba7141f2abed0c453d14cf64946212532108c8ee63" exitCode=0
Sep 17 22:03:02.371702 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.371695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk" event={"ID":"59bf4206-3c5e-41db-856d-97147d3df9da","Type":"ContainerDied","Data":"b7fc067c1250a3024ad2ecba7141f2abed0c453d14cf64946212532108c8ee63"}
Sep 17 22:03:02.405873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.405844    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:03:02.421134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421061    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-data\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421111    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-certs\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421146    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-socket\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bf4206-3c5e-41db-856d-97147d3df9da-istio-podinfo\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-credential-socket\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-istio-token\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421322    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bf4206-3c5e-41db-856d-97147d3df9da-istiod-ca-cert\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-data" (OuterVolumeSpecName: "istio-data") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:03:02.421376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421371    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-envoy\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djfpj\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-kube-api-access-djfpj\") pod \"59bf4206-3c5e-41db-856d-97147d3df9da\" (UID: \"59bf4206-3c5e-41db-856d-97147d3df9da\") "
Sep 17 22:03:02.421778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421451    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:03:02.421778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:03:02.421778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:03:02.421984 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421913    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.421984 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421935    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.421984 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421949    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.421984 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.421962    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.422357 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.422148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59bf4206-3c5e-41db-856d-97147d3df9da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:03:02.423985 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.423956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59bf4206-3c5e-41db-856d-97147d3df9da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:03:02.424268 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.424240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-kube-api-access-djfpj" (OuterVolumeSpecName: "kube-api-access-djfpj") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "kube-api-access-djfpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:03:02.424386 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.424278    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-istio-token" (OuterVolumeSpecName: "istio-token") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:03:02.424575 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.424558    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59bf4206-3c5e-41db-856d-97147d3df9da" (UID: "59bf4206-3c5e-41db-856d-97147d3df9da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:03:02.523214 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.523177    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59bf4206-3c5e-41db-856d-97147d3df9da-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.523214 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.523212    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.523214 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.523220    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59bf4206-3c5e-41db-856d-97147d3df9da-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.523443 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.523228    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59bf4206-3c5e-41db-856d-97147d3df9da-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.523443 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.523237    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djfpj\" (UniqueName: \"kubernetes.io/projected/59bf4206-3c5e-41db-856d-97147d3df9da-kube-api-access-djfpj\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:02.633716 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:02.633677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:03.171367 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.171341    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 22:03:03.171714 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.171404    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 22:03:03.378758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.378673    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"
Sep 17 22:03:03.378758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.378704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk" event={"ID":"59bf4206-3c5e-41db-856d-97147d3df9da","Type":"ContainerDied","Data":"476bc2eaa94647d7f30b24b4e0f230a413be9d9a5f16d0b442bf3742017f152e"}
Sep 17 22:03:03.378982 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.378769    2580 scope.go:117] "RemoveContainer" containerID="b7fc067c1250a3024ad2ecba7141f2abed0c453d14cf64946212532108c8ee63"
Sep 17 22:03:03.380623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.380594    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerID="f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b" exitCode=0
Sep 17 22:03:03.380776 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.380630    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" event={"ID":"51e69067-67f5-4b03-a10b-dd17c2d1b7d2","Type":"ContainerDied","Data":"f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b"}
Sep 17 22:03:03.381101 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.381080    2580 scope.go:117] "RemoveContainer" containerID="f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b"
Sep 17 22:03:03.382425 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.382392    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:03.382513 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.382493    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:03.382564 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.382547    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:03.439701 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.439671    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"]
Sep 17 22:03:03.448554 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.448528    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-2d1bcf-openshift-default-797687f5b8-sb4xk"]
Sep 17 22:03:03.736909 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:03.736805    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:04.389708 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:04.389645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" event={"ID":"51e69067-67f5-4b03-a10b-dd17c2d1b7d2","Type":"ContainerStarted","Data":"8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81"}
Sep 17 22:03:05.029953 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:05.029914    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59bf4206-3c5e-41db-856d-97147d3df9da" path="/var/lib/kubelet/pods/59bf4206-3c5e-41db-856d-97147d3df9da/volumes"
Sep 17 22:03:05.032904 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:05.032874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:03:05.033120 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:05.033100    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 22:03:05.033173 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:05.033145    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 22:03:06.032773 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:06.032736    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 22:03:06.033182 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:06.032791    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 22:03:07.032474 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.032435    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 22:03:07.032633 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.032503    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 22:03:07.665792 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.665754    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:07.950213 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.950134    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"]
Sep 17 22:03:07.950604 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.950586    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59bf4206-3c5e-41db-856d-97147d3df9da" containerName="istio-proxy"
Sep 17 22:03:07.950771 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.950644    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="59bf4206-3c5e-41db-856d-97147d3df9da" containerName="istio-proxy"
Sep 17 22:03:07.950771 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.950686    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00397f4d-a2c4-427d-b229-cc29d990a9fb" containerName="maas-api"
Sep 17 22:03:07.950771 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.950695    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="00397f4d-a2c4-427d-b229-cc29d990a9fb" containerName="maas-api"
Sep 17 22:03:07.950939 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.950848    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="00397f4d-a2c4-427d-b229-cc29d990a9fb" containerName="maas-api"
Sep 17 22:03:07.950939 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.950864    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="59bf4206-3c5e-41db-856d-97147d3df9da" containerName="istio-proxy"
Sep 17 22:03:07.953485 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.953465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.956734 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.956716    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d8ea1ea7-openshift-default-dockercfg-fs5lx\""
Sep 17 22:03:07.968746 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.968721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"]
Sep 17 22:03:07.974704 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.974679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-podinfo\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.974848 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.974731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-certs\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.974848 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.974774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2pz\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-kube-api-access-gr2pz\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.974848 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.974823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-envoy\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.975020 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.974868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-socket\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.975020 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.974895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-data\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.975020 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.974943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-credential-socket\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.975154 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.975028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-token\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.975154 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.975075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9351397b-9508-41cd-945e-68cbcca4fdd9-istiod-ca-cert\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:07.995482 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:07.995447    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:08.032900 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.032868    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 22:03:08.033068 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.032928    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 22:03:08.071290 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.071254    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:08.076298 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-credential-socket\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076453 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-token\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076453 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9351397b-9508-41cd-945e-68cbcca4fdd9-istiod-ca-cert\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076453 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-podinfo\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-certs\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2pz\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-kube-api-access-gr2pz\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-envoy\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-socket\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-data\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076917 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-credential-socket\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.076980 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-certs\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.077034 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.076994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-data\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.077087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.077041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-socket\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.077274 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.077166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9351397b-9508-41cd-945e-68cbcca4fdd9-istiod-ca-cert\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.079112 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.079090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-envoy\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.079202 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.079192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-podinfo\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.086648 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.086619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-token\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.087151 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.087130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2pz\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-kube-api-access-gr2pz\") pod \"e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") " pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.266009 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.265798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:08.276495 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.276438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:08.367643 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.367602    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:08.586000 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.585971    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"]
Sep 17 22:03:08.586730 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:03:08.586698    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9351397b_9508_41cd_945e_68cbcca4fdd9.slice/crio-0f56dacf4ab044bb1b68581bb535e83bd0993852543d6985a5953f4f8e0c4733 WatchSource:0}: Error finding container 0f56dacf4ab044bb1b68581bb535e83bd0993852543d6985a5953f4f8e0c4733: Status 404 returned error can't find the container with id 0f56dacf4ab044bb1b68581bb535e83bd0993852543d6985a5953f4f8e0c4733
Sep 17 22:03:08.589380 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.589337    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:08.589459 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.589427    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:08.589499 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.589471    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:08.763121 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:08.763078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:09.032678 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:09.032621    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 17 22:03:09.032889 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:09.032698    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 17 22:03:09.456239 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:09.456130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" event={"ID":"9351397b-9508-41cd-945e-68cbcca4fdd9","Type":"ContainerStarted","Data":"e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50"}
Sep 17 22:03:09.456239 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:09.456231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" event={"ID":"9351397b-9508-41cd-945e-68cbcca4fdd9","Type":"ContainerStarted","Data":"0f56dacf4ab044bb1b68581bb535e83bd0993852543d6985a5953f4f8e0c4733"}
Sep 17 22:03:09.529693 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:09.529607    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podStartSLOduration=2.5295851430000003 podStartE2EDuration="2.529585143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:03:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:03:09.528944562 +0000 UTC m=+1323.050509505" watchObservedRunningTime="2026-09-17 22:03:09.529585143 +0000 UTC m=+1323.051150074"
Sep 17 22:03:10.036874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.036842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:03:10.037279 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.037232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:03:10.037844 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.037827    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:03:10.108823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.108785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:10.266537 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.266500    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:10.271909 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.271883    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:10.462879 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.462790    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:10.463709 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:10.463684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:11.180335 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:11.180302    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:11.523460 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:11.523433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:11.620498 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:11.620462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:12.406333 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:12.406300    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:12.765802 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:12.765715    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:03:13.994751 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:13.994710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:15.073488 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:15.073451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:16.163947 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:16.163901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:17.156266 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:17.156222    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:17.299493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:17.299461    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:17.614302 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:17.614265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:18.196847 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:18.196810    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:18.320271 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:18.320243    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:18.722784 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:18.722745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:19.667389 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:19.667357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:20.686802 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:20.686760    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:21.511522 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.511486    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"]
Sep 17 22:03:21.511725 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.511706    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm" podUID="bf3e0217-8b4f-4a65-ad8c-f73faddfb586" containerName="maas-api" containerID="cri-o://4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed" gracePeriod=30
Sep 17 22:03:21.555244 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.555205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:21.659257 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.659215    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:21.742769 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.742737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:21.773856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.773829    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 22:03:21.850850 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.844909    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:21.928826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.925851    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-metrics-certs\") pod \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") "
Sep 17 22:03:21.928826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.925968    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls\") pod \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") "
Sep 17 22:03:21.928826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.925998    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-openshift-service-ca\") pod \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") "
Sep 17 22:03:21.928826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.926132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6dsc\" (UniqueName: \"kubernetes.io/projected/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-kube-api-access-f6dsc\") pod \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\" (UID: \"bf3e0217-8b4f-4a65-ad8c-f73faddfb586\") "
Sep 17 22:03:21.929187 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.929164    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bf3e0217-8b4f-4a65-ad8c-f73faddfb586" (UID: "bf3e0217-8b4f-4a65-ad8c-f73faddfb586"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:03:21.930116 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.930087    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bf3e0217-8b4f-4a65-ad8c-f73faddfb586" (UID: "bf3e0217-8b4f-4a65-ad8c-f73faddfb586"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:03:21.930322 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.930295    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bf3e0217-8b4f-4a65-ad8c-f73faddfb586" (UID: "bf3e0217-8b4f-4a65-ad8c-f73faddfb586"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:03:21.931339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.931318    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-kube-api-access-f6dsc" (OuterVolumeSpecName: "kube-api-access-f6dsc") pod "bf3e0217-8b4f-4a65-ad8c-f73faddfb586" (UID: "bf3e0217-8b4f-4a65-ad8c-f73faddfb586"). InnerVolumeSpecName "kube-api-access-f6dsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:03:21.943937 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:21.943909    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:22.029046 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.028957    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:22.029046 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.028988    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:22.029046 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.028998    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6dsc\" (UniqueName: \"kubernetes.io/projected/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-kube-api-access-f6dsc\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:22.029046 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.029007    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3e0217-8b4f-4a65-ad8c-f73faddfb586-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:03:22.337913 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.337819    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:22.535566 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.535530    2580 generic.go:356] "Generic (PLEG): container finished" podID="bf3e0217-8b4f-4a65-ad8c-f73faddfb586" containerID="4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed" exitCode=0
Sep 17 22:03:22.535758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.535594    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"
Sep 17 22:03:22.535758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.535616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm" event={"ID":"bf3e0217-8b4f-4a65-ad8c-f73faddfb586","Type":"ContainerDied","Data":"4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed"}
Sep 17 22:03:22.535758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.535688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm" event={"ID":"bf3e0217-8b4f-4a65-ad8c-f73faddfb586","Type":"ContainerDied","Data":"158192c69be4889c122f32f7027694dd56b20c507fa568d41318f2ba90525617"}
Sep 17 22:03:22.535758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.535713    2580 scope.go:117] "RemoveContainer" containerID="4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed"
Sep 17 22:03:22.546090 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.546068    2580 scope.go:117] "RemoveContainer" containerID="4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed"
Sep 17 22:03:22.546365 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:03:22.546343    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed\": container with ID starting with 4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed not found: ID does not exist" containerID="4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed"
Sep 17 22:03:22.546447 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.546372    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed"} err="failed to get container status \"4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed\": rpc error: code = NotFound desc = could not find container \"4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed\": container with ID starting with 4ffb8946ab138a72c851b3e4ab9285bf64c41fe5e19a7c0699eb25a13e8f86ed not found: ID does not exist"
Sep 17 22:03:22.628493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.628410    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"]
Sep 17 22:03:22.630969 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:22.630949    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3d5c73-5d845cf665-hbmdm"]
Sep 17 22:03:23.000202 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:23.000104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:23.024744 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:23.024714    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf3e0217-8b4f-4a65-ad8c-f73faddfb586" path="/var/lib/kubelet/pods/bf3e0217-8b4f-4a65-ad8c-f73faddfb586/volumes"
Sep 17 22:03:23.907033 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:23.906991    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:25.137382 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:25.137347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:26.315147 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:26.315114    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:27.209397 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:27.209365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:27.418318 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:27.418286    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:28.269306 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:28.269266    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:29.796216 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:29.796182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:30.759638 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:30.759603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:31.426017 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:31.425968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:31.673983 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:31.673946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:32.878560 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:32.878464    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:34.040108 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:34.040070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:35.273606 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:35.273575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:35.765019 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:35.764982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:36.627641 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:36.627608    2580 generic.go:356] "Generic (PLEG): container finished" podID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerID="e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50" exitCode=0
Sep 17 22:03:36.628039 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:36.627683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" event={"ID":"9351397b-9508-41cd-945e-68cbcca4fdd9","Type":"ContainerDied","Data":"e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50"}
Sep 17 22:03:36.628125 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:36.628112    2580 scope.go:117] "RemoveContainer" containerID="e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50"
Sep 17 22:03:36.629297 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:36.629265    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:36.629424 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:36.629351    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:36.629424 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:36.629400    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:03:36.741068 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:36.741035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:37.638174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:37.638142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" event={"ID":"9351397b-9508-41cd-945e-68cbcca4fdd9","Type":"ContainerStarted","Data":"9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8"}
Sep 17 22:03:37.870554 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:37.870518    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:38.266522 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:38.266482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:38.267831 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:38.267802    2580 patch_prober.go:28] interesting pod/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 17 22:03:38.267963 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:38.267852    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 17 22:03:39.267171 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:39.267125    2580 patch_prober.go:28] interesting pod/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 17 22:03:39.267561 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:39.267211    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 17 22:03:39.996762 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:39.996725    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:40.266823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:40.266724    2580 patch_prober.go:28] interesting pod/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 17 22:03:40.266823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:40.266791    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 17 22:03:40.462790 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:40.462757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:41.266859 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:41.266823    2580 patch_prober.go:28] interesting pod/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 17 22:03:41.267063 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:41.266880    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 17 22:03:42.267069 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:42.267027    2580 patch_prober.go:28] interesting pod/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 17 22:03:42.267477 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:42.267087    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 17 22:03:43.270623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:43.270595    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:43.271729 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:43.271710    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:03:43.591575 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:43.591476    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:03:46.086702 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:46.086650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:03:57.298315 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:03:57.298283    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:00.031831 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:00.031796    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"]
Sep 17 22:04:00.053580 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:00.053544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:04.475369 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:04.475328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:04.799859 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:04.799817    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"]
Sep 17 22:04:04.800117 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:04.800092    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy" containerID="cri-o://8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902" gracePeriod=30
Sep 17 22:04:04.825544 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:04.825511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:05.316454 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:05.316420    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:05.650056 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:05.649973    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:06.649780 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:06.649744    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:08.193482 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:08.193448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:08.861776 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:08.861680    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:08.985592 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:08.985558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:09.268514 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:09.268486    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:10.065623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.065537    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 22:04:10.144881 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.144844    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-certs\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145073 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-credential-socket\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145150 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-envoy\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145150 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145135    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-data\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145141    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:10.145261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145159    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-socket\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145229    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbnp6\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-kube-api-access-cbnp6\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-token\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-podinfo\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45cc95e-2333-4f36-8ce7-3ef938109542-istiod-ca-cert\") pod \"f45cc95e-2333-4f36-8ce7-3ef938109542\" (UID: \"f45cc95e-2333-4f36-8ce7-3ef938109542\") "
Sep 17 22:04:10.145422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145403    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:10.145640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145421    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:10.145640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145437    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-data" (OuterVolumeSpecName: "istio-data") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:10.145837 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145813    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.145908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145840    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.145908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145847    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45cc95e-2333-4f36-8ce7-3ef938109542-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:04:10.145908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145853    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.145908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.145896    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.147702 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.147677    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:04:10.147820 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.147761    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:10.147820 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.147787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-token" (OuterVolumeSpecName: "istio-token") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:04:10.147820 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.147800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-kube-api-access-cbnp6" (OuterVolumeSpecName: "kube-api-access-cbnp6") pod "f45cc95e-2333-4f36-8ce7-3ef938109542" (UID: "f45cc95e-2333-4f36-8ce7-3ef938109542"). InnerVolumeSpecName "kube-api-access-cbnp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:04:10.152204 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.152172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:10.247447 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.247411    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbnp6\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-kube-api-access-cbnp6\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.247447 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.247441    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.247447 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.247452    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.247718 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.247460    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f45cc95e-2333-4f36-8ce7-3ef938109542-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.247718 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.247468    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f45cc95e-2333-4f36-8ce7-3ef938109542-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:10.838186 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.838152    2580 generic.go:356] "Generic (PLEG): container finished" podID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerID="8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902" exitCode=0
Sep 17 22:04:10.838621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.838200    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"
Sep 17 22:04:10.838621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.838245    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" event={"ID":"f45cc95e-2333-4f36-8ce7-3ef938109542","Type":"ContainerDied","Data":"8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902"}
Sep 17 22:04:10.838621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.838322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w" event={"ID":"f45cc95e-2333-4f36-8ce7-3ef938109542","Type":"ContainerDied","Data":"5525a9294962d848c002aa91a1174134a78ceaabae3dc7cb794850087d199f0f"}
Sep 17 22:04:10.838621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.838346    2580 scope.go:117] "RemoveContainer" containerID="8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902"
Sep 17 22:04:10.848626 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.848608    2580 scope.go:117] "RemoveContainer" containerID="bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047"
Sep 17 22:04:10.857319 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.857303    2580 scope.go:117] "RemoveContainer" containerID="8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902"
Sep 17 22:04:10.857584 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:04:10.857564    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902\": container with ID starting with 8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902 not found: ID does not exist" containerID="8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902"
Sep 17 22:04:10.857682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.857596    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902"} err="failed to get container status \"8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902\": rpc error: code = NotFound desc = could not find container \"8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902\": container with ID starting with 8def34351f97fa0866fc05adb4f1e2790a4eb46cadde41916e5145df720b9902 not found: ID does not exist"
Sep 17 22:04:10.857682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.857621    2580 scope.go:117] "RemoveContainer" containerID="bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047"
Sep 17 22:04:10.857894 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:04:10.857874    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047\": container with ID starting with bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047 not found: ID does not exist" containerID="bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047"
Sep 17 22:04:10.857937 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.857899    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047"} err="failed to get container status \"bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047\": rpc error: code = NotFound desc = could not find container \"bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047\": container with ID starting with bc0a364c21143a7cdb2e5ece495de4c8dd59d1865c0b35656efbdc7403181047 not found: ID does not exist"
Sep 17 22:04:10.863843 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.863823    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"]
Sep 17 22:04:10.866409 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.866389    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3d5c73-openshift-default-869765f49d-kl77w"]
Sep 17 22:04:10.965175 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:10.965141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:11.032271 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:11.032240    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" path="/var/lib/kubelet/pods/f45cc95e-2333-4f36-8ce7-3ef938109542/volumes"
Sep 17 22:04:11.914234 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:11.914199    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:12.856461 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:12.856428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:13.840898 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.840855    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"]
Sep 17 22:04:13.841398 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841379    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy"
Sep 17 22:04:13.841465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy"
Sep 17 22:04:13.841465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841410    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy"
Sep 17 22:04:13.841465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841428    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy"
Sep 17 22:04:13.841465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841441    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3e0217-8b4f-4a65-ad8c-f73faddfb586" containerName="maas-api"
Sep 17 22:04:13.841465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841447    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3e0217-8b4f-4a65-ad8c-f73faddfb586" containerName="maas-api"
Sep 17 22:04:13.841770 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841510    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3e0217-8b4f-4a65-ad8c-f73faddfb586" containerName="maas-api"
Sep 17 22:04:13.841770 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841519    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy"
Sep 17 22:04:13.841770 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.841526    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f45cc95e-2333-4f36-8ce7-3ef938109542" containerName="istio-proxy"
Sep 17 22:04:13.844467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.844449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.847188 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.847168    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-8f8dad-serving-cert\""
Sep 17 22:04:13.868803 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.868765    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"]
Sep 17 22:04:13.882292 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.882261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.882292 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.882296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6eca34-beab-47c2-ad26-907c35bf5df4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.882514 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.882382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.882514 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.882423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j6xk\" (UniqueName: \"kubernetes.io/projected/ab6eca34-beab-47c2-ad26-907c35bf5df4-kube-api-access-7j6xk\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.902864 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.902831    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:13.983596 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.983559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.983596 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.983599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6eca34-beab-47c2-ad26-907c35bf5df4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.983888 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.983649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.983888 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.983698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j6xk\" (UniqueName: \"kubernetes.io/projected/ab6eca34-beab-47c2-ad26-907c35bf5df4-kube-api-access-7j6xk\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.983888 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:04:13.983757    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-serving-cert: secret "maas-api-e2e-shared-a-w3-8f8dad-serving-cert" not found
Sep 17 22:04:13.983888 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:04:13.983850    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls podName:ab6eca34-beab-47c2-ad26-907c35bf5df4 nodeName:}" failed. No retries permitted until 2026-09-17 22:04:14.483828243 +0000 UTC m=+1388.005393174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls") pod "maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h" (UID: "ab6eca34-beab-47c2-ad26-907c35bf5df4") : secret "maas-api-e2e-shared-a-w3-8f8dad-serving-cert" not found
Sep 17 22:04:13.984324 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.984304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6eca34-beab-47c2-ad26-907c35bf5df4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:13.986316 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:13.986294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:14.001025 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.001002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j6xk\" (UniqueName: \"kubernetes.io/projected/ab6eca34-beab-47c2-ad26-907c35bf5df4-kube-api-access-7j6xk\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:14.021174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.021139    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:14.359500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.359464    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:14.489066 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.489030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:14.491647 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.491614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:14.515168 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.515133    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:14.609119 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.609084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:14.756406 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:14.756311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:15.052317 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.052263    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx" podUID="03bc0d3b-f471-47fc-a1e4-9146068f4527" containerName="main" containerID="cri-o://f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6" gracePeriod=45
Sep 17 22:04:15.071880 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.071857    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"]
Sep 17 22:04:15.095590 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:04:15.095562    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6eca34_beab_47c2_ad26_907c35bf5df4.slice/crio-242adf4cd8e78841ee6a90fc84640d00ce7d47d00ed2ccb56cadb0df7d624eac WatchSource:0}: Error finding container 242adf4cd8e78841ee6a90fc84640d00ce7d47d00ed2ccb56cadb0df7d624eac: Status 404 returned error can't find the container with id 242adf4cd8e78841ee6a90fc84640d00ce7d47d00ed2ccb56cadb0df7d624eac
Sep 17 22:04:15.157036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.157013    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 22:04:15.302544 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.302487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:04:15.400700 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.400651    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-tmp-dir\") pod \"03bc0d3b-f471-47fc-a1e4-9146068f4527\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") "
Sep 17 22:04:15.400893 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.400742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfl4m\" (UniqueName: \"kubernetes.io/projected/03bc0d3b-f471-47fc-a1e4-9146068f4527-kube-api-access-vfl4m\") pod \"03bc0d3b-f471-47fc-a1e4-9146068f4527\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") "
Sep 17 22:04:15.400893 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.400758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-dshm\") pod \"03bc0d3b-f471-47fc-a1e4-9146068f4527\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") "
Sep 17 22:04:15.400893 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.400778    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-home\") pod \"03bc0d3b-f471-47fc-a1e4-9146068f4527\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") "
Sep 17 22:04:15.401061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.400940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-model-cache\") pod \"03bc0d3b-f471-47fc-a1e4-9146068f4527\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") "
Sep 17 22:04:15.401061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.400986    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03bc0d3b-f471-47fc-a1e4-9146068f4527-tls-certs\") pod \"03bc0d3b-f471-47fc-a1e4-9146068f4527\" (UID: \"03bc0d3b-f471-47fc-a1e4-9146068f4527\") "
Sep 17 22:04:15.401061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.400988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03bc0d3b-f471-47fc-a1e4-9146068f4527" (UID: "03bc0d3b-f471-47fc-a1e4-9146068f4527"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:15.401061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.401043    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-home" (OuterVolumeSpecName: "home") pod "03bc0d3b-f471-47fc-a1e4-9146068f4527" (UID: "03bc0d3b-f471-47fc-a1e4-9146068f4527"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:15.401205 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.401175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-model-cache" (OuterVolumeSpecName: "model-cache") pod "03bc0d3b-f471-47fc-a1e4-9146068f4527" (UID: "03bc0d3b-f471-47fc-a1e4-9146068f4527"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:15.401318 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.401302    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:15.401374 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.401325    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:15.401374 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.401342    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:15.403228 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.403205    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03bc0d3b-f471-47fc-a1e4-9146068f4527-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03bc0d3b-f471-47fc-a1e4-9146068f4527" (UID: "03bc0d3b-f471-47fc-a1e4-9146068f4527"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:04:15.403329 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.403263    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-dshm" (OuterVolumeSpecName: "dshm") pod "03bc0d3b-f471-47fc-a1e4-9146068f4527" (UID: "03bc0d3b-f471-47fc-a1e4-9146068f4527"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:04:15.403421 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.403323    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03bc0d3b-f471-47fc-a1e4-9146068f4527-kube-api-access-vfl4m" (OuterVolumeSpecName: "kube-api-access-vfl4m") pod "03bc0d3b-f471-47fc-a1e4-9146068f4527" (UID: "03bc0d3b-f471-47fc-a1e4-9146068f4527"). InnerVolumeSpecName "kube-api-access-vfl4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:04:15.502036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.502007    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03bc0d3b-f471-47fc-a1e4-9146068f4527-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:15.502036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.502039    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfl4m\" (UniqueName: \"kubernetes.io/projected/03bc0d3b-f471-47fc-a1e4-9146068f4527-kube-api-access-vfl4m\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:15.502246 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.502053    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03bc0d3b-f471-47fc-a1e4-9146068f4527-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:04:15.872805 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.872713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h" event={"ID":"ab6eca34-beab-47c2-ad26-907c35bf5df4","Type":"ContainerStarted","Data":"f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590"}
Sep 17 22:04:15.872805 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.872783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:15.872985 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.872805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h" event={"ID":"ab6eca34-beab-47c2-ad26-907c35bf5df4","Type":"ContainerStarted","Data":"242adf4cd8e78841ee6a90fc84640d00ce7d47d00ed2ccb56cadb0df7d624eac"}
Sep 17 22:04:15.874214 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.874189    2580 generic.go:356] "Generic (PLEG): container finished" podID="03bc0d3b-f471-47fc-a1e4-9146068f4527" containerID="f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6" exitCode=0
Sep 17 22:04:15.874352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.874226    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"
Sep 17 22:04:15.874352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.874269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx" event={"ID":"03bc0d3b-f471-47fc-a1e4-9146068f4527","Type":"ContainerDied","Data":"f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6"}
Sep 17 22:04:15.874352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.874308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx" event={"ID":"03bc0d3b-f471-47fc-a1e4-9146068f4527","Type":"ContainerDied","Data":"bc3e5553f94ea6bd56caa6c0f5626b9ac4cc46c91cca52c3debcbcbf3a63be86"}
Sep 17 22:04:15.874352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.874327    2580 scope.go:117] "RemoveContainer" containerID="f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6"
Sep 17 22:04:15.884798 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.884777    2580 scope.go:117] "RemoveContainer" containerID="f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6"
Sep 17 22:04:15.885042 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:04:15.885024    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6\": container with ID starting with f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6 not found: ID does not exist" containerID="f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6"
Sep 17 22:04:15.885080 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.885052    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6"} err="failed to get container status \"f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6\": rpc error: code = NotFound desc = could not find container \"f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6\": container with ID starting with f9e880038ecb3baf21ffe2974f4b077078911d6bfabd3b2081de95df54328ee6 not found: ID does not exist"
Sep 17 22:04:15.898728 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.898675    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h" podStartSLOduration=2.4925415539999998 podStartE2EDuration="2.898643765s" totalImagesPullingTime="406.102211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:04:15.897474328 +0000 UTC m=+1389.419039278" watchObservedRunningTime="2026-09-17 22:04:15.898643765 +0000 UTC m=+1389.420208697"
Sep 17 22:04:15.928252 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.928214    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"]
Sep 17 22:04:15.937553 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:15.937524    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-b-ce545ee1-kserve-69754c4844-9t4kx"]
Sep 17 22:04:17.025765 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:17.025732    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03bc0d3b-f471-47fc-a1e4-9146068f4527" path="/var/lib/kubelet/pods/03bc0d3b-f471-47fc-a1e4-9146068f4527/volumes"
Sep 17 22:04:21.886526 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:21.886495    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:04:26.168347 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:26.168311    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:04:36.943096 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:36.943058    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:38.042675 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:38.042632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:38.839651 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:38.839613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:38.941813 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:38.941778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:39.289859 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.289823    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:39.559778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.559691    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"]
Sep 17 22:04:39.560184 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.560166    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03bc0d3b-f471-47fc-a1e4-9146068f4527" containerName="main"
Sep 17 22:04:39.560247 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.560187    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03bc0d3b-f471-47fc-a1e4-9146068f4527" containerName="main"
Sep 17 22:04:39.560296 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.560286    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="03bc0d3b-f471-47fc-a1e4-9146068f4527" containerName="main"
Sep 17 22:04:39.562559 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.562541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.569946 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.569513    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-35b181-openshift-default-dockercfg-htzqd\""
Sep 17 22:04:39.583143 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.583115    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"]
Sep 17 22:04:39.587771 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.587745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:39.641510 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6307d789-207e-44a5-bb75-699581d9629b-istio-podinfo\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.641712 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-credential-socket\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.641712 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-certs\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.641712 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-data\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.641904 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-envoy\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.641904 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-socket\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.641904 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-istio-token\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.642073 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzbl\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-kube-api-access-6qzbl\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.642073 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.641942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6307d789-207e-44a5-bb75-699581d9629b-istiod-ca-cert\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.742705 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.742637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-envoy\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.742900 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.742721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-socket\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.742900 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.742765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-istio-token\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743026 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.742895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzbl\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-kube-api-access-6qzbl\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743026 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.742954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6307d789-207e-44a5-bb75-699581d9629b-istiod-ca-cert\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743146 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6307d789-207e-44a5-bb75-699581d9629b-istio-podinfo\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743146 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-credential-socket\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743146 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-certs\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743146 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-socket\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743357 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-data\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743417 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-certs\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743470 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-credential-socket\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743545 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-data\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.743945 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.743924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6307d789-207e-44a5-bb75-699581d9629b-istiod-ca-cert\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.745199 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.745179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-envoy\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.745480 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.745461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6307d789-207e-44a5-bb75-699581d9629b-istio-podinfo\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.751290 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.751266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzbl\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-kube-api-access-6qzbl\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.751497 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.751479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-istio-token\") pod \"e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") " pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:39.820890 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.820799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:39.873319 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:39.873277    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:40.079058 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:40.078959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:40.157428 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:40.157399    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"]
Sep 17 22:04:40.158538 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:04:40.158509    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6307d789_207e_44a5_bb75_699581d9629b.slice/crio-6278e7462a046db842781d7faec5ff81141a97bde8a8db7850415ec889caf8c2 WatchSource:0}: Error finding container 6278e7462a046db842781d7faec5ff81141a97bde8a8db7850415ec889caf8c2: Status 404 returned error can't find the container with id 6278e7462a046db842781d7faec5ff81141a97bde8a8db7850415ec889caf8c2
Sep 17 22:04:40.161236 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:40.161190    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:04:40.161319 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:40.161296    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:04:40.161369 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:40.161343    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:04:40.562983 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:40.562948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:41.025090 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:41.025061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" event={"ID":"6307d789-207e-44a5-bb75-699581d9629b","Type":"ContainerStarted","Data":"8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b"}
Sep 17 22:04:41.025283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:41.025110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" event={"ID":"6307d789-207e-44a5-bb75-699581d9629b","Type":"ContainerStarted","Data":"6278e7462a046db842781d7faec5ff81141a97bde8a8db7850415ec889caf8c2"}
Sep 17 22:04:41.046571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:41.046523    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podStartSLOduration=2.04650208 podStartE2EDuration="2.04650208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:04:41.044090977 +0000 UTC m=+1414.565655921" watchObservedRunningTime="2026-09-17 22:04:41.04650208 +0000 UTC m=+1414.568067027"
Sep 17 22:04:41.353720 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:41.353608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:41.874276 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:41.874242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:41.879445 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:41.879414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:42.027798 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:42.027763    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:42.028769 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:42.028749    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:04:42.254081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:42.253967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:42.950014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:42.949972    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:43.038855 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:43.038820    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:43.342615 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:43.342575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:43.901107 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:43.901067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:44.451202 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:44.451164    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:45.319554 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:45.319500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:46.219750 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:46.219692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:47.102311 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:47.102281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:47.955904 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:47.955873    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:48.754724 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:48.754687    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:49.632754 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.632717    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"]
Sep 17 22:04:49.636075 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.636052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.639197 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.639176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-35b181-serving-cert\""
Sep 17 22:04:49.643861 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.643832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.643958 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.643878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.643958 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.643938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-459dd\" (UniqueName: \"kubernetes.io/projected/ebca044b-a02d-446e-8d83-c91dd4295c84-kube-api-access-459dd\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.644071 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.644012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebca044b-a02d-446e-8d83-c91dd4295c84-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.651094 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.651069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"]
Sep 17 22:04:49.672965 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.672934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:49.749477 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.749439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebca044b-a02d-446e-8d83-c91dd4295c84-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.750865 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.750837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.758871 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.755036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.758871 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.755092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-459dd\" (UniqueName: \"kubernetes.io/projected/ebca044b-a02d-446e-8d83-c91dd4295c84-kube-api-access-459dd\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.758871 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.750493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebca044b-a02d-446e-8d83-c91dd4295c84-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.758871 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:04:49.755581    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-serving-cert: secret "maas-api-e2e-shared-b-w3-35b181-serving-cert" not found
Sep 17 22:04:49.758871 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:04:49.755647    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls podName:ebca044b-a02d-446e-8d83-c91dd4295c84 nodeName:}" failed. No retries permitted until 2026-09-17 22:04:50.255625773 +0000 UTC m=+1423.777190700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls") pod "maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz" (UID: "ebca044b-a02d-446e-8d83-c91dd4295c84") : secret "maas-api-e2e-shared-b-w3-35b181-serving-cert" not found
Sep 17 22:04:49.759808 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.759780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:49.760380 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.760353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.767154 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.767134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-459dd\" (UniqueName: \"kubernetes.io/projected/ebca044b-a02d-446e-8d83-c91dd4295c84-kube-api-access-459dd\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:49.935616 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:49.935517    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:50.245420 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:50.245329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:50.260107 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:50.260078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:50.262675 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:50.262624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:50.321895 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:50.321857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:04:50.548580 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:50.548546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:50.824935 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:50.824904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"]
Sep 17 22:04:50.826378 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:04:50.826353    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebca044b_a02d_446e_8d83_c91dd4295c84.slice/crio-5c28ecc3680ace8ff28c2631bb94b7c0b4826669633abc4a920118d9d2356123 WatchSource:0}: Error finding container 5c28ecc3680ace8ff28c2631bb94b7c0b4826669633abc4a920118d9d2356123: Status 404 returned error can't find the container with id 5c28ecc3680ace8ff28c2631bb94b7c0b4826669633abc4a920118d9d2356123
Sep 17 22:04:51.084626 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:51.084542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz" event={"ID":"ebca044b-a02d-446e-8d83-c91dd4295c84","Type":"ContainerStarted","Data":"5c28ecc3680ace8ff28c2631bb94b7c0b4826669633abc4a920118d9d2356123"}
Sep 17 22:04:52.091886 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:52.091855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz" event={"ID":"ebca044b-a02d-446e-8d83-c91dd4295c84","Type":"ContainerStarted","Data":"97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5"}
Sep 17 22:04:52.092264 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:52.091911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:04:52.114042 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:52.113992    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz" podStartSLOduration=2.748000618 podStartE2EDuration="3.113978763s" totalImagesPullingTime="365.978145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:04:52.111139527 +0000 UTC m=+1425.632704475" watchObservedRunningTime="2026-09-17 22:04:52.113978763 +0000 UTC m=+1425.635543692"
Sep 17 22:04:58.060422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:58.060385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:04:58.102972 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:04:58.102941    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:05:04.749989 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:04.749949    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"]
Sep 17 22:05:04.780739 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:04.780708    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:09.197607 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.197571    2580 generic.go:356] "Generic (PLEG): container finished" podID="6307d789-207e-44a5-bb75-699581d9629b" containerID="8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b" exitCode=0
Sep 17 22:05:09.198039 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.197646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" event={"ID":"6307d789-207e-44a5-bb75-699581d9629b","Type":"ContainerDied","Data":"8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b"}
Sep 17 22:05:09.198097 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.198083    2580 scope.go:117] "RemoveContainer" containerID="8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b"
Sep 17 22:05:09.199476 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.199438    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:05:09.199582 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.199532    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:05:09.199626 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.199577    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:05:09.605218 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.605177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:09.680855 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:09.680822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:10.206318 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:10.206281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" event={"ID":"6307d789-207e-44a5-bb75-699581d9629b","Type":"ContainerStarted","Data":"9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b"}
Sep 17 22:05:10.873733 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:10.873700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:05:10.874997 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:10.874967    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 17 22:05:10.875142 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:10.875062    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 17 22:05:11.874147 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:11.874114    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 17 22:05:11.874547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:11.874171    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 17 22:05:12.028823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:12.028778    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:05:12.745395 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:12.745344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:12.874059 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:12.874023    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 17 22:05:12.874234 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:12.874114    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 17 22:05:13.028846 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:13.028808    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:13.659366 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:13.659335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:13.874372 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:13.874337    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 17 22:05:13.874820 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:13.874397    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 17 22:05:14.874497 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:14.874458    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 17 22:05:14.874935 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:14.874529    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 17 22:05:14.981568 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:14.981526    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:15.873763 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:15.873727    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 17 22:05:15.873989 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:15.873799    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 17 22:05:16.087967 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:16.087932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:16.878002 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:16.877962    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:05:16.878946 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:16.878924    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:05:17.109483 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:17.109453    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:18.270755 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:18.270710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:19.041617 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:19.041585    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:19.770126 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:19.770082    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg" podUID="955d6df7-0bac-4db9-98f1-0185d89a7429" containerName="main" containerID="cri-o://390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978" gracePeriod=45
Sep 17 22:05:19.896683 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:19.895715    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:20.026484 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.026413    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:05:20.190363 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190328    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvs4j\" (UniqueName: \"kubernetes.io/projected/955d6df7-0bac-4db9-98f1-0185d89a7429-kube-api-access-hvs4j\") pod \"955d6df7-0bac-4db9-98f1-0185d89a7429\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") "
Sep 17 22:05:20.190571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190386    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-home\") pod \"955d6df7-0bac-4db9-98f1-0185d89a7429\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") "
Sep 17 22:05:20.190571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190411    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-dshm\") pod \"955d6df7-0bac-4db9-98f1-0185d89a7429\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") "
Sep 17 22:05:20.190571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-tmp-dir\") pod \"955d6df7-0bac-4db9-98f1-0185d89a7429\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") "
Sep 17 22:05:20.190571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955d6df7-0bac-4db9-98f1-0185d89a7429-tls-certs\") pod \"955d6df7-0bac-4db9-98f1-0185d89a7429\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") "
Sep 17 22:05:20.190816 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190590    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-model-cache\") pod \"955d6df7-0bac-4db9-98f1-0185d89a7429\" (UID: \"955d6df7-0bac-4db9-98f1-0185d89a7429\") "
Sep 17 22:05:20.190816 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190767    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-home" (OuterVolumeSpecName: "home") pod "955d6df7-0bac-4db9-98f1-0185d89a7429" (UID: "955d6df7-0bac-4db9-98f1-0185d89a7429"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:05:20.190816 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "955d6df7-0bac-4db9-98f1-0185d89a7429" (UID: "955d6df7-0bac-4db9-98f1-0185d89a7429"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:05:20.190988 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.190892    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-model-cache" (OuterVolumeSpecName: "model-cache") pod "955d6df7-0bac-4db9-98f1-0185d89a7429" (UID: "955d6df7-0bac-4db9-98f1-0185d89a7429"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:05:20.191049 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.191038    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:05:20.191101 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.191052    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:05:20.191101 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.191062    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:05:20.192809 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.192786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-dshm" (OuterVolumeSpecName: "dshm") pod "955d6df7-0bac-4db9-98f1-0185d89a7429" (UID: "955d6df7-0bac-4db9-98f1-0185d89a7429"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:05:20.192907 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.192842    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955d6df7-0bac-4db9-98f1-0185d89a7429-kube-api-access-hvs4j" (OuterVolumeSpecName: "kube-api-access-hvs4j") pod "955d6df7-0bac-4db9-98f1-0185d89a7429" (UID: "955d6df7-0bac-4db9-98f1-0185d89a7429"). InnerVolumeSpecName "kube-api-access-hvs4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:05:20.192907 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.192884    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955d6df7-0bac-4db9-98f1-0185d89a7429-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "955d6df7-0bac-4db9-98f1-0185d89a7429" (UID: "955d6df7-0bac-4db9-98f1-0185d89a7429"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:05:20.277123 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.277032    2580 generic.go:356] "Generic (PLEG): container finished" podID="955d6df7-0bac-4db9-98f1-0185d89a7429" containerID="390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978" exitCode=0
Sep 17 22:05:20.277123 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.277078    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"
Sep 17 22:05:20.277329 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.277115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg" event={"ID":"955d6df7-0bac-4db9-98f1-0185d89a7429","Type":"ContainerDied","Data":"390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978"}
Sep 17 22:05:20.277329 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.277164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg" event={"ID":"955d6df7-0bac-4db9-98f1-0185d89a7429","Type":"ContainerDied","Data":"cb4c4e6cff4bbdc366c7e477b603121c815aca47b08f4cad0ad65d700354aef3"}
Sep 17 22:05:20.277329 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.277181    2580 scope.go:117] "RemoveContainer" containerID="390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978"
Sep 17 22:05:20.287239 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.287222    2580 scope.go:117] "RemoveContainer" containerID="390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978"
Sep 17 22:05:20.287517 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:05:20.287499    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978\": container with ID starting with 390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978 not found: ID does not exist" containerID="390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978"
Sep 17 22:05:20.287585 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.287526    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978"} err="failed to get container status \"390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978\": rpc error: code = NotFound desc = could not find container \"390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978\": container with ID starting with 390f6ff14a0e05bde5d86c49c496bdad0ada41bc035be3656d972603d1f46978 not found: ID does not exist"
Sep 17 22:05:20.292175 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.292155    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvs4j\" (UniqueName: \"kubernetes.io/projected/955d6df7-0bac-4db9-98f1-0185d89a7429-kube-api-access-hvs4j\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:05:20.292259 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.292177    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/955d6df7-0bac-4db9-98f1-0185d89a7429-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:05:20.292259 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.292185    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/955d6df7-0bac-4db9-98f1-0185d89a7429-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:05:20.301834 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.301812    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"]
Sep 17 22:05:20.307804 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:20.307780    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/e2e-conflict-a-ce545ee1-kserve-59884fc594-ndfxg"]
Sep 17 22:05:21.025887 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:21.025849    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="955d6df7-0bac-4db9-98f1-0185d89a7429" path="/var/lib/kubelet/pods/955d6df7-0bac-4db9-98f1-0185d89a7429/volumes"
Sep 17 22:05:23.560165 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:23.560127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:24.757755 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:24.757724    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:25.721393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:25.721348    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:26.671167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:26.671124    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:05:26.773395 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:26.773364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:27.752704 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:27.752642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:28.569364 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:28.569325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:29.450982 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:29.450928    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:30.243472 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:30.243439    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:31.241317 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:31.241283    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:38.940994 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:38.940957    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:39.024072 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:39.024030    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:39.091301 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:39.091267    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:39.188232 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:39.188193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:39.267190 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:39.267158    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:39.666516 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:39.666415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:40.640736 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:40.640701    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:41.337515 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.337479    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"]
Sep 17 22:05:41.337940 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.337926    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="955d6df7-0bac-4db9-98f1-0185d89a7429" containerName="main"
Sep 17 22:05:41.337997 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.337943    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="955d6df7-0bac-4db9-98f1-0185d89a7429" containerName="main"
Sep 17 22:05:41.338035 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.338005    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="955d6df7-0bac-4db9-98f1-0185d89a7429" containerName="main"
Sep 17 22:05:41.340173 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.340157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.342894 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.342866    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"kube-root-ca.crt\""
Sep 17 22:05:41.344085 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.344048    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"default-dockercfg-r9shz\""
Sep 17 22:05:41.344199 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.344098    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"openshift-service-ca.crt\""
Sep 17 22:05:41.344199 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.344150    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-dbe8a7\"/\"distinct-w4-dbe8a7-kserve-self-signed-certs\""
Sep 17 22:05:41.351485 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.351463    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"]
Sep 17 22:05:41.403328 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.403288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-dshm\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.403551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.403345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-home\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.403551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.403364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-model-cache\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.403551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.403401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83b9663c-ffb6-4439-b436-1a29810a6a9b-tls-certs\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.403551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.403485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-tmp-dir\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.403551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.403500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldm8p\" (UniqueName: \"kubernetes.io/projected/83b9663c-ffb6-4439-b436-1a29810a6a9b-kube-api-access-ldm8p\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504224 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-tmp-dir\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504224 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldm8p\" (UniqueName: \"kubernetes.io/projected/83b9663c-ffb6-4439-b436-1a29810a6a9b-kube-api-access-ldm8p\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-dshm\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-home\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-model-cache\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83b9663c-ffb6-4439-b436-1a29810a6a9b-tls-certs\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504769 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-tmp-dir\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504885 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-model-cache\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.504936 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.504897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-home\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.506863 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.506844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-dshm\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.507055 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.507039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83b9663c-ffb6-4439-b436-1a29810a6a9b-tls-certs\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.513205 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.513182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldm8p\" (UniqueName: \"kubernetes.io/projected/83b9663c-ffb6-4439-b436-1a29810a6a9b-kube-api-access-ldm8p\") pod \"distinct-w4-dbe8a7-kserve-5cb7595968-66mqj\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") " pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.534472 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.534443    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:41.649476 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.649385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:41.653508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.653468    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:41.931889 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:41.931866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"]
Sep 17 22:05:41.933080 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:05:41.933047    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83b9663c_ffb6_4439_b436_1a29810a6a9b.slice/crio-10bec23d762df37dfff1908293020796efc621aeaf82ffbd8e18c0bda54a76fc WatchSource:0}: Error finding container 10bec23d762df37dfff1908293020796efc621aeaf82ffbd8e18c0bda54a76fc: Status 404 returned error can't find the container with id 10bec23d762df37dfff1908293020796efc621aeaf82ffbd8e18c0bda54a76fc
Sep 17 22:05:42.384062 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:42.384029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:42.418866 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:42.418833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj" event={"ID":"83b9663c-ffb6-4439-b436-1a29810a6a9b","Type":"ContainerStarted","Data":"199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf"}
Sep 17 22:05:42.419086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:42.418888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj" event={"ID":"83b9663c-ffb6-4439-b436-1a29810a6a9b","Type":"ContainerStarted","Data":"10bec23d762df37dfff1908293020796efc621aeaf82ffbd8e18c0bda54a76fc"}
Sep 17 22:05:42.453383 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:42.453335    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj" podStartSLOduration=1.453320307 podStartE2EDuration="1.453320307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:05:42.450862194 +0000 UTC m=+1475.972427144" watchObservedRunningTime="2026-09-17 22:05:42.453320307 +0000 UTC m=+1475.974885236"
Sep 17 22:05:42.726793 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:42.726702    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:43.586117 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:43.586086    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:44.437583 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:44.437545    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:45.369580 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:45.369547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:47.531260 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:47.531215    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:51.649568 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:51.649532    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:51.650090 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:51.649593    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:51.667610 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:51.667583    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:52.489173 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:52.489143    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:05:52.639371 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:52.639336    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:54.334752 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:54.334719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:05:55.783237 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:55.783205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:05:59.667223 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:05:59.667185    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:08.503075 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:08.503041    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:06:08.514523 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:08.514498    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:06:21.519368 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:21.519337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:21.596086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:21.596052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:24.556322 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:24.556288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:25.283471 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:25.283440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:27.791681 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:27.790305    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:06:30.892937 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:30.892845    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:32.933816 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:32.933785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:48.565756 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:48.565722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:49.880597 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:49.880566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:52.151608 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:52.151571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:54.981790 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:54.981749    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:55.081428 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:55.081389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:55.220783 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:55.220752    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"]
Sep 17 22:06:55.221033 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:55.221006    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy" containerID="cri-o://9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8" gracePeriod=30
Sep 17 22:06:55.248568 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:55.248483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:56.557160 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:56.557129    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:56.657421 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:56.657389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:56.767382 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:56.767341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:57.394418 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:57.394381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:57.498066 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:57.498029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:06:58.273688 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:58.273625    2580 patch_prober.go:28] interesting pod/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 22:06:58.274071 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:58.273716    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 22:06:58.847054 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:06:58.847017    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:00.469969 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.469941    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:07:00.621188 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-data\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-socket\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621260    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-envoy\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621284    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr2pz\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-kube-api-access-gr2pz\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-credential-socket\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621365    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-token\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621398    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9351397b-9508-41cd-945e-68cbcca4fdd9-istiod-ca-cert\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621424    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-certs\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621477    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-podinfo\") pod \"9351397b-9508-41cd-945e-68cbcca4fdd9\" (UID: \"9351397b-9508-41cd-945e-68cbcca4fdd9\") "
Sep 17 22:07:00.621757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621519    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:07:00.621757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621561    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:07:00.621757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621729    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:07:00.622014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621817    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:07:00.622014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621912    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.622014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621930    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.622014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621944    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.622014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.621957    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.622204 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.622185    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9351397b-9508-41cd-945e-68cbcca4fdd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:07:00.623905 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.623874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:07:00.624038 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.623989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:07:00.624241 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.624221    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:07:00.624288 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.624272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-kube-api-access-gr2pz" (OuterVolumeSpecName: "kube-api-access-gr2pz") pod "9351397b-9508-41cd-945e-68cbcca4fdd9" (UID: "9351397b-9508-41cd-945e-68cbcca4fdd9"). InnerVolumeSpecName "kube-api-access-gr2pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:07:00.723082 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.723051    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.723082 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.723079    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr2pz\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-kube-api-access-gr2pz\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.723082 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.723089    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.723339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.723097    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9351397b-9508-41cd-945e-68cbcca4fdd9-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.723339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.723105    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9351397b-9508-41cd-945e-68cbcca4fdd9-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:07:00.886091 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.885996    2580 generic.go:356] "Generic (PLEG): container finished" podID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerID="9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8" exitCode=0
Sep 17 22:07:00.886091 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.886050    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"
Sep 17 22:07:00.886091 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.886075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" event={"ID":"9351397b-9508-41cd-945e-68cbcca4fdd9","Type":"ContainerDied","Data":"9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8"}
Sep 17 22:07:00.886349 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.886158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs" event={"ID":"9351397b-9508-41cd-945e-68cbcca4fdd9","Type":"ContainerDied","Data":"0f56dacf4ab044bb1b68581bb535e83bd0993852543d6985a5953f4f8e0c4733"}
Sep 17 22:07:00.886349 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.886180    2580 scope.go:117] "RemoveContainer" containerID="9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8"
Sep 17 22:07:00.896486 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.896464    2580 scope.go:117] "RemoveContainer" containerID="e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50"
Sep 17 22:07:00.905308 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.905291    2580 scope.go:117] "RemoveContainer" containerID="9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8"
Sep 17 22:07:00.905603 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:07:00.905579    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8\": container with ID starting with 9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8 not found: ID does not exist" containerID="9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8"
Sep 17 22:07:00.905671 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.905613    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8"} err="failed to get container status \"9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8\": rpc error: code = NotFound desc = could not find container \"9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8\": container with ID starting with 9dec5567f1d8d869a6b918a1570b870bd8d3107e06d116ce77a60f538ad198c8 not found: ID does not exist"
Sep 17 22:07:00.905671 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.905631    2580 scope.go:117] "RemoveContainer" containerID="e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50"
Sep 17 22:07:00.905916 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:07:00.905900    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50\": container with ID starting with e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50 not found: ID does not exist" containerID="e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50"
Sep 17 22:07:00.905959 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.905920    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50"} err="failed to get container status \"e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50\": rpc error: code = NotFound desc = could not find container \"e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50\": container with ID starting with e0993b7d1a0006b8212a076aa280d1eac3d86ceaf108ecbf760a95fa915f9e50 not found: ID does not exist"
Sep 17 22:07:00.911438 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.911417    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"]
Sep 17 22:07:00.919511 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:00.919488    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d8ea1ea7-openshift-default-7894f9d68d-6fsgs"]
Sep 17 22:07:01.024487 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:01.024457    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" path="/var/lib/kubelet/pods/9351397b-9508-41cd-945e-68cbcca4fdd9/volumes"
Sep 17 22:07:04.920669 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:04.920626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:04.994227 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:04.994186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:05.590913 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:05.590871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:06.371558 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:06.371515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:07:11.594899 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:11.594861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:11.704621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:11.704583    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:11.841720 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:11.841651    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:21.807388 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:21.807349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:21.908373 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:21.908290    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:22.379354 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:22.379325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:22.606905 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:22.606869    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:26.759227 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.759191    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"]
Sep 17 22:07:26.759838 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.759818    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy"
Sep 17 22:07:26.759919 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.759843    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy"
Sep 17 22:07:26.760003 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.759989    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy"
Sep 17 22:07:26.760062 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.760007    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy"
Sep 17 22:07:26.764338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.764314    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:26.768249 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.768228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"auth-test-model-35b181-kserve-self-signed-certs\""
Sep 17 22:07:26.768396 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.768232    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"default-dockercfg-r8vjk\""
Sep 17 22:07:26.768396 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.768274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"openshift-service-ca.crt\""
Sep 17 22:07:26.768396 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.768232    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"kube-root-ca.crt\""
Sep 17 22:07:26.773078 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.772839    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"]
Sep 17 22:07:26.791372 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.791336    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:26.909505 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.909466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbvr\" (UniqueName: \"kubernetes.io/projected/f7f789cf-be48-4c69-87bd-a0af0f69359f-kube-api-access-2kbvr\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:26.909736 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.909532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-home\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:26.909736 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.909560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-model-cache\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:26.909736 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.909589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-tmp-dir\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:26.909736 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.909651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f789cf-be48-4c69-87bd-a0af0f69359f-tls-certs\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:26.909736 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:26.909734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-dshm\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.010500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.010395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f789cf-be48-4c69-87bd-a0af0f69359f-tls-certs\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.010500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.010471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-dshm\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.010796 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.010558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbvr\" (UniqueName: \"kubernetes.io/projected/f7f789cf-be48-4c69-87bd-a0af0f69359f-kube-api-access-2kbvr\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.010796 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.010601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-home\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.010796 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.010623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-model-cache\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.010796 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.010755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-tmp-dir\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.011052 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.011032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-home\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.011122 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.011081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-model-cache\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.011168 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.011134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-tmp-dir\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.012939 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.012921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-dshm\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.013205 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.013189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f789cf-be48-4c69-87bd-a0af0f69359f-tls-certs\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.022916 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.022892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbvr\" (UniqueName: \"kubernetes.io/projected/f7f789cf-be48-4c69-87bd-a0af0f69359f-kube-api-access-2kbvr\") pod \"auth-test-model-35b181-kserve-5b6f5f9899-xfshm\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") " pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.076008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.075977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:27.362322 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:27.362287    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"]
Sep 17 22:07:27.363606 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:07:27.363583    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7f789cf_be48_4c69_87bd_a0af0f69359f.slice/crio-710295f8a7976f6216e9c9da9a50bb8720a792d7ffbee31d39255145699d29c4 WatchSource:0}: Error finding container 710295f8a7976f6216e9c9da9a50bb8720a792d7ffbee31d39255145699d29c4: Status 404 returned error can't find the container with id 710295f8a7976f6216e9c9da9a50bb8720a792d7ffbee31d39255145699d29c4
Sep 17 22:07:28.049689 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:28.049636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm" event={"ID":"f7f789cf-be48-4c69-87bd-a0af0f69359f","Type":"ContainerStarted","Data":"5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c"}
Sep 17 22:07:28.050101 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:28.049699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm" event={"ID":"f7f789cf-be48-4c69-87bd-a0af0f69359f","Type":"ContainerStarted","Data":"710295f8a7976f6216e9c9da9a50bb8720a792d7ffbee31d39255145699d29c4"}
Sep 17 22:07:28.635387 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:28.635349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:37.076248 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:37.076205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:37.076647 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:37.076276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:37.088944 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:37.088915    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:37.111356 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:37.111306    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm" podStartSLOduration=11.111291902 podStartE2EDuration="11.111291902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:28.072473671 +0000 UTC m=+1581.594038599" watchObservedRunningTime="2026-09-17 22:07:37.111291902 +0000 UTC m=+1590.632856831"
Sep 17 22:07:37.114574 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:37.114551    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:07:42.054153 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:42.054117    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:07:43.556357 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:43.556319    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:49.856108 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:49.856074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:49.960339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:49.960301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:50.228749 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.228625    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:50.587415 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.587383    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"]
Sep 17 22:07:50.587865 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.587850    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy"
Sep 17 22:07:50.587933 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.587868    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9351397b-9508-41cd-945e-68cbcca4fdd9" containerName="istio-proxy"
Sep 17 22:07:50.591126 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.591111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.594699 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.594676    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-194000-openshift-default-dockercfg-j6x76\""
Sep 17 22:07:50.611262 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.611231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:50.612000 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.611975    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"]
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-data\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-envoy\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-socket\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-credential-socket\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-token\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2041e834-fb0a-485b-a789-4bd5c80cccf0-istiod-ca-cert\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfw4\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-kube-api-access-9dfw4\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.650954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-podinfo\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.651178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.651003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-certs\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.751912 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.751879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-podinfo\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.751924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-certs\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.751988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-data\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-envoy\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-socket\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752134 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-credential-socket\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-token\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2041e834-fb0a-485b-a789-4bd5c80cccf0-istiod-ca-cert\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfw4\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-kube-api-access-9dfw4\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752561 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-certs\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752561 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-data\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752798 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-socket\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.752871 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.752784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-credential-socket\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.753142 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.753121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2041e834-fb0a-485b-a789-4bd5c80cccf0-istiod-ca-cert\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.754598 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.754572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-envoy\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.754746 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.754729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-podinfo\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.762753 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.762735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-token\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.763073 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.763050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfw4\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-kube-api-access-9dfw4\") pod \"e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") " pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:50.902326 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:50.902218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:51.004535 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:51.004494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:51.188030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:51.188005    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"]
Sep 17 22:07:51.190547 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:07:51.190505    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2041e834_fb0a_485b_a789_4bd5c80cccf0.slice/crio-f45cc8f544b7ca4430a462b864aec652caeb1736c000840fd6e80d61558a427e WatchSource:0}: Error finding container f45cc8f544b7ca4430a462b864aec652caeb1736c000840fd6e80d61558a427e: Status 404 returned error can't find the container with id f45cc8f544b7ca4430a462b864aec652caeb1736c000840fd6e80d61558a427e
Sep 17 22:07:51.193122 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:51.193088    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:07:51.193210 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:51.193157    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:07:51.193210 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:51.193185    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:07:51.200050 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:51.200029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" event={"ID":"2041e834-fb0a-485b-a789-4bd5c80cccf0","Type":"ContainerStarted","Data":"f45cc8f544b7ca4430a462b864aec652caeb1736c000840fd6e80d61558a427e"}
Sep 17 22:07:52.207683 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:52.207639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" event={"ID":"2041e834-fb0a-485b-a789-4bd5c80cccf0","Type":"ContainerStarted","Data":"a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7"}
Sep 17 22:07:52.231130 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:52.231067    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podStartSLOduration=2.231045811 podStartE2EDuration="2.231045811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:52.230768207 +0000 UTC m=+1605.752333152" watchObservedRunningTime="2026-09-17 22:07:52.231045811 +0000 UTC m=+1605.752610742"
Sep 17 22:07:52.902576 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:52.902542    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:52.908247 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:52.908220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:53.217823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:53.217716    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:53.221714 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:53.221684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:07:53.575229 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:53.575194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:54.404713 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:54.404650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:54.587298 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:54.587255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:54.999183 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:54.999143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:56.169473 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:56.169442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:57.015676 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:57.015632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:57.948964 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:57.948935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:58.848751 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:58.848629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:07:59.661888 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:07:59.661856    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:00.562631 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:00.562595    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:00.662176 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:00.662144    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:00.938377 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:00.938293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:01.220771 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:01.220676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:01.319287 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:01.319253    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:04.618221 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:04.618180    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:13.273860 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:13.273816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:08:22.372057 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:22.372009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:23.768057 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:23.768013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:24.258944 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:24.258836    2580 patch_prober.go:28] interesting pod/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 22:08:24.258944 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:24.258903    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 22:08:24.364577 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:24.364538    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:24.808892 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:24.808849    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:24.945343 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:24.945308    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:25.129501 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.129425    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"]
Sep 17 22:08:25.132255 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.132234    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.137288 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.137264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7dd893-openshift-default-dockercfg-7rp7k\""
Sep 17 22:08:25.154783 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.154750    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"]
Sep 17 22:08:25.160532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.160509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:25.225952 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.225912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-credential-socket\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226163 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.225972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-socket\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226163 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.226023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bcfb706-ff10-49d4-97c0-00c8c748883a-istiod-ca-cert\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226163 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.226081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-podinfo\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226163 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.226155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-certs\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226419 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.226216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-envoy\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226419 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.226268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-data\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226419 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.226340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-token\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.226419 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.226383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrbx\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-kube-api-access-kwrbx\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.327857 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.327819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-certs\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328035 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.327874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-envoy\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328035 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.327989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-data\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328129 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-token\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328129 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrbx\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-kube-api-access-kwrbx\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-credential-socket\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-socket\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-certs\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328231 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bcfb706-ff10-49d4-97c0-00c8c748883a-istiod-ca-cert\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328423 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-data\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328517 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-socket\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328575 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-credential-socket\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328712 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-podinfo\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.328819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.328802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bcfb706-ff10-49d4-97c0-00c8c748883a-istiod-ca-cert\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.330352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.330319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-envoy\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.331114 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.331091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-podinfo\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.338238 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.338214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-token\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.338340 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.338255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrbx\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-kube-api-access-kwrbx\") pod \"e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") " pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.412529 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.412447    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:25.422369 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.422344    2580 generic.go:356] "Generic (PLEG): container finished" podID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerID="a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7" exitCode=0
Sep 17 22:08:25.422519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.422384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" event={"ID":"2041e834-fb0a-485b-a789-4bd5c80cccf0","Type":"ContainerDied","Data":"a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7"}
Sep 17 22:08:25.422822 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.422806    2580 scope.go:117] "RemoveContainer" containerID="a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7"
Sep 17 22:08:25.423999 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.423967    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:08:25.424084 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.424038    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:08:25.424084 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.424073    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:08:25.444229 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.444208    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:25.751089 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:08:25.751043    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcfb706_ff10_49d4_97c0_00c8c748883a.slice/crio-9bffdd69287b5171deea9c04131efa745ed4b8af56936a422277b1acac86b599 WatchSource:0}: Error finding container 9bffdd69287b5171deea9c04131efa745ed4b8af56936a422277b1acac86b599: Status 404 returned error can't find the container with id 9bffdd69287b5171deea9c04131efa745ed4b8af56936a422277b1acac86b599
Sep 17 22:08:25.752102 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.751972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"]
Sep 17 22:08:25.753993 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.753958    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:08:25.754095 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.754024    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:08:25.754095 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.754052    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:08:25.878545 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:25.878508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:26.434000 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.433960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" event={"ID":"2041e834-fb0a-485b-a789-4bd5c80cccf0","Type":"ContainerStarted","Data":"ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5"}
Sep 17 22:08:26.435759 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.435692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" event={"ID":"2bcfb706-ff10-49d4-97c0-00c8c748883a","Type":"ContainerStarted","Data":"c1b26e2a6fdab1a6ab9e93f00b6b6ccf3de6d7ce5b2f8bad90a5edc6e7932175"}
Sep 17 22:08:26.435912 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.435782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" event={"ID":"2bcfb706-ff10-49d4-97c0-00c8c748883a","Type":"ContainerStarted","Data":"9bffdd69287b5171deea9c04131efa745ed4b8af56936a422277b1acac86b599"}
Sep 17 22:08:26.445064 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.445043    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:26.450435 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.450410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:26.484602 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.484559    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" podStartSLOduration=1.484541055 podStartE2EDuration="1.484541055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:08:26.481115214 +0000 UTC m=+1640.002680144" watchObservedRunningTime="2026-09-17 22:08:26.484541055 +0000 UTC m=+1640.006105987"
Sep 17 22:08:26.649579 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.649543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:26.902443 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.902404    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:08:26.902955 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.902631    2580 patch_prober.go:28] interesting pod/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 17 22:08:26.902955 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:26.902726    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 17 22:08:27.442344 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:27.442313    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:27.443487 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:27.443464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:08:27.767258 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:27.767233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:27.902902 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:27.902868    2580 patch_prober.go:28] interesting pod/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 17 22:08:27.903321 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:27.902928    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 17 22:08:28.520713 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:28.520670    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:28.645595 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:28.645552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:28.738621 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:28.738593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:28.839036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:28.838936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:28.902649 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:28.902617    2580 patch_prober.go:28] interesting pod/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 17 22:08:28.902839 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:28.902703    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 17 22:08:29.902853 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:29.902814    2580 patch_prober.go:28] interesting pod/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 17 22:08:29.903244 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:29.902873    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 17 22:08:30.167112 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:30.167014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:30.903597 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:30.903542    2580 patch_prober.go:28] interesting pod/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 17 22:08:30.904166 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:30.903623    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 17 22:08:31.303725 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:31.303688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:31.906392 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:31.906347    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:08:31.906843 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:31.906770    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:08:31.907394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:31.907376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:08:32.188937 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:32.188855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:32.293640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:32.293588    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:32.423028 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:32.422993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:32.745979 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:32.745949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:32.851271 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:32.851235    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:33.455961 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:33.455932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:34.308808 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:34.308772    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:35.217882 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:35.217850    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:36.148918 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:36.148886    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:36.928530 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:36.928496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:37.921298 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:37.921264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:45.386675 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:45.386616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:45.867482 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:45.867440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:46.700933 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:46.700902    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:47.832943 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:47.832900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:48.455166 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:48.455132    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:48.966981 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:48.966949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:49.881946 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:49.881913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:50.359780 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:50.359745    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"]
Sep 17 22:08:50.457676 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:50.457615    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:50.682801 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:50.682707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:51.643735 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:51.643702    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:52.220977 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:52.220940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:52.322574 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:52.322541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:52.450109 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:52.450076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:53.313362 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:53.313320    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:54.337823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:54.337785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:55.235512 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:55.235483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:56.071515 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:56.071480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:56.997243 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:56.997199    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:57.945617 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:57.945565    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:58.693878 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:58.693838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:08:59.546837 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:08:59.546765    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:00.613771 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:00.613730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:01.644068 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:01.644030    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:05.380378 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.380304    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6" podUID="bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" containerName="main" containerID="cri-o://9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a" gracePeriod=45
Sep 17 22:09:05.444932 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.444877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:05.599392 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.599360    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:05.649703 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.649678    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:09:05.672223 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.672185    2580 generic.go:356] "Generic (PLEG): container finished" podID="bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" containerID="9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a" exitCode=0
Sep 17 22:09:05.672397 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.672232    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6" event={"ID":"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2","Type":"ContainerDied","Data":"9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a"}
Sep 17 22:09:05.672397 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.672238    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"
Sep 17 22:09:05.672397 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.672271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6" event={"ID":"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2","Type":"ContainerDied","Data":"89122a865deada0a3a485627fe52953bf2d53ff39798b6dc1ffcf0501d0dad93"}
Sep 17 22:09:05.672397 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.672295    2580 scope.go:117] "RemoveContainer" containerID="9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a"
Sep 17 22:09:05.682832 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.682804    2580 scope.go:117] "RemoveContainer" containerID="9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a"
Sep 17 22:09:05.683193 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:09:05.683171    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a\": container with ID starting with 9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a not found: ID does not exist" containerID="9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a"
Sep 17 22:09:05.683242 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.683208    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a"} err="failed to get container status \"9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a\": rpc error: code = NotFound desc = could not find container \"9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a\": container with ID starting with 9c897dbb5214d8ea816d3fc5a5810d57132398c18c676cf406f15f9036c6802a not found: ID does not exist"
Sep 17 22:09:05.754112 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.754075    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:05.772070 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-model-cache\") pod \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") "
Sep 17 22:09:05.772255 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772090    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-home\") pod \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") "
Sep 17 22:09:05.772255 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tmp-dir\") pod \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") "
Sep 17 22:09:05.772255 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-dshm\") pod \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") "
Sep 17 22:09:05.772449 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772279    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tls-certs\") pod \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") "
Sep 17 22:09:05.772449 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772305    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-kube-api-access-785nl\") pod \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\" (UID: \"bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2\") "
Sep 17 22:09:05.772449 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772376    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-home" (OuterVolumeSpecName: "home") pod "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" (UID: "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:05.772449 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772389    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" (UID: "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:05.772708 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772497    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" (UID: "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:05.772773 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772721    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:05.772773 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772742    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:05.772773 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.772756    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:05.774955 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.774924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-kube-api-access-785nl" (OuterVolumeSpecName: "kube-api-access-785nl") pod "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" (UID: "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2"). InnerVolumeSpecName "kube-api-access-785nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:05.775194 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.775171    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-dshm" (OuterVolumeSpecName: "dshm") pod "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" (UID: "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:05.775280 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.775190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" (UID: "bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:09:05.869439 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.869404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:05.873633 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.873606    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:05.873633 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.873633    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:05.873856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:05.873648    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-785nl\" (UniqueName: \"kubernetes.io/projected/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2-kube-api-access-785nl\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:06.002477 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:06.002173    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:06.033332 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:06.033297    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"]
Sep 17 22:09:06.036515 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:06.036492    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-f996ae/distinct-w0-f996ae-kserve-6d45f8c875-lb6w6"]
Sep 17 22:09:06.367004 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:06.366964    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:06.500595 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:06.500540    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:07.025802 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:07.025769    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" path="/var/lib/kubelet/pods/bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2/volumes"
Sep 17 22:09:07.607177 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:07.607136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:08.839805 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:08.839770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:10.337810 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:10.337770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:11.147051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:11.147011    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:12.064425 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:12.064383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:13.094031 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:13.093990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:13.539213 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:13.539175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:13.642157 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:13.642127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:13.876115 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:13.876021    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:13.971406 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:13.971373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:14.089293 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:14.089265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:14.241563 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:14.241471    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:14.353829 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:14.353794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:14.709417 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:14.709364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:14.913790 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:14.913758    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:16.276544 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:16.276497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:18.018005 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:18.017969    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:19.564571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:19.564535    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:20.733174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:20.733142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:21.993396 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:21.993359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:23.013677 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:23.013632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:23.614679 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:23.614623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:23.806295 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:23.806255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:23.959611 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:23.959525    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"]
Sep 17 22:09:23.959795 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:23.959774    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy" containerID="cri-o://ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5" gracePeriod=30
Sep 17 22:09:24.071601 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:24.071563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:24.859512 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:24.859479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:26.178682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:26.178619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:27.159811 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:27.159778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:28.574917 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:28.574679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:29.219498 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.219476    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:09:29.323224 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-token\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323429 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dfw4\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-kube-api-access-9dfw4\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323429 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323265    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-envoy\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323429 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323291    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2041e834-fb0a-485b-a789-4bd5c80cccf0-istiod-ca-cert\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323429 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-credential-socket\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323429 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-podinfo\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323429 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323381    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-socket\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323803 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323499    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-data\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323803 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-certs\") pod \"2041e834-fb0a-485b-a789-4bd5c80cccf0\" (UID: \"2041e834-fb0a-485b-a789-4bd5c80cccf0\") "
Sep 17 22:09:29.323906 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323792    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:29.323906 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.323875    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2041e834-fb0a-485b-a789-4bd5c80cccf0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:29.324081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.324024    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:29.324081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.324086    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.324081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.324104    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2041e834-fb0a-485b-a789-4bd5c80cccf0-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.324376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.324102    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:29.324376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.324282    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:29.325764 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.325734    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:29.325876 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.325763    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:09:29.325876 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.325811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-kube-api-access-9dfw4" (OuterVolumeSpecName: "kube-api-access-9dfw4") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "kube-api-access-9dfw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:29.325876 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.325835    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2041e834-fb0a-485b-a789-4bd5c80cccf0" (UID: "2041e834-fb0a-485b-a789-4bd5c80cccf0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:29.425144 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.425092    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.425144 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.425143    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.425144 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.425158    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.425410 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.425171    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.425410 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.425185    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2041e834-fb0a-485b-a789-4bd5c80cccf0-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.425410 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.425195    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.425410 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.425206    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dfw4\" (UniqueName: \"kubernetes.io/projected/2041e834-fb0a-485b-a789-4bd5c80cccf0-kube-api-access-9dfw4\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:29.813579 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.813545    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:29.823376 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.823344    2580 generic.go:356] "Generic (PLEG): container finished" podID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerID="ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5" exitCode=0
Sep 17 22:09:29.823532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.823391    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"
Sep 17 22:09:29.823532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.823422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" event={"ID":"2041e834-fb0a-485b-a789-4bd5c80cccf0","Type":"ContainerDied","Data":"ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5"}
Sep 17 22:09:29.823532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.823474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx" event={"ID":"2041e834-fb0a-485b-a789-4bd5c80cccf0","Type":"ContainerDied","Data":"f45cc8f544b7ca4430a462b864aec652caeb1736c000840fd6e80d61558a427e"}
Sep 17 22:09:29.823532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.823499    2580 scope.go:117] "RemoveContainer" containerID="ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5"
Sep 17 22:09:29.834849 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.834833    2580 scope.go:117] "RemoveContainer" containerID="a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7"
Sep 17 22:09:29.843448 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.843432    2580 scope.go:117] "RemoveContainer" containerID="ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5"
Sep 17 22:09:29.843746 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:09:29.843727    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5\": container with ID starting with ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5 not found: ID does not exist" containerID="ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5"
Sep 17 22:09:29.843819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.843756    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5"} err="failed to get container status \"ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5\": rpc error: code = NotFound desc = could not find container \"ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5\": container with ID starting with ab385996c9d1967c39bfe81a0fdd5f66cbe3f36e878fd572ef685d747bbfbea5 not found: ID does not exist"
Sep 17 22:09:29.843819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.843773    2580 scope.go:117] "RemoveContainer" containerID="a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7"
Sep 17 22:09:29.844019 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:09:29.844005    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7\": container with ID starting with a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7 not found: ID does not exist" containerID="a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7"
Sep 17 22:09:29.844071 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.844023    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7"} err="failed to get container status \"a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7\": rpc error: code = NotFound desc = could not find container \"a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7\": container with ID starting with a843add29911c930597886745be837e8c1b9f29570e6a39963af0066a310d3c7 not found: ID does not exist"
Sep 17 22:09:29.873068 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.873033    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"]
Sep 17 22:09:29.894567 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:29.894538    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-194000-openshift-default-75f76ccbf6-ncjfx"]
Sep 17 22:09:30.589681 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:30.589628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:30.691965 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:30.691933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:30.854076 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:30.853982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:30.954459 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:30.954414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:31.025359 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:31.025325    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" path="/var/lib/kubelet/pods/2041e834-fb0a-485b-a789-4bd5c80cccf0/volumes"
Sep 17 22:09:31.672649 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:31.672619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:32.575638 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:32.575597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:34.800127 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:34.800089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:09:36.152533 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:36.152490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:40.277421 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:40.277373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:40.380168 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:40.380136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:40.479976 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:40.479921    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:40.579449 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:40.579350    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:40.668389 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:40.668352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:40.967506 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:40.967412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:41.094324 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:41.094290    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:42.146086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:42.146048    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:43.157673 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:43.157612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:44.175870 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:44.175834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:45.268312 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:45.268274    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:46.373895 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:46.373815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:46.930111 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:46.930076    2580 generic.go:356] "Generic (PLEG): container finished" podID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerID="c1b26e2a6fdab1a6ab9e93f00b6b6ccf3de6d7ce5b2f8bad90a5edc6e7932175" exitCode=0
Sep 17 22:09:46.930317 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:46.930156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" event={"ID":"2bcfb706-ff10-49d4-97c0-00c8c748883a","Type":"ContainerDied","Data":"c1b26e2a6fdab1a6ab9e93f00b6b6ccf3de6d7ce5b2f8bad90a5edc6e7932175"}
Sep 17 22:09:46.930651 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:46.930634    2580 scope.go:117] "RemoveContainer" containerID="c1b26e2a6fdab1a6ab9e93f00b6b6ccf3de6d7ce5b2f8bad90a5edc6e7932175"
Sep 17 22:09:46.931859 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:46.931831    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:09:46.931935 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:46.931921    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:09:46.931980 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:46.931965    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:09:47.937928 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:47.937887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" event={"ID":"2bcfb706-ff10-49d4-97c0-00c8c748883a","Type":"ContainerStarted","Data":"13213727bf4e651a80b75321bb47b5d9d98a4026de5455621edf0e9226d787ae"}
Sep 17 22:09:48.445008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.444966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:09:48.445245 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.445221    2580 patch_prober.go:28] interesting pod/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 22:09:48.445326 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.445284    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 22:09:48.465168 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.465119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:48.553620 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.553584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:48.722777 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.719054    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"]
Sep 17 22:09:48.741091 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.741062    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:48.944487 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:48.944450    2580 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" secret="" err="secret \"e2e-api-b-7dd893-openshift-default-dockercfg-7rp7k\" not found"
Sep 17 22:09:49.444817 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:49.444781    2580 patch_prober.go:28] interesting pod/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 22:09:49.445006 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:49.444851    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 22:09:49.950565 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:49.950514    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy" containerID="cri-o://13213727bf4e651a80b75321bb47b5d9d98a4026de5455621edf0e9226d787ae" gracePeriod=30
Sep 17 22:09:50.052866 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:50.052834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:51.050446 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:51.050400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:51.850032 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:51.849992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:52.844483 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:52.844446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:53.748456 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:53.748424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:54.781596 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:54.781564    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:57.442389 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:57.442352    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:09:57.541963 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:57.541926    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:59.005034 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.005000    2580 generic.go:356] "Generic (PLEG): container finished" podID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerID="13213727bf4e651a80b75321bb47b5d9d98a4026de5455621edf0e9226d787ae" exitCode=0
Sep 17 22:09:59.005438 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.005077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" event={"ID":"2bcfb706-ff10-49d4-97c0-00c8c748883a","Type":"ContainerDied","Data":"13213727bf4e651a80b75321bb47b5d9d98a4026de5455621edf0e9226d787ae"}
Sep 17 22:09:59.005438 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.005141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc" event={"ID":"2bcfb706-ff10-49d4-97c0-00c8c748883a","Type":"ContainerDied","Data":"9bffdd69287b5171deea9c04131efa745ed4b8af56936a422277b1acac86b599"}
Sep 17 22:09:59.005438 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.005160    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bffdd69287b5171deea9c04131efa745ed4b8af56936a422277b1acac86b599"
Sep 17 22:09:59.005438 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.005176    2580 scope.go:117] "RemoveContainer" containerID="c1b26e2a6fdab1a6ab9e93f00b6b6ccf3de6d7ce5b2f8bad90a5edc6e7932175"
Sep 17 22:09:59.012997 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.012975    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:09:59.143638 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143548    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-certs\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143638 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-socket\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143638 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143624    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-credential-socket\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143957 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143740    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwrbx\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-kube-api-access-kwrbx\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143957 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143776    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-token\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143957 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143810    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-data\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143957 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143850    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-podinfo\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143957 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143872    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-envoy\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.143957 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.143935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bcfb706-ff10-49d4-97c0-00c8c748883a-istiod-ca-cert\") pod \"2bcfb706-ff10-49d4-97c0-00c8c748883a\" (UID: \"2bcfb706-ff10-49d4-97c0-00c8c748883a\") "
Sep 17 22:09:59.144266 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.144222    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:59.144328 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.144260    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:59.144328 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.144315    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:59.144431 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.144338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:59.144431 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.144398    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.144431 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.144418    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.144561 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.144526    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcfb706-ff10-49d4-97c0-00c8c748883a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:59.146208 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.146179    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-kube-api-access-kwrbx" (OuterVolumeSpecName: "kube-api-access-kwrbx") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "kube-api-access-kwrbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:59.146208 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.146200    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:09:59.146568 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.146553    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:59.146625 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.146595    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bcfb706-ff10-49d4-97c0-00c8c748883a" (UID: "2bcfb706-ff10-49d4-97c0-00c8c748883a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:59.245338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.245301    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.245338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.245329    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.245338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.245342    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwrbx\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-kube-api-access-kwrbx\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.245585 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.245350    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.245585 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.245360    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.245585 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.245368    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bcfb706-ff10-49d4-97c0-00c8c748883a-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.245585 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.245375    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bcfb706-ff10-49d4-97c0-00c8c748883a-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:09:59.819753 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.819723    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"]
Sep 17 22:09:59.819972 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.819932    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8" podUID="f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" containerName="maas-api" containerID="cri-o://932319fcb00461c8259ddf8f6e21c7e85f116d9710a1856ccf02de80ab88aaba" gracePeriod=30
Sep 17 22:09:59.862571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.862539    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:09:59.964981 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:09:59.964938    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:00.014724 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.014679    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"
Sep 17 22:10:00.016981 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.016943    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" containerID="932319fcb00461c8259ddf8f6e21c7e85f116d9710a1856ccf02de80ab88aaba" exitCode=0
Sep 17 22:10:00.017109 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.017018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8" event={"ID":"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1","Type":"ContainerDied","Data":"932319fcb00461c8259ddf8f6e21c7e85f116d9710a1856ccf02de80ab88aaba"}
Sep 17 22:10:00.045008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.044960    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:00.057793 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.057762    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"]
Sep 17 22:10:00.072625 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.068091    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7dd893-openshift-default-75d44b4bcb-bkdbc"]
Sep 17 22:10:00.085315 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.085291    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:10:00.133221 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.133191    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:00.155195 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.155162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-openshift-service-ca\") pod \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") "
Sep 17 22:10:00.155379 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.155228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlljw\" (UniqueName: \"kubernetes.io/projected/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-kube-api-access-rlljw\") pod \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") "
Sep 17 22:10:00.155379 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.155249    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-metrics-certs\") pod \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") "
Sep 17 22:10:00.155379 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.155279    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-maas-api-tls\") pod \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\" (UID: \"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1\") "
Sep 17 22:10:00.155569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.155548    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" (UID: "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:10:00.155682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.155636    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:00.157566 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.157540    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" (UID: "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:10:00.157702 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.157616    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-kube-api-access-rlljw" (OuterVolumeSpecName: "kube-api-access-rlljw") pod "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" (UID: "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1"). InnerVolumeSpecName "kube-api-access-rlljw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:10:00.157702 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.157689    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" (UID: "f0ab00f7-ff77-48dd-a708-8345dd8e1cd1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:10:00.257220 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.257185    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlljw\" (UniqueName: \"kubernetes.io/projected/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-kube-api-access-rlljw\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:00.257220 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.257218    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:00.257220 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.257232    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:00.487442 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.487346    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:00.582813 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:00.582772    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:01.024375 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:01.024341    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" path="/var/lib/kubelet/pods/2bcfb706-ff10-49d4-97c0-00c8c748883a/volumes"
Sep 17 22:10:01.024774 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:01.024408    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"
Sep 17 22:10:01.024870 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:01.024851    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8" event={"ID":"f0ab00f7-ff77-48dd-a708-8345dd8e1cd1","Type":"ContainerDied","Data":"6ba68d5d28fa3e41a048cf7dbf059a69a0dd5df718f0f881b88b4cd29d5d587a"}
Sep 17 22:10:01.024928 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:01.024898    2580 scope.go:117] "RemoveContainer" containerID="932319fcb00461c8259ddf8f6e21c7e85f116d9710a1856ccf02de80ab88aaba"
Sep 17 22:10:01.078273 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:01.078220    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"]
Sep 17 22:10:01.083324 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:01.083297    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-a23afc-65754b887c-2mxs8"]
Sep 17 22:10:01.758249 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:01.758207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:02.771981 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:02.771951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:03.025097 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:03.025003    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" path="/var/lib/kubelet/pods/f0ab00f7-ff77-48dd-a708-8345dd8e1cd1/volumes"
Sep 17 22:10:03.646615 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:03.646578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:04.463289 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:04.463255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:04.669197 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:04.669158    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:10:07.217142 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:07.217100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:07.322973 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:07.322939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:07.532680 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:07.532638    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"]
Sep 17 22:10:07.532887 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:07.532851    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy" containerID="cri-o://1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c" gracePeriod=30
Sep 17 22:10:07.551959 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:07.551927    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:08.731929 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:08.731895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:09.663242 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:09.663204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:10.456443 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:10.456411    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:11.448838 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:11.448798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:12.212394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.212360    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:12.786388 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.786366    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:10:12.880636 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.880537    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-credential-socket\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.880636 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.880592    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-istio-token\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.880636 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.880623    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm9hm\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-kube-api-access-mm9hm\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.880951 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.880693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-envoy\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.880951 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.880833    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d6ac83-72c5-4025-936a-b44407a32fde-istiod-ca-cert\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.880951 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.880888    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:12.880951 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.880924    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-data\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.881167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881012    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-socket\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.881167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881042    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-certs\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.881167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881077    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d6ac83-72c5-4025-936a-b44407a32fde-istio-podinfo\") pod \"70d6ac83-72c5-4025-936a-b44407a32fde\" (UID: \"70d6ac83-72c5-4025-936a-b44407a32fde\") "
Sep 17 22:10:12.881315 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881165    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-data" (OuterVolumeSpecName: "istio-data") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:12.881315 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881239    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d6ac83-72c5-4025-936a-b44407a32fde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:10:12.881315 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881265    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:12.881640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881479    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:12.881640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881555    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d6ac83-72c5-4025-936a-b44407a32fde-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.881640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881572    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.881640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881581    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.881640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881589    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.881640 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.881596    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.883139 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.883116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:12.883306 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.883282    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70d6ac83-72c5-4025-936a-b44407a32fde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:10:12.883562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.883541    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-kube-api-access-mm9hm" (OuterVolumeSpecName: "kube-api-access-mm9hm") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "kube-api-access-mm9hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:10:12.883684 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.883619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-istio-token" (OuterVolumeSpecName: "istio-token") pod "70d6ac83-72c5-4025-936a-b44407a32fde" (UID: "70d6ac83-72c5-4025-936a-b44407a32fde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:10:12.982125 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.982093    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d6ac83-72c5-4025-936a-b44407a32fde-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.982125 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.982119    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.982125 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.982128    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm9hm\" (UniqueName: \"kubernetes.io/projected/70d6ac83-72c5-4025-936a-b44407a32fde-kube-api-access-mm9hm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:12.982352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:12.982138    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d6ac83-72c5-4025-936a-b44407a32fde-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:13.098778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.098736    2580 generic.go:356] "Generic (PLEG): container finished" podID="70d6ac83-72c5-4025-936a-b44407a32fde" containerID="1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c" exitCode=0
Sep 17 22:10:13.098934 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.098796    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"
Sep 17 22:10:13.098934 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.098800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" event={"ID":"70d6ac83-72c5-4025-936a-b44407a32fde","Type":"ContainerDied","Data":"1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c"}
Sep 17 22:10:13.098934 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.098857    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl" event={"ID":"70d6ac83-72c5-4025-936a-b44407a32fde","Type":"ContainerDied","Data":"7e6f9eeaaae35aedcef1a57f6e676e695baccb49a185269a8e79144c6fffe579"}
Sep 17 22:10:13.098934 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.098879    2580 scope.go:117] "RemoveContainer" containerID="1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c"
Sep 17 22:10:13.108553 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.108537    2580 scope.go:117] "RemoveContainer" containerID="dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924"
Sep 17 22:10:13.117169 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.117146    2580 scope.go:117] "RemoveContainer" containerID="1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c"
Sep 17 22:10:13.117449 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:10:13.117429    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c\": container with ID starting with 1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c not found: ID does not exist" containerID="1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c"
Sep 17 22:10:13.117496 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.117462    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c"} err="failed to get container status \"1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c\": rpc error: code = NotFound desc = could not find container \"1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c\": container with ID starting with 1d14de0d46c1a11fc4e685a09289a7643e699ff651c2980fa13faea87159d24c not found: ID does not exist"
Sep 17 22:10:13.117496 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.117481    2580 scope.go:117] "RemoveContainer" containerID="dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924"
Sep 17 22:10:13.117784 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:10:13.117763    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924\": container with ID starting with dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924 not found: ID does not exist" containerID="dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924"
Sep 17 22:10:13.117852 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.117791    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924"} err="failed to get container status \"dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924\": rpc error: code = NotFound desc = could not find container \"dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924\": container with ID starting with dc76f71463c65851709a9c53315a98cd015d8bc9a25fe71896c1e6de5f2d5924 not found: ID does not exist"
Sep 17 22:10:13.125508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.125485    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"]
Sep 17 22:10:13.132692 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.132619    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-a23afc-openshift-default-7cfc47cd66-ttlgl"]
Sep 17 22:10:13.176067 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:13.176034    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:15.025102 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:15.025069    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" path="/var/lib/kubelet/pods/70d6ac83-72c5-4025-936a-b44407a32fde/volumes"
Sep 17 22:10:18.048769 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:18.048735    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:18.766214 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:18.766177    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"]
Sep 17 22:10:18.766515 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:18.766483    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2" podUID="9e648961-7526-40c8-b99e-17cb4a1989ab" containerName="maas-api" containerID="cri-o://3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4" gracePeriod=30
Sep 17 22:10:18.808143 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:18.808116    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:18.934467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:18.934433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:19.018594 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.018569    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:10:19.071336 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.071282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:19.134061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.134022    2580 generic.go:356] "Generic (PLEG): container finished" podID="9e648961-7526-40c8-b99e-17cb4a1989ab" containerID="3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4" exitCode=0
Sep 17 22:10:19.134222 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.134070    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"
Sep 17 22:10:19.134222 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.134109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2" event={"ID":"9e648961-7526-40c8-b99e-17cb4a1989ab","Type":"ContainerDied","Data":"3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4"}
Sep 17 22:10:19.134222 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.134160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2" event={"ID":"9e648961-7526-40c8-b99e-17cb4a1989ab","Type":"ContainerDied","Data":"5def39eb6e8465eedb5ea64a6560945e8a66349774e6b2f588ef619f47db79dc"}
Sep 17 22:10:19.134222 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.134191    2580 scope.go:117] "RemoveContainer" containerID="3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4"
Sep 17 22:10:19.142484 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.142461    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-metrics-certs\") pod \"9e648961-7526-40c8-b99e-17cb4a1989ab\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") "
Sep 17 22:10:19.142634 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.142523    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls\") pod \"9e648961-7526-40c8-b99e-17cb4a1989ab\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") "
Sep 17 22:10:19.142634 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.142561    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e648961-7526-40c8-b99e-17cb4a1989ab-openshift-service-ca\") pod \"9e648961-7526-40c8-b99e-17cb4a1989ab\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") "
Sep 17 22:10:19.142634 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.142592    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bswg\" (UniqueName: \"kubernetes.io/projected/9e648961-7526-40c8-b99e-17cb4a1989ab-kube-api-access-5bswg\") pod \"9e648961-7526-40c8-b99e-17cb4a1989ab\" (UID: \"9e648961-7526-40c8-b99e-17cb4a1989ab\") "
Sep 17 22:10:19.142994 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.142965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e648961-7526-40c8-b99e-17cb4a1989ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e648961-7526-40c8-b99e-17cb4a1989ab" (UID: "9e648961-7526-40c8-b99e-17cb4a1989ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:10:19.143108 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.143091    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e648961-7526-40c8-b99e-17cb4a1989ab-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:19.143899 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.143879    2580 scope.go:117] "RemoveContainer" containerID="3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4"
Sep 17 22:10:19.144254 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:10:19.144230    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4\": container with ID starting with 3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4 not found: ID does not exist" containerID="3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4"
Sep 17 22:10:19.144399 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.144263    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4"} err="failed to get container status \"3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4\": rpc error: code = NotFound desc = could not find container \"3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4\": container with ID starting with 3899f4741d8c46dd40a98c1bf500d9d91c84158c7ebd66282e56fb29ece944c4 not found: ID does not exist"
Sep 17 22:10:19.144914 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.144887    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e648961-7526-40c8-b99e-17cb4a1989ab" (UID: "9e648961-7526-40c8-b99e-17cb4a1989ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:10:19.145157 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.145138    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e648961-7526-40c8-b99e-17cb4a1989ab-kube-api-access-5bswg" (OuterVolumeSpecName: "kube-api-access-5bswg") pod "9e648961-7526-40c8-b99e-17cb4a1989ab" (UID: "9e648961-7526-40c8-b99e-17cb4a1989ab"). InnerVolumeSpecName "kube-api-access-5bswg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:10:19.145157 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.145146    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9e648961-7526-40c8-b99e-17cb4a1989ab" (UID: "9e648961-7526-40c8-b99e-17cb4a1989ab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:10:19.183468 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.183433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:19.244470 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.244419    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:19.244470 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.244471    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e648961-7526-40c8-b99e-17cb4a1989ab-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:19.244706 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.244488    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bswg\" (UniqueName: \"kubernetes.io/projected/9e648961-7526-40c8-b99e-17cb4a1989ab-kube-api-access-5bswg\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:19.300030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.299899    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:19.464033 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.463998    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"]
Sep 17 22:10:19.468179 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.468153    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-12d586-7dcfb99764-626b2"]
Sep 17 22:10:19.542481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.542428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:19.666641 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:19.666555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:20.943671 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:20.943615    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:21.029868 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:21.029829    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e648961-7526-40c8-b99e-17cb4a1989ab" path="/var/lib/kubelet/pods/9e648961-7526-40c8-b99e-17cb4a1989ab/volumes"
Sep 17 22:10:21.960798 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:21.960766    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:22.791879 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:22.791839    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:27.327123 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:27.327093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:27.424031 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:27.423987    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:27.599007 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:27.598927    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"]
Sep 17 22:10:27.599190 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:27.599121    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy" containerID="cri-o://8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81" gracePeriod=30
Sep 17 22:10:27.793467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:27.793411    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:32.369646 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.369610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:10:32.855819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.855795    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:10:32.974607 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974517    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-credential-socket\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.974607 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974595    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-envoy\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.974847 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974617    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwjqv\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-kube-api-access-lwjqv\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.974847 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974708    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istiod-ca-cert\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.974847 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974736    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-socket\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.974847 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-certs\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.974847 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974789    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-podinfo\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.974847 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974833    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-data\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.975172 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-token\") pod \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\" (UID: \"51e69067-67f5-4b03-a10b-dd17c2d1b7d2\") "
Sep 17 22:10:32.975172 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974883    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:32.975172 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.974996    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:32.975172 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.975033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:32.975172 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.975085    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:10:32.975394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.975249    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:32.975394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.975258    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:32.975394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.975278    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:32.975394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.975292    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:32.975394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.975305    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:32.977073 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.977038    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-kube-api-access-lwjqv" (OuterVolumeSpecName: "kube-api-access-lwjqv") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "kube-api-access-lwjqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:10:32.977198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.977183    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:10:32.977312 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.977297    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:32.977355 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:32.977298    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51e69067-67f5-4b03-a10b-dd17c2d1b7d2" (UID: "51e69067-67f5-4b03-a10b-dd17c2d1b7d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:10:33.076532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.076484    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:33.076532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.076521    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:33.076532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.076533    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:33.076532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.076543    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:33.076843 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.076554    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwjqv\" (UniqueName: \"kubernetes.io/projected/51e69067-67f5-4b03-a10b-dd17c2d1b7d2-kube-api-access-lwjqv\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:33.221723 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.221686    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerID="8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81" exitCode=0
Sep 17 22:10:33.221908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.221743    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"
Sep 17 22:10:33.221908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.221785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" event={"ID":"51e69067-67f5-4b03-a10b-dd17c2d1b7d2","Type":"ContainerDied","Data":"8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81"}
Sep 17 22:10:33.221908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.221860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z" event={"ID":"51e69067-67f5-4b03-a10b-dd17c2d1b7d2","Type":"ContainerDied","Data":"a74fc024799984523039cefba8a3c7efdcd10b7250584f76a24faaf841aa9f11"}
Sep 17 22:10:33.221908 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.221896    2580 scope.go:117] "RemoveContainer" containerID="8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81"
Sep 17 22:10:33.231779 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.231754    2580 scope.go:117] "RemoveContainer" containerID="f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b"
Sep 17 22:10:33.241422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.241401    2580 scope.go:117] "RemoveContainer" containerID="8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81"
Sep 17 22:10:33.241727 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:10:33.241706    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81\": container with ID starting with 8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81 not found: ID does not exist" containerID="8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81"
Sep 17 22:10:33.241815 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.241736    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81"} err="failed to get container status \"8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81\": rpc error: code = NotFound desc = could not find container \"8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81\": container with ID starting with 8649fa06b771f9997d344c2827b80e33604a5b0f50e59a606066cd183dee9f81 not found: ID does not exist"
Sep 17 22:10:33.241815 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.241754    2580 scope.go:117] "RemoveContainer" containerID="f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b"
Sep 17 22:10:33.242050 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:10:33.242033    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b\": container with ID starting with f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b not found: ID does not exist" containerID="f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b"
Sep 17 22:10:33.242111 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.242056    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b"} err="failed to get container status \"f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b\": rpc error: code = NotFound desc = could not find container \"f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b\": container with ID starting with f26b3e12b0e7f1c153837b2bf81acb1b7071865fc20cb8e0412e96ee52b3943b not found: ID does not exist"
Sep 17 22:10:33.242338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.242318    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"]
Sep 17 22:10:33.250839 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:33.250815    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-12d586-openshift-default-d5b77854d-2pf9z"]
Sep 17 22:10:35.024534 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:35.024499    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" path="/var/lib/kubelet/pods/51e69067-67f5-4b03-a10b-dd17c2d1b7d2/volumes"
Sep 17 22:10:37.531650 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:37.531612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:38.756895 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:38.756860    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:39.575729 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:39.575693    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:40.426239 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:40.426205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:41.257848 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:41.257807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:42.496298 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:42.496260    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"]
Sep 17 22:10:42.585777 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:42.585749    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:46.079912 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:46.079851    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:46.219330 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:46.219296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:53.603571 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:53.603534    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:53.604139 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:53.604047    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"]
Sep 17 22:10:53.606884 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:53.606863    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-dbe8a7-29828040-rljqw"]
Sep 17 22:10:53.700529 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:53.700494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:53.805101 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:53.805063    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:53.904780 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:53.904692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:54.274367 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:54.274341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:54.418313 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:54.418277    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:54.652059 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:54.651942    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:10:55.024757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:55.024723    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1edd563e-2650-4c2f-b5a1-f4bba4b7fc81" path="/var/lib/kubelet/pods/1edd563e-2650-4c2f-b5a1-f4bba4b7fc81/volumes"
Sep 17 22:10:56.015494 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:56.015450    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:57.449350 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.449303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:10:57.516319 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.516282    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj" podUID="83b9663c-ffb6-4439-b436-1a29810a6a9b" containerName="main" containerID="cri-o://199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf" gracePeriod=45
Sep 17 22:10:57.774865 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.774830    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:10:57.926798 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.926765    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-dshm\") pod \"83b9663c-ffb6-4439-b436-1a29810a6a9b\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") "
Sep 17 22:10:57.926967 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.926808    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-model-cache\") pod \"83b9663c-ffb6-4439-b436-1a29810a6a9b\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") "
Sep 17 22:10:57.926967 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.926831    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldm8p\" (UniqueName: \"kubernetes.io/projected/83b9663c-ffb6-4439-b436-1a29810a6a9b-kube-api-access-ldm8p\") pod \"83b9663c-ffb6-4439-b436-1a29810a6a9b\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") "
Sep 17 22:10:57.926967 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.926870    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83b9663c-ffb6-4439-b436-1a29810a6a9b-tls-certs\") pod \"83b9663c-ffb6-4439-b436-1a29810a6a9b\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") "
Sep 17 22:10:57.926967 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.926930    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-tmp-dir\") pod \"83b9663c-ffb6-4439-b436-1a29810a6a9b\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") "
Sep 17 22:10:57.927206 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.926969    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-home\") pod \"83b9663c-ffb6-4439-b436-1a29810a6a9b\" (UID: \"83b9663c-ffb6-4439-b436-1a29810a6a9b\") "
Sep 17 22:10:57.927206 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.927089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-model-cache" (OuterVolumeSpecName: "model-cache") pod "83b9663c-ffb6-4439-b436-1a29810a6a9b" (UID: "83b9663c-ffb6-4439-b436-1a29810a6a9b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:57.927358 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.927330    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-home" (OuterVolumeSpecName: "home") pod "83b9663c-ffb6-4439-b436-1a29810a6a9b" (UID: "83b9663c-ffb6-4439-b436-1a29810a6a9b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:57.927500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.927336    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:57.927500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.927483    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "83b9663c-ffb6-4439-b436-1a29810a6a9b" (UID: "83b9663c-ffb6-4439-b436-1a29810a6a9b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:57.929269 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.929243    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b9663c-ffb6-4439-b436-1a29810a6a9b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "83b9663c-ffb6-4439-b436-1a29810a6a9b" (UID: "83b9663c-ffb6-4439-b436-1a29810a6a9b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:10:57.929371 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.929284    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-dshm" (OuterVolumeSpecName: "dshm") pod "83b9663c-ffb6-4439-b436-1a29810a6a9b" (UID: "83b9663c-ffb6-4439-b436-1a29810a6a9b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:10:57.929534 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:57.929506    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b9663c-ffb6-4439-b436-1a29810a6a9b-kube-api-access-ldm8p" (OuterVolumeSpecName: "kube-api-access-ldm8p") pod "83b9663c-ffb6-4439-b436-1a29810a6a9b" (UID: "83b9663c-ffb6-4439-b436-1a29810a6a9b"). InnerVolumeSpecName "kube-api-access-ldm8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:10:58.028283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.028251    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:58.028283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.028278    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldm8p\" (UniqueName: \"kubernetes.io/projected/83b9663c-ffb6-4439-b436-1a29810a6a9b-kube-api-access-ldm8p\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:58.028283 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.028288    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83b9663c-ffb6-4439-b436-1a29810a6a9b-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:58.028510 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.028296    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:58.028510 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.028306    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83b9663c-ffb6-4439-b436-1a29810a6a9b-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:10:58.371411 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.371288    2580 generic.go:356] "Generic (PLEG): container finished" podID="83b9663c-ffb6-4439-b436-1a29810a6a9b" containerID="199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf" exitCode=0
Sep 17 22:10:58.371411 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.371333    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"
Sep 17 22:10:58.371411 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.371377    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj" event={"ID":"83b9663c-ffb6-4439-b436-1a29810a6a9b","Type":"ContainerDied","Data":"199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf"}
Sep 17 22:10:58.371723 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.371430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj" event={"ID":"83b9663c-ffb6-4439-b436-1a29810a6a9b","Type":"ContainerDied","Data":"10bec23d762df37dfff1908293020796efc621aeaf82ffbd8e18c0bda54a76fc"}
Sep 17 22:10:58.371723 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.371452    2580 scope.go:117] "RemoveContainer" containerID="199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf"
Sep 17 22:10:58.381418 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.381399    2580 scope.go:117] "RemoveContainer" containerID="199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf"
Sep 17 22:10:58.381712 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:10:58.381688    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf\": container with ID starting with 199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf not found: ID does not exist" containerID="199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf"
Sep 17 22:10:58.381819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.381716    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf"} err="failed to get container status \"199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf\": rpc error: code = NotFound desc = could not find container \"199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf\": container with ID starting with 199113b25f8fe7fe42ce9597c99163780de11636dfb81377ffb1dd307d4abaaf not found: ID does not exist"
Sep 17 22:10:58.397416 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.397381    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"]
Sep 17 22:10:58.405541 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:58.405519    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-dbe8a7/distinct-w4-dbe8a7-kserve-5cb7595968-66mqj"]
Sep 17 22:10:59.025278 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:10:59.025247    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b9663c-ffb6-4439-b436-1a29810a6a9b" path="/var/lib/kubelet/pods/83b9663c-ffb6-4439-b436-1a29810a6a9b/volumes"
Sep 17 22:11:00.578777 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:00.578740    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:00.688459 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:00.688426    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:00.927068 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:00.926968    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"]
Sep 17 22:11:00.927243 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:00.927217    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" containerID="cri-o://2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87" gracePeriod=30
Sep 17 22:11:00.944000 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:00.943962    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:02.745114 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:02.745065    2580 patch_prober.go:28] interesting pod/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 22:11:02.745503 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:02.745156    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 22:11:06.189422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.189396    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 22:11:06.299973 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.299940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-socket\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istiod-ca-cert\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvhnq\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-kube-api-access-qvhnq\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300069    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-certs\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300094    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-envoy\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300133    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-credential-socket\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-podinfo\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300296    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:11:06.300481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-data\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300391    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-token\") pod \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\" (UID: \"acadecce-4d1b-4169-812a-b2d1f1b6c5d1\") "
Sep 17 22:11:06.300481 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:11:06.300873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300468    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:11:06.300873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:11:06.300873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300783    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.300873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300800    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.300873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300809    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.300873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300821    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.300873 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.300850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:11:06.302701 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.302645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:11:06.302701 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.302693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:11:06.302910 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.302889    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-kube-api-access-qvhnq" (OuterVolumeSpecName: "kube-api-access-qvhnq") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "kube-api-access-qvhnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:11:06.303035 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.303017    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acadecce-4d1b-4169-812a-b2d1f1b6c5d1" (UID: "acadecce-4d1b-4169-812a-b2d1f1b6c5d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:11:06.401894 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.401852    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.401894 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.401889    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.401894 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.401899    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvhnq\" (UniqueName: \"kubernetes.io/projected/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-kube-api-access-qvhnq\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.402146 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.401909    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.402146 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.401917    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acadecce-4d1b-4169-812a-b2d1f1b6c5d1-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:11:06.422984 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.422947    2580 generic.go:356] "Generic (PLEG): container finished" podID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerID="2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87" exitCode=0
Sep 17 22:11:06.423167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.423017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" event={"ID":"acadecce-4d1b-4169-812a-b2d1f1b6c5d1","Type":"ContainerDied","Data":"2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87"}
Sep 17 22:11:06.423167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.423075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq" event={"ID":"acadecce-4d1b-4169-812a-b2d1f1b6c5d1","Type":"ContainerDied","Data":"e3fc1d7024dabfb7871cf4e8dfb4ea5ac464e01d72684c24aef6d6825ed6679e"}
Sep 17 22:11:06.423167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.423078    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"
Sep 17 22:11:06.423167 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.423097    2580 scope.go:117] "RemoveContainer" containerID="2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87"
Sep 17 22:11:06.433580 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.433560    2580 scope.go:117] "RemoveContainer" containerID="f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2"
Sep 17 22:11:06.443110 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.443090    2580 scope.go:117] "RemoveContainer" containerID="2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87"
Sep 17 22:11:06.443425 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:11:06.443405    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87\": container with ID starting with 2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87 not found: ID does not exist" containerID="2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87"
Sep 17 22:11:06.443498 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.443435    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87"} err="failed to get container status \"2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87\": rpc error: code = NotFound desc = could not find container \"2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87\": container with ID starting with 2f155264e48bab1212cff54eb1e1f27f66a68a66412681c60c68276dd0ec4e87 not found: ID does not exist"
Sep 17 22:11:06.443498 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.443453    2580 scope.go:117] "RemoveContainer" containerID="f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2"
Sep 17 22:11:06.443740 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:11:06.443723    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2\": container with ID starting with f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2 not found: ID does not exist" containerID="f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2"
Sep 17 22:11:06.443815 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.443745    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2"} err="failed to get container status \"f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2\": rpc error: code = NotFound desc = could not find container \"f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2\": container with ID starting with f4f61e2f9123a2d48eca033d007c0e389ce65165c28be4f8fe31ab0602fa81f2 not found: ID does not exist"
Sep 17 22:11:06.452314 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.452276    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"]
Sep 17 22:11:06.455507 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:06.455483    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-dbe8a7-openshift-default-7c694f9658-wmldq"]
Sep 17 22:11:07.025075 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:07.025044    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" path="/var/lib/kubelet/pods/acadecce-4d1b-4169-812a-b2d1f1b6c5d1/volumes"
Sep 17 22:11:08.544580 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:08.544543    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:11:08.553362 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:08.553339    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:11:08.654439 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:08.654400    2580 scope.go:117] "RemoveContainer" containerID="22f62bd15fd33be19655b24f6a1e2b4520a030abbde49e89db1db325586a86a3"
Sep 17 22:11:12.561625 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:12.561586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:11:18.691545 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:18.691513    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:18.789603 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:18.789562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:20.586127 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:20.586086    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:27.347412 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:27.347375    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:11:37.153606 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:37.153566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:40.556421 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:40.556389    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:11:50.884517 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:50.884480    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:11:53.265995 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:53.265957    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:11:54.389215 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:54.389178    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"]
Sep 17 22:11:54.749813 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:11:54.749722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:12:01.060924 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:01.060882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:12:02.649830 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:02.649798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:12:09.408330 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.408261    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm" podUID="f7f789cf-be48-4c69-87bd-a0af0f69359f" containerName="main" containerID="cri-o://5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c" gracePeriod=45
Sep 17 22:12:09.653832 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.653810    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:12:09.776903 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.776868    2580 generic.go:356] "Generic (PLEG): container finished" podID="f7f789cf-be48-4c69-87bd-a0af0f69359f" containerID="5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c" exitCode=0
Sep 17 22:12:09.777076 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.776910    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"
Sep 17 22:12:09.777076 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.776962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm" event={"ID":"f7f789cf-be48-4c69-87bd-a0af0f69359f","Type":"ContainerDied","Data":"5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c"}
Sep 17 22:12:09.777076 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.777002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm" event={"ID":"f7f789cf-be48-4c69-87bd-a0af0f69359f","Type":"ContainerDied","Data":"710295f8a7976f6216e9c9da9a50bb8720a792d7ffbee31d39255145699d29c4"}
Sep 17 22:12:09.777076 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.777022    2580 scope.go:117] "RemoveContainer" containerID="5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c"
Sep 17 22:12:09.785910 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.785896    2580 scope.go:117] "RemoveContainer" containerID="5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c"
Sep 17 22:12:09.786180 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:12:09.786164    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c\": container with ID starting with 5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c not found: ID does not exist" containerID="5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c"
Sep 17 22:12:09.786227 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.786192    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c"} err="failed to get container status \"5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c\": rpc error: code = NotFound desc = could not find container \"5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c\": container with ID starting with 5f391098afa55b9d96ac4e2fbd91cfbe4e0f473ac75c2fa55e827b3e5f95906c not found: ID does not exist"
Sep 17 22:12:09.790484 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790465    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-home\") pod \"f7f789cf-be48-4c69-87bd-a0af0f69359f\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") "
Sep 17 22:12:09.790550 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790508    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kbvr\" (UniqueName: \"kubernetes.io/projected/f7f789cf-be48-4c69-87bd-a0af0f69359f-kube-api-access-2kbvr\") pod \"f7f789cf-be48-4c69-87bd-a0af0f69359f\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") "
Sep 17 22:12:09.790550 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790531    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f789cf-be48-4c69-87bd-a0af0f69359f-tls-certs\") pod \"f7f789cf-be48-4c69-87bd-a0af0f69359f\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") "
Sep 17 22:12:09.790616 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790604    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-dshm\") pod \"f7f789cf-be48-4c69-87bd-a0af0f69359f\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") "
Sep 17 22:12:09.790651 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790633    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-model-cache\") pod \"f7f789cf-be48-4c69-87bd-a0af0f69359f\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") "
Sep 17 22:12:09.790719 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790650    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-home" (OuterVolumeSpecName: "home") pod "f7f789cf-be48-4c69-87bd-a0af0f69359f" (UID: "f7f789cf-be48-4c69-87bd-a0af0f69359f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:12:09.790719 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790684    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-tmp-dir\") pod \"f7f789cf-be48-4c69-87bd-a0af0f69359f\" (UID: \"f7f789cf-be48-4c69-87bd-a0af0f69359f\") "
Sep 17 22:12:09.790895 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f7f789cf-be48-4c69-87bd-a0af0f69359f" (UID: "f7f789cf-be48-4c69-87bd-a0af0f69359f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:12:09.791018 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.790919    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-model-cache" (OuterVolumeSpecName: "model-cache") pod "f7f789cf-be48-4c69-87bd-a0af0f69359f" (UID: "f7f789cf-be48-4c69-87bd-a0af0f69359f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:12:09.791090 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.791073    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:12:09.791129 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.791106    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:12:09.791129 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.791114    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:12:09.792858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.792837    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f789cf-be48-4c69-87bd-a0af0f69359f-kube-api-access-2kbvr" (OuterVolumeSpecName: "kube-api-access-2kbvr") pod "f7f789cf-be48-4c69-87bd-a0af0f69359f" (UID: "f7f789cf-be48-4c69-87bd-a0af0f69359f"). InnerVolumeSpecName "kube-api-access-2kbvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:12:09.793297 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.793279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-dshm" (OuterVolumeSpecName: "dshm") pod "f7f789cf-be48-4c69-87bd-a0af0f69359f" (UID: "f7f789cf-be48-4c69-87bd-a0af0f69359f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:12:09.793362 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.793292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7f789cf-be48-4c69-87bd-a0af0f69359f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f7f789cf-be48-4c69-87bd-a0af0f69359f" (UID: "f7f789cf-be48-4c69-87bd-a0af0f69359f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:12:09.891733 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.891700    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kbvr\" (UniqueName: \"kubernetes.io/projected/f7f789cf-be48-4c69-87bd-a0af0f69359f-kube-api-access-2kbvr\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:12:09.891733 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.891726    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f789cf-be48-4c69-87bd-a0af0f69359f-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:12:09.891733 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:09.891738    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7f789cf-be48-4c69-87bd-a0af0f69359f-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:12:10.100135 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:10.100106    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"]
Sep 17 22:12:10.104723 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:10.104701    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/auth-test-model-35b181-kserve-5b6f5f9899-xfshm"]
Sep 17 22:12:11.024985 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:11.024945    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7f789cf-be48-4c69-87bd-a0af0f69359f" path="/var/lib/kubelet/pods/f7f789cf-be48-4c69-87bd-a0af0f69359f/volumes"
Sep 17 22:12:16.345827 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:16.345793    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:12:22.893869 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:22.893834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:12:25.966833 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:25.966797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:12:57.131292 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:57.131254    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:12:57.203220 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:12:57.203172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:13:03.156602 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:03.156567    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:13:07.658833 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:07.658797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:13:28.351368 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:28.351322    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:13:41.658447 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:41.658398    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:13:45.139164 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139125    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7823-1d9a9c"]
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139509    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e648961-7526-40c8-b99e-17cb4a1989ab" containerName="maas-api"
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139524    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e648961-7526-40c8-b99e-17cb4a1989ab" containerName="maas-api"
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139534    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy"
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139539    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy"
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139548    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy"
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139554    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy"
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139561    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy"
Sep 17 22:13:45.139569 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139567    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139574    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b9663c-ffb6-4439-b436-1a29810a6a9b" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139580    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b9663c-ffb6-4439-b436-1a29810a6a9b" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139587    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139592    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139597    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" containerName="maas-api"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139602    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" containerName="maas-api"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139607    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7f789cf-be48-4c69-87bd-a0af0f69359f" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139612    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7f789cf-be48-4c69-87bd-a0af0f69359f" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139617    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139621    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139626    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139631    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139638    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139642    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139648    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139667    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139676    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139680    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139686    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139691    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139750    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139758    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139763    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139768    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139772    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139777    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e648961-7526-40c8-b99e-17cb4a1989ab" containerName="maas-api"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139782    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2f6f6f-4c49-4818-9f3e-4fe671e8eab2" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139787    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="acadecce-4d1b-4169-812a-b2d1f1b6c5d1" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139792    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d6ac83-72c5-4025-936a-b44407a32fde" containerName="istio-proxy"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139798    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b9663c-ffb6-4439-b436-1a29810a6a9b" containerName="main"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139803    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ab00f7-ff77-48dd-a708-8345dd8e1cd1" containerName="maas-api"
Sep 17 22:13:45.139867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.139808    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7f789cf-be48-4c69-87bd-a0af0f69359f" containerName="main"
Sep 17 22:13:45.142819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.142802    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-1d9a9c"
Sep 17 22:13:45.145538 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.145512    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lbp7g\""
Sep 17 22:13:45.150104 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.150078    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7823-1d9a9c"]
Sep 17 22:13:45.267679 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.267627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc85v\" (UniqueName: \"kubernetes.io/projected/8131b7a9-af4d-4a68-99fe-15ec9e80c9cc-kube-api-access-pc85v\") pod \"test-curl-7823-1d9a9c\" (UID: \"8131b7a9-af4d-4a68-99fe-15ec9e80c9cc\") " pod="opendatahub/test-curl-7823-1d9a9c"
Sep 17 22:13:45.368591 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.368536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc85v\" (UniqueName: \"kubernetes.io/projected/8131b7a9-af4d-4a68-99fe-15ec9e80c9cc-kube-api-access-pc85v\") pod \"test-curl-7823-1d9a9c\" (UID: \"8131b7a9-af4d-4a68-99fe-15ec9e80c9cc\") " pod="opendatahub/test-curl-7823-1d9a9c"
Sep 17 22:13:45.378549 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.378519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc85v\" (UniqueName: \"kubernetes.io/projected/8131b7a9-af4d-4a68-99fe-15ec9e80c9cc-kube-api-access-pc85v\") pod \"test-curl-7823-1d9a9c\" (UID: \"8131b7a9-af4d-4a68-99fe-15ec9e80c9cc\") " pod="opendatahub/test-curl-7823-1d9a9c"
Sep 17 22:13:45.454019 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.453927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-1d9a9c"
Sep 17 22:13:45.728235 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:45.728173    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7823-1d9a9c"]
Sep 17 22:13:45.730505 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:13:45.730479    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8131b7a9_af4d_4a68_99fe_15ec9e80c9cc.slice/crio-92f1a3de6924bb31288bf2399fd5b99d6a6eef529ddc33362faf41ff2d34fa27 WatchSource:0}: Error finding container 92f1a3de6924bb31288bf2399fd5b99d6a6eef529ddc33362faf41ff2d34fa27: Status 404 returned error can't find the container with id 92f1a3de6924bb31288bf2399fd5b99d6a6eef529ddc33362faf41ff2d34fa27
Sep 17 22:13:46.324954 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:46.324914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7823-1d9a9c" event={"ID":"8131b7a9-af4d-4a68-99fe-15ec9e80c9cc","Type":"ContainerStarted","Data":"ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652"}
Sep 17 22:13:46.325347 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:46.324963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7823-1d9a9c" event={"ID":"8131b7a9-af4d-4a68-99fe-15ec9e80c9cc","Type":"ContainerStarted","Data":"92f1a3de6924bb31288bf2399fd5b99d6a6eef529ddc33362faf41ff2d34fa27"}
Sep 17 22:13:46.343207 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:46.343151    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7823-1d9a9c" podStartSLOduration=1.3431350690000001 podStartE2EDuration="1.343135069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:13:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:13:46.342259323 +0000 UTC m=+1959.863824253" watchObservedRunningTime="2026-09-17 22:13:46.343135069 +0000 UTC m=+1959.864699998"
Sep 17 22:13:46.962685 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:46.962632    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7823-1d9a9c"]
Sep 17 22:13:46.966947 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:46.966920    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7823-1d9a9c"]
Sep 17 22:13:47.097292 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097257    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7823-7f77ea"]
Sep 17 22:13:47.097613 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097601    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8131b7a9-af4d-4a68-99fe-15ec9e80c9cc" containerName="test-curl-7823-1d9a9c"
Sep 17 22:13:47.097698 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097615    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8131b7a9-af4d-4a68-99fe-15ec9e80c9cc" containerName="test-curl-7823-1d9a9c"
Sep 17 22:13:47.097698 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097641    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy"
Sep 17 22:13:47.097698 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097646    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy"
Sep 17 22:13:47.097819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097735    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8131b7a9-af4d-4a68-99fe-15ec9e80c9cc" containerName="test-curl-7823-1d9a9c"
Sep 17 22:13:47.097819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097743    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcfb706-ff10-49d4-97c0-00c8c748883a" containerName="istio-proxy"
Sep 17 22:13:47.097819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097749    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2041e834-fb0a-485b-a789-4bd5c80cccf0" containerName="istio-proxy"
Sep 17 22:13:47.097819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.097755    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e69067-67f5-4b03-a10b-dd17c2d1b7d2" containerName="istio-proxy"
Sep 17 22:13:47.100854 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.100838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-7f77ea"
Sep 17 22:13:47.109683 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.109637    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7823-7f77ea"]
Sep 17 22:13:47.185600 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.185563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-594dj\" (UniqueName: \"kubernetes.io/projected/d3a85672-c52a-4345-ba09-b70a96d7b689-kube-api-access-594dj\") pod \"test-curl-7823-7f77ea\" (UID: \"d3a85672-c52a-4345-ba09-b70a96d7b689\") " pod="opendatahub/test-curl-7823-7f77ea"
Sep 17 22:13:47.287124 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.287085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-594dj\" (UniqueName: \"kubernetes.io/projected/d3a85672-c52a-4345-ba09-b70a96d7b689-kube-api-access-594dj\") pod \"test-curl-7823-7f77ea\" (UID: \"d3a85672-c52a-4345-ba09-b70a96d7b689\") " pod="opendatahub/test-curl-7823-7f77ea"
Sep 17 22:13:47.296160 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.296123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-594dj\" (UniqueName: \"kubernetes.io/projected/d3a85672-c52a-4345-ba09-b70a96d7b689-kube-api-access-594dj\") pod \"test-curl-7823-7f77ea\" (UID: \"d3a85672-c52a-4345-ba09-b70a96d7b689\") " pod="opendatahub/test-curl-7823-7f77ea"
Sep 17 22:13:47.329974 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:13:47.329947    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7823-1d9a9c" container="test-curl-7823-1d9a9c"
Sep 17 22:13:47.411483 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.411382    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-7f77ea"
Sep 17 22:13:47.683684 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:47.683639    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7823-7f77ea"]
Sep 17 22:13:47.685450 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:13:47.685420    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3a85672_c52a_4345_ba09_b70a96d7b689.slice/crio-47bdf513e6af2a9578895373268e0c39f7ee9ec70f9b70c08a1078ac55541c9b WatchSource:0}: Error finding container 47bdf513e6af2a9578895373268e0c39f7ee9ec70f9b70c08a1078ac55541c9b: Status 404 returned error can't find the container with id 47bdf513e6af2a9578895373268e0c39f7ee9ec70f9b70c08a1078ac55541c9b
Sep 17 22:13:48.341300 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:48.341262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7823-7f77ea" event={"ID":"d3a85672-c52a-4345-ba09-b70a96d7b689","Type":"ContainerStarted","Data":"6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47"}
Sep 17 22:13:48.341787 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:48.341310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7823-7f77ea" event={"ID":"d3a85672-c52a-4345-ba09-b70a96d7b689","Type":"ContainerStarted","Data":"47bdf513e6af2a9578895373268e0c39f7ee9ec70f9b70c08a1078ac55541c9b"}
Sep 17 22:13:48.341787 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:48.341430    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7823-1d9a9c" podUID="8131b7a9-af4d-4a68-99fe-15ec9e80c9cc" containerName="test-curl-7823-1d9a9c" containerID="cri-o://ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652" gracePeriod=2
Sep 17 22:13:48.356455 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:48.356409    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7823-7f77ea" podStartSLOduration=1.35639388 podStartE2EDuration="1.35639388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:13:48.355626377 +0000 UTC m=+1961.877191309" watchObservedRunningTime="2026-09-17 22:13:48.35639388 +0000 UTC m=+1961.877958821"
Sep 17 22:13:48.964857 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:48.964821    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7823-7f77ea"]
Sep 17 22:13:48.971550 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:48.971518    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7823-7f77ea"]
Sep 17 22:13:49.346748 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:13:49.346716    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7823-7f77ea" container="test-curl-7823-7f77ea"
Sep 17 22:13:50.352301 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:50.352258    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7823-7f77ea" podUID="d3a85672-c52a-4345-ba09-b70a96d7b689" containerName="test-curl-7823-7f77ea" containerID="cri-o://6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47" gracePeriod=2
Sep 17 22:13:50.519058 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:50.519030    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-1d9a9c"
Sep 17 22:13:50.621079 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:50.620986    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc85v\" (UniqueName: \"kubernetes.io/projected/8131b7a9-af4d-4a68-99fe-15ec9e80c9cc-kube-api-access-pc85v\") pod \"8131b7a9-af4d-4a68-99fe-15ec9e80c9cc\" (UID: \"8131b7a9-af4d-4a68-99fe-15ec9e80c9cc\") "
Sep 17 22:13:50.623261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:50.623236    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8131b7a9-af4d-4a68-99fe-15ec9e80c9cc-kube-api-access-pc85v" (OuterVolumeSpecName: "kube-api-access-pc85v") pod "8131b7a9-af4d-4a68-99fe-15ec9e80c9cc" (UID: "8131b7a9-af4d-4a68-99fe-15ec9e80c9cc"). InnerVolumeSpecName "kube-api-access-pc85v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:13:50.722087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:50.722045    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc85v\" (UniqueName: \"kubernetes.io/projected/8131b7a9-af4d-4a68-99fe-15ec9e80c9cc-kube-api-access-pc85v\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:13:51.024619 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:51.024577    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8131b7a9-af4d-4a68-99fe-15ec9e80c9cc" path="/var/lib/kubelet/pods/8131b7a9-af4d-4a68-99fe-15ec9e80c9cc/volumes"
Sep 17 22:13:51.105970 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:51.105931    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:13:51.358979 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:51.358890    2580 generic.go:356] "Generic (PLEG): container finished" podID="8131b7a9-af4d-4a68-99fe-15ec9e80c9cc" containerID="ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652" exitCode=137
Sep 17 22:13:51.358979 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:51.358929    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-1d9a9c"
Sep 17 22:13:51.359406 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:51.358988    2580 scope.go:117] "RemoveContainer" containerID="ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652"
Sep 17 22:13:51.367823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:51.367803    2580 scope.go:117] "RemoveContainer" containerID="ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652"
Sep 17 22:13:51.368094 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:13:51.368070    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652\": container with ID starting with ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652 not found: ID does not exist" containerID="ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652"
Sep 17 22:13:51.368159 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:51.368102    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652"} err="failed to get container status \"ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652\": rpc error: code = NotFound desc = could not find container \"ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652\": container with ID starting with ae25ed73204e0c6ca65f99499eb10d89df6804a8af60607f433f970bab4e7652 not found: ID does not exist"
Sep 17 22:13:52.064252 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:52.064219    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:13:52.544076 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:52.544045    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-7f77ea"
Sep 17 22:13:52.639728 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:52.639607    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-594dj\" (UniqueName: \"kubernetes.io/projected/d3a85672-c52a-4345-ba09-b70a96d7b689-kube-api-access-594dj\") pod \"d3a85672-c52a-4345-ba09-b70a96d7b689\" (UID: \"d3a85672-c52a-4345-ba09-b70a96d7b689\") "
Sep 17 22:13:52.641798 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:52.641770    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3a85672-c52a-4345-ba09-b70a96d7b689-kube-api-access-594dj" (OuterVolumeSpecName: "kube-api-access-594dj") pod "d3a85672-c52a-4345-ba09-b70a96d7b689" (UID: "d3a85672-c52a-4345-ba09-b70a96d7b689"). InnerVolumeSpecName "kube-api-access-594dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:13:52.740826 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:52.740781    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-594dj\" (UniqueName: \"kubernetes.io/projected/d3a85672-c52a-4345-ba09-b70a96d7b689-kube-api-access-594dj\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:13:53.024737 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:53.024702    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3a85672-c52a-4345-ba09-b70a96d7b689" path="/var/lib/kubelet/pods/d3a85672-c52a-4345-ba09-b70a96d7b689/volumes"
Sep 17 22:13:53.372982 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:53.372896    2580 generic.go:356] "Generic (PLEG): container finished" podID="d3a85672-c52a-4345-ba09-b70a96d7b689" containerID="6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47" exitCode=137
Sep 17 22:13:53.372982 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:53.372944    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7823-7f77ea"
Sep 17 22:13:53.373189 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:53.372997    2580 scope.go:117] "RemoveContainer" containerID="6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47"
Sep 17 22:13:53.382094 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:53.382074    2580 scope.go:117] "RemoveContainer" containerID="6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47"
Sep 17 22:13:53.382413 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:13:53.382381    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47\": container with ID starting with 6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47 not found: ID does not exist" containerID="6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47"
Sep 17 22:13:53.382461 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:53.382418    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47"} err="failed to get container status \"6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47\": rpc error: code = NotFound desc = could not find container \"6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47\": container with ID starting with 6fbacdae300f961ee3eb07289d83512da64461f74eb8dd040b2f9c9ad0eb8a47 not found: ID does not exist"
Sep 17 22:13:55.549598 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:13:55.549563    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:14:09.896997 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:09.896964    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:14:13.553198 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:13.553162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:14:33.070450 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.070416    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"]
Sep 17 22:14:33.070858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.070801    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3a85672-c52a-4345-ba09-b70a96d7b689" containerName="test-curl-7823-7f77ea"
Sep 17 22:14:33.070858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.070813    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3a85672-c52a-4345-ba09-b70a96d7b689" containerName="test-curl-7823-7f77ea"
Sep 17 22:14:33.070954 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.070875    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3a85672-c52a-4345-ba09-b70a96d7b689" containerName="test-curl-7823-7f77ea"
Sep 17 22:14:33.074041 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.074021    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.078583 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.078563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"default-dockercfg-r8vjk\""
Sep 17 22:14:33.078727 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.078563    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"openshift-service-ca.crt\""
Sep 17 22:14:33.078727 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.078613    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"rate-test-model-35b181-kserve-self-signed-certs\""
Sep 17 22:14:33.078727 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.078586    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-35b181\"/\"kube-root-ca.crt\""
Sep 17 22:14:33.097891 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.097865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"]
Sep 17 22:14:33.113453 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.113418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:14:33.213097 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.213053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-dshm\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.213097 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.213100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwwbt\" (UniqueName: \"kubernetes.io/projected/56d579e5-168d-458c-81c0-0a90c8790677-kube-api-access-vwwbt\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.213385 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.213139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-tmp-dir\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.213385 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.213187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-model-cache\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.213385 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.213207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d579e5-168d-458c-81c0-0a90c8790677-tls-certs\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.213385 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.213260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-home\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.314799 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.314759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-dshm\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.314799 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.314798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwwbt\" (UniqueName: \"kubernetes.io/projected/56d579e5-168d-458c-81c0-0a90c8790677-kube-api-access-vwwbt\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.315043 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.314926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-tmp-dir\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.315043 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.314980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-model-cache\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.315043 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.315006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d579e5-168d-458c-81c0-0a90c8790677-tls-certs\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.315213 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.315044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-home\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.315349 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.315328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-tmp-dir\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.315419 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.315368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-model-cache\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.315419 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.315390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-home\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.317168 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.317150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-dshm\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.317562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.317547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d579e5-168d-458c-81c0-0a90c8790677-tls-certs\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.323941 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.323885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwwbt\" (UniqueName: \"kubernetes.io/projected/56d579e5-168d-458c-81c0-0a90c8790677-kube-api-access-vwwbt\") pod \"rate-test-model-35b181-kserve-569d5bc7c9-g4wj4\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") " pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.383022 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.382985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:33.664911 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:33.664886    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"]
Sep 17 22:14:33.666613 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:14:33.666588    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56d579e5_168d_458c_81c0_0a90c8790677.slice/crio-79e8833d5738d34734a3277ba9904ba82cad7187ad75650e08c8cb14e3d507db WatchSource:0}: Error finding container 79e8833d5738d34734a3277ba9904ba82cad7187ad75650e08c8cb14e3d507db: Status 404 returned error can't find the container with id 79e8833d5738d34734a3277ba9904ba82cad7187ad75650e08c8cb14e3d507db
Sep 17 22:14:34.606316 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:34.606265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4" event={"ID":"56d579e5-168d-458c-81c0-0a90c8790677","Type":"ContainerStarted","Data":"de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3"}
Sep 17 22:14:34.606316 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:34.606323    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4" event={"ID":"56d579e5-168d-458c-81c0-0a90c8790677","Type":"ContainerStarted","Data":"79e8833d5738d34734a3277ba9904ba82cad7187ad75650e08c8cb14e3d507db"}
Sep 17 22:14:34.625865 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:34.625816    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4" podStartSLOduration=1.625800199 podStartE2EDuration="1.625800199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:14:34.62455114 +0000 UTC m=+2008.146116069" watchObservedRunningTime="2026-09-17 22:14:34.625800199 +0000 UTC m=+2008.147365133"
Sep 17 22:14:36.957858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:36.957822    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:14:36.997226 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:36.997189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:14:43.167346 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:43.167308    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:14:43.269516 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:43.269484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:14:43.384036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:43.384000    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:43.384036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:43.384046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:43.397006 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:43.396978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:43.666668 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:43.666636    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:14:55.084750 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:14:55.084714    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:15:04.851614 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:04.851572    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:15:11.349779 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:11.349736    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:12.345603 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:12.345566    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"]
Sep 17 22:15:12.360369 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:12.360336    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:12.801695 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:12.801643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:13.182709 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:13.182594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:13.578647 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:13.578608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:14.004103 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:14.003988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:16.116963 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:16.116892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:16.371178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:16.371091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:15:16.794815 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:16.794772    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:16.896821 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:16.896789    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:17.174445 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:17.174341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:18.182114 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:18.182079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:19.130085 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.130045    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"]
Sep 17 22:15:19.134379 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.134357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.137480 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.137457    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a71836-serving-cert\""
Sep 17 22:15:19.145703 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.145672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"]
Sep 17 22:15:19.177091 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.177064    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:19.249182 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.249126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-metrics-certs\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.249687 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.249214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/442732f6-7e88-4b96-af4f-8349944032ba-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.249687 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.249295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lcj6\" (UniqueName: \"kubernetes.io/projected/442732f6-7e88-4b96-af4f-8349944032ba-kube-api-access-6lcj6\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.249687 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.249399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.277568 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.277531    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:19.350902 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.350863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/442732f6-7e88-4b96-af4f-8349944032ba-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.350902 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.350903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lcj6\" (UniqueName: \"kubernetes.io/projected/442732f6-7e88-4b96-af4f-8349944032ba-kube-api-access-6lcj6\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.351177 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.350953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.351177 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.350995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-metrics-certs\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.351177 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:15:19.351094    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-serving-cert: secret "maas-api-e2e-ipp-a-a71836-serving-cert" not found
Sep 17 22:15:19.351177 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:15:19.351178    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls podName:442732f6-7e88-4b96-af4f-8349944032ba nodeName:}" failed. No retries permitted until 2026-09-17 22:15:19.851157167 +0000 UTC m=+2053.372722080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls") pod "maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" (UID: "442732f6-7e88-4b96-af4f-8349944032ba") : secret "maas-api-e2e-ipp-a-a71836-serving-cert" not found
Sep 17 22:15:19.351623 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.351599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/442732f6-7e88-4b96-af4f-8349944032ba-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.353567 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.353549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-metrics-certs\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.361401 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.361375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lcj6\" (UniqueName: \"kubernetes.io/projected/442732f6-7e88-4b96-af4f-8349944032ba-kube-api-access-6lcj6\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.714710 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.714675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:19.824193 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.824155    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:19.856072 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:19.856041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:19.856246 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:15:19.856185    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-serving-cert: secret "maas-api-e2e-ipp-a-a71836-serving-cert" not found
Sep 17 22:15:19.856296 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:15:19.856252    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls podName:442732f6-7e88-4b96-af4f-8349944032ba nodeName:}" failed. No retries permitted until 2026-09-17 22:15:20.856236013 +0000 UTC m=+2054.377800921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls") pod "maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" (UID: "442732f6-7e88-4b96-af4f-8349944032ba") : secret "maas-api-e2e-ipp-a-a71836-serving-cert" not found
Sep 17 22:15:20.133509 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:20.133464    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:20.864433 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:20.864396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:20.866943 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:20.866923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a71836-845769c867-7vlfr\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:20.947734 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:20.947679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:21.224357 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:21.224329    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"]
Sep 17 22:15:21.225537 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:15:21.225509    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442732f6_7e88_4b96_af4f_8349944032ba.slice/crio-6144916ccf7fb9b8fc868d90fda5f8f5a3cf17b0861052de334b740385088664 WatchSource:0}: Error finding container 6144916ccf7fb9b8fc868d90fda5f8f5a3cf17b0861052de334b740385088664: Status 404 returned error can't find the container with id 6144916ccf7fb9b8fc868d90fda5f8f5a3cf17b0861052de334b740385088664
Sep 17 22:15:21.227210 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:21.227187    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 22:15:21.868226 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:21.868197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" event={"ID":"442732f6-7e88-4b96-af4f-8349944032ba","Type":"ContainerStarted","Data":"6144916ccf7fb9b8fc868d90fda5f8f5a3cf17b0861052de334b740385088664"}
Sep 17 22:15:22.875455 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:22.875422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" event={"ID":"442732f6-7e88-4b96-af4f-8349944032ba","Type":"ContainerStarted","Data":"f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2"}
Sep 17 22:15:22.875887 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:22.875533    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:22.897320 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:22.897262    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" podStartSLOduration=3.260343742 podStartE2EDuration="3.897246329s" totalImagesPullingTime="636.902587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:15:22.893993484 +0000 UTC m=+2056.415558431" watchObservedRunningTime="2026-09-17 22:15:22.897246329 +0000 UTC m=+2056.418811317"
Sep 17 22:15:27.364983 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.364915    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4" podUID="56d579e5-168d-458c-81c0-0a90c8790677" containerName="main" containerID="cri-o://de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3" gracePeriod=45
Sep 17 22:15:27.616759 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.616692    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:15:27.624725 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.624704    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-dshm\") pod \"56d579e5-168d-458c-81c0-0a90c8790677\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") "
Sep 17 22:15:27.624822 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.624780    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-home\") pod \"56d579e5-168d-458c-81c0-0a90c8790677\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") "
Sep 17 22:15:27.624822 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.624814    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-model-cache\") pod \"56d579e5-168d-458c-81c0-0a90c8790677\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") "
Sep 17 22:15:27.624895 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.624831    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-tmp-dir\") pod \"56d579e5-168d-458c-81c0-0a90c8790677\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") "
Sep 17 22:15:27.624895 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.624866    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d579e5-168d-458c-81c0-0a90c8790677-tls-certs\") pod \"56d579e5-168d-458c-81c0-0a90c8790677\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") "
Sep 17 22:15:27.624965 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.624899    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwwbt\" (UniqueName: \"kubernetes.io/projected/56d579e5-168d-458c-81c0-0a90c8790677-kube-api-access-vwwbt\") pod \"56d579e5-168d-458c-81c0-0a90c8790677\" (UID: \"56d579e5-168d-458c-81c0-0a90c8790677\") "
Sep 17 22:15:27.625105 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.625072    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-home" (OuterVolumeSpecName: "home") pod "56d579e5-168d-458c-81c0-0a90c8790677" (UID: "56d579e5-168d-458c-81c0-0a90c8790677"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:15:27.625105 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.625081    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "56d579e5-168d-458c-81c0-0a90c8790677" (UID: "56d579e5-168d-458c-81c0-0a90c8790677"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:15:27.625256 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.625098    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-model-cache" (OuterVolumeSpecName: "model-cache") pod "56d579e5-168d-458c-81c0-0a90c8790677" (UID: "56d579e5-168d-458c-81c0-0a90c8790677"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:15:27.626920 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.626902    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-dshm" (OuterVolumeSpecName: "dshm") pod "56d579e5-168d-458c-81c0-0a90c8790677" (UID: "56d579e5-168d-458c-81c0-0a90c8790677"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:15:27.627048 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.627027    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d579e5-168d-458c-81c0-0a90c8790677-kube-api-access-vwwbt" (OuterVolumeSpecName: "kube-api-access-vwwbt") pod "56d579e5-168d-458c-81c0-0a90c8790677" (UID: "56d579e5-168d-458c-81c0-0a90c8790677"). InnerVolumeSpecName "kube-api-access-vwwbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:15:27.627102 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.627085    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d579e5-168d-458c-81c0-0a90c8790677-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "56d579e5-168d-458c-81c0-0a90c8790677" (UID: "56d579e5-168d-458c-81c0-0a90c8790677"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:15:27.726254 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.726219    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:15:27.726254 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.726252    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:15:27.726254 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.726263    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d579e5-168d-458c-81c0-0a90c8790677-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:15:27.726519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.726275    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwwbt\" (UniqueName: \"kubernetes.io/projected/56d579e5-168d-458c-81c0-0a90c8790677-kube-api-access-vwwbt\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:15:27.726519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.726285    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:15:27.726519 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.726296    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d579e5-168d-458c-81c0-0a90c8790677-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:15:27.904325 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.904233    2580 generic.go:356] "Generic (PLEG): container finished" podID="56d579e5-168d-458c-81c0-0a90c8790677" containerID="de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3" exitCode=0
Sep 17 22:15:27.904325 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.904274    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"
Sep 17 22:15:27.904325 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.904291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4" event={"ID":"56d579e5-168d-458c-81c0-0a90c8790677","Type":"ContainerDied","Data":"de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3"}
Sep 17 22:15:27.904325 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.904325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4" event={"ID":"56d579e5-168d-458c-81c0-0a90c8790677","Type":"ContainerDied","Data":"79e8833d5738d34734a3277ba9904ba82cad7187ad75650e08c8cb14e3d507db"}
Sep 17 22:15:27.904638 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.904342    2580 scope.go:117] "RemoveContainer" containerID="de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3"
Sep 17 22:15:27.914337 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.914320    2580 scope.go:117] "RemoveContainer" containerID="de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3"
Sep 17 22:15:27.914610 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:15:27.914591    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3\": container with ID starting with de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3 not found: ID does not exist" containerID="de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3"
Sep 17 22:15:27.914672 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.914619    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3"} err="failed to get container status \"de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3\": rpc error: code = NotFound desc = could not find container \"de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3\": container with ID starting with de6a44535da5206eade9ac38e6705504e34343d4a5e5bc527fb25b24c59705b3 not found: ID does not exist"
Sep 17 22:15:27.926307 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.926284    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"]
Sep 17 22:15:27.930239 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:27.930216    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-35b181/rate-test-model-35b181-kserve-569d5bc7c9-g4wj4"]
Sep 17 22:15:28.886325 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:28.886252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:15:29.025029 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:29.024997    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d579e5-168d-458c-81c0-0a90c8790677" path="/var/lib/kubelet/pods/56d579e5-168d-458c-81c0-0a90c8790677/volumes"
Sep 17 22:15:32.169213 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:32.169176    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:15:42.441282 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:42.441242    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:43.213007 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:43.212966    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:43.972979 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:43.972946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:44.753899 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:44.753870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:46.937645 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:46.937610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:47.649331 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:47.649301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:48.002224 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:48.002129    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:48.250958 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:48.250926    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:50.233240 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:50.233202    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:50.955717 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:50.955650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:51.056071 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:51.056043    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:51.155842 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:51.155811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:52.069932 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:52.069894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:53.048649 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.048612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:53.854196 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.854162    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"]
Sep 17 22:15:53.854711 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.854553    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d579e5-168d-458c-81c0-0a90c8790677" containerName="main"
Sep 17 22:15:53.854711 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.854568    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d579e5-168d-458c-81c0-0a90c8790677" containerName="main"
Sep 17 22:15:53.854821 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.854721    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d579e5-168d-458c-81c0-0a90c8790677" containerName="main"
Sep 17 22:15:53.861130 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.861105    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:53.864548 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.864523    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-813cee-serving-cert\""
Sep 17 22:15:53.873809 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.873782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"]
Sep 17 22:15:53.894248 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.894216    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:53.969237 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.969194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx78n\" (UniqueName: \"kubernetes.io/projected/69e7f7cf-3b7e-434b-ab47-e88a3f625670-kube-api-access-hx78n\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:53.969414 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.969263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:53.969414 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.969328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69e7f7cf-3b7e-434b-ab47-e88a3f625670-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:53.969508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.969411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-metrics-certs\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:53.990741 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:53.990711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:54.070508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.070467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx78n\" (UniqueName: \"kubernetes.io/projected/69e7f7cf-3b7e-434b-ab47-e88a3f625670-kube-api-access-hx78n\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.070508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.070509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.070792 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.070574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69e7f7cf-3b7e-434b-ab47-e88a3f625670-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.070792 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.070609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-metrics-certs\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.070792 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:15:54.070775    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-serving-cert: secret "maas-api-e2e-ipp-b-813cee-serving-cert" not found
Sep 17 22:15:54.070961 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:15:54.070858    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls podName:69e7f7cf-3b7e-434b-ab47-e88a3f625670 nodeName:}" failed. No retries permitted until 2026-09-17 22:15:54.570834647 +0000 UTC m=+2088.092399574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls") pod "maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl" (UID: "69e7f7cf-3b7e-434b-ab47-e88a3f625670") : secret "maas-api-e2e-ipp-b-813cee-serving-cert" not found
Sep 17 22:15:54.071329 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.071299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69e7f7cf-3b7e-434b-ab47-e88a3f625670-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.073306 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.073281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-metrics-certs\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.087165 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.087132    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx78n\" (UniqueName: \"kubernetes.io/projected/69e7f7cf-3b7e-434b-ab47-e88a3f625670-kube-api-access-hx78n\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.546204 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.546143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:54.575639 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.575602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.578361 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.578333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls\") pod \"maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:54.643770 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.643736    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:54.734886 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.734853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:15:54.771947 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:54.771914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:55.065706 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:55.065682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"]
Sep 17 22:15:55.068032 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:15:55.068000    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e7f7cf_3b7e_434b_ab47_e88a3f625670.slice/crio-19a55f1170694d79c8d9e999ef2f46b61095efdd5c968c93146bb7beed3ebf2d WatchSource:0}: Error finding container 19a55f1170694d79c8d9e999ef2f46b61095efdd5c968c93146bb7beed3ebf2d: Status 404 returned error can't find the container with id 19a55f1170694d79c8d9e999ef2f46b61095efdd5c968c93146bb7beed3ebf2d
Sep 17 22:15:56.075288 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:56.075255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl" event={"ID":"69e7f7cf-3b7e-434b-ab47-e88a3f625670","Type":"ContainerStarted","Data":"8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611"}
Sep 17 22:15:56.075719 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:56.075304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl" event={"ID":"69e7f7cf-3b7e-434b-ab47-e88a3f625670","Type":"ContainerStarted","Data":"19a55f1170694d79c8d9e999ef2f46b61095efdd5c968c93146bb7beed3ebf2d"}
Sep 17 22:15:56.075719 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:56.075377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:15:56.096410 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:56.096351    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl" podStartSLOduration=2.77233457 podStartE2EDuration="3.096306552s" totalImagesPullingTime="323.971982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:15:56.096116077 +0000 UTC m=+2089.617681018" watchObservedRunningTime="2026-09-17 22:15:56.096306552 +0000 UTC m=+2089.617871482"
Sep 17 22:15:58.261969 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:15:58.261936    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:16:02.085869 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:02.085841    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:16:08.583123 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:08.583098    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:16:08.593400 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:08.593372    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:16:08.750703 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:08.750644    2580 scope.go:117] "RemoveContainer" containerID="13213727bf4e651a80b75321bb47b5d9d98a4026de5455621edf0e9226d787ae"
Sep 17 22:16:19.064356 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:19.064319    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:19.999874 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:19.999833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:20.864990 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:20.864956    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:21.120473 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:21.120380    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:22.116437 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:22.116396    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:23.136768 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:23.136732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:32.166346 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:32.166300    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:36.500432 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:36.500393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:16:38.533452 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:38.533409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:51.928516 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:51.928478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:53.862783 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:53.862740    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:16:56.464465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:16:56.464432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:17:03.436471 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.436390    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:03.827611 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.827573    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"]
Sep 17 22:17:03.831074 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.831059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.836092 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.836069    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-2e0396-openshift-default-dockercfg-8mbsw\""
Sep 17 22:17:03.904510 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.904450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"]
Sep 17 22:17:03.934610 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-socket\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.934834 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-credential-socket\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.934834 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lxph\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-kube-api-access-7lxph\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.934834 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-data\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.934834 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-token\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.935050 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-podinfo\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.935050 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-certs\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.935050 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bcfaa96-9853-4005-99c8-221dd3dc735f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:03.935050 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:03.934938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-envoy\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.035759 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.035720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-socket\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.035759 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.035765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-credential-socket\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036032 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.035805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lxph\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-kube-api-access-7lxph\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036032 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.035826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-data\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036032 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.035847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-token\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036032 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.035986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-podinfo\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-certs\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bcfaa96-9853-4005-99c8-221dd3dc735f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-socket\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-credential-socket\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036261 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-envoy\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-data\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-certs\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.036772 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.036742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bcfaa96-9853-4005-99c8-221dd3dc735f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.038534 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.038516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-envoy\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.038816 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.038794    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-podinfo\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.046207 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.046181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-token\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.046515 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.046485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lxph\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-kube-api-access-7lxph\") pod \"e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") " pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.141045 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.140913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:04.444422 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.444390    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"]
Sep 17 22:17:04.446604 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:17:04.446577    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcfaa96_9853_4005_99c8_221dd3dc735f.slice/crio-8b9f7d60a0cf0998729c0dcd42408b8caa467397bac5594a230668655e0ebb5c WatchSource:0}: Error finding container 8b9f7d60a0cf0998729c0dcd42408b8caa467397bac5594a230668655e0ebb5c: Status 404 returned error can't find the container with id 8b9f7d60a0cf0998729c0dcd42408b8caa467397bac5594a230668655e0ebb5c
Sep 17 22:17:04.449097 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.449057    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:17:04.449183 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.449163    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:17:04.449228 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.449215    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:17:04.453480 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.453458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" event={"ID":"7bcfaa96-9853-4005-99c8-221dd3dc735f","Type":"ContainerStarted","Data":"8b9f7d60a0cf0998729c0dcd42408b8caa467397bac5594a230668655e0ebb5c"}
Sep 17 22:17:04.559120 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:04.559078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:05.460555 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:05.460511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" event={"ID":"7bcfaa96-9853-4005-99c8-221dd3dc735f","Type":"ContainerStarted","Data":"0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac"}
Sep 17 22:17:05.488866 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:05.488813    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podStartSLOduration=2.488795607 podStartE2EDuration="2.488795607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:17:05.487359598 +0000 UTC m=+2159.008924544" watchObservedRunningTime="2026-09-17 22:17:05.488795607 +0000 UTC m=+2159.010360537"
Sep 17 22:17:06.141508 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:06.141463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:06.147593 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:06.147561    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:06.466477 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:06.466378    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:06.467358 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:06.467341    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:06.911068 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:06.911029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:07.511626 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:07.511592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:07.650003 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:07.649954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:08.062815 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:08.062779    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:09.308680 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:09.308618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:10.125943 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:10.125904    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:11.140178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:11.140137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:12.061315 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:12.061262    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:12.157421 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:12.157385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:12.259889 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:12.259854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:12.645830 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:12.645791    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:12.742388 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:12.742355    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:16.969946 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:16.969909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:17:27.589131 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:27.589095    2580 generic.go:356] "Generic (PLEG): container finished" podID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerID="0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac" exitCode=0
Sep 17 22:17:27.589589 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:27.589171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" event={"ID":"7bcfaa96-9853-4005-99c8-221dd3dc735f","Type":"ContainerDied","Data":"0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac"}
Sep 17 22:17:27.589669 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:27.589627    2580 scope.go:117] "RemoveContainer" containerID="0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac"
Sep 17 22:17:27.590928 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:27.590898    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:17:27.591030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:27.590964    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:17:27.591030 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:27.590994    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892136Ki","pods":"250"}
Sep 17 22:17:28.597279 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:28.597244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" event={"ID":"7bcfaa96-9853-4005-99c8-221dd3dc735f","Type":"ContainerStarted","Data":"a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3"}
Sep 17 22:17:29.141451 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:29.141414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:29.141711 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:29.141691    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 17 22:17:29.141778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:29.141739    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 17 22:17:30.141743 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:30.141711    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 17 22:17:30.142128 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:30.141767    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 17 22:17:31.141514 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:31.141471    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 17 22:17:31.141765 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:31.141537    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 17 22:17:32.141946 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:32.141898    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 17 22:17:32.142356 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:32.141977    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 17 22:17:33.142071 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:33.142029    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 17 22:17:33.142484 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:33.142088    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 17 22:17:34.141241 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:34.141209    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 17 22:17:34.141428 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:34.141275    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 17 22:17:35.146137 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:35.146105    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:35.146758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:35.146536    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:35.147289 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:35.147269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:17:35.267408 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:35.267370    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:36.159685 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:36.159620    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:37.056235 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:37.056201    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:37.647606 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:37.647572    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:38.200204 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:38.200169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:39.547931 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:39.547896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:40.595850 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:40.595814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:41.538822 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:41.538792    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:42.460355 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:42.460317    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:43.370245 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:43.370190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:44.268244 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:44.268212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:48.944599 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:48.944563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:49.743022 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:49.742983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:49.850965 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:49.850917    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:49.949291 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:49.949256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:50.032989 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:50.032958    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:50.477118 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:50.477025    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:50.567285 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:50.567242    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:51.504014 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:51.503977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:52.550303 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:52.550270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:53.671644 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:53.671612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:54.651042 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:54.651008    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:54.714898 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:54.714864    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:17:57.005962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:57.005925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:57.110004 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:57.109973    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:17:57.252670 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:57.252622    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"]
Sep 17 22:17:57.252867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:57.252849    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy" containerID="cri-o://a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3" gracePeriod=30
Sep 17 22:17:57.294492 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:17:57.294451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:01.609241 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:01.609197    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:02.499537 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.499510    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:18:02.607085 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-credential-socket\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607296 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lxph\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-kube-api-access-7lxph\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607296 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bcfaa96-9853-4005-99c8-221dd3dc735f-istiod-ca-cert\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607296 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-certs\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607296 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607250    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-socket\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607296 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607288    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-envoy\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607556 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607327    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-data\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607556 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607345    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:18:02.607556 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-token\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607556 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-podinfo\") pod \"7bcfaa96-9853-4005-99c8-221dd3dc735f\" (UID: \"7bcfaa96-9853-4005-99c8-221dd3dc735f\") "
Sep 17 22:18:02.607556 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607558    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607635    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607701    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bcfaa96-9853-4005-99c8-221dd3dc735f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607809    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607828    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bcfaa96-9853-4005-99c8-221dd3dc735f-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607837    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607845    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.607856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.607852    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.609568 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.609547    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-kube-api-access-7lxph" (OuterVolumeSpecName: "kube-api-access-7lxph") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "kube-api-access-7lxph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:18:02.609963 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.609944    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:18:02.610156 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.610137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:18:02.610216 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.610200    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bcfaa96-9853-4005-99c8-221dd3dc735f" (UID: "7bcfaa96-9853-4005-99c8-221dd3dc735f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:18:02.648722 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.648684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:02.709121 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.709087    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.709121 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.709114    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.709121 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.709123    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lxph\" (UniqueName: \"kubernetes.io/projected/7bcfaa96-9853-4005-99c8-221dd3dc735f-kube-api-access-7lxph\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.709372 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.709132    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bcfaa96-9853-4005-99c8-221dd3dc735f-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:02.821951 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.821918    2580 generic.go:356] "Generic (PLEG): container finished" podID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerID="a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3" exitCode=0
Sep 17 22:18:02.822127 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.821967    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"
Sep 17 22:18:02.822127 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.821993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" event={"ID":"7bcfaa96-9853-4005-99c8-221dd3dc735f","Type":"ContainerDied","Data":"a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3"}
Sep 17 22:18:02.822127 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.822057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz" event={"ID":"7bcfaa96-9853-4005-99c8-221dd3dc735f","Type":"ContainerDied","Data":"8b9f7d60a0cf0998729c0dcd42408b8caa467397bac5594a230668655e0ebb5c"}
Sep 17 22:18:02.822127 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.822079    2580 scope.go:117] "RemoveContainer" containerID="a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3"
Sep 17 22:18:02.832034 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.832021    2580 scope.go:117] "RemoveContainer" containerID="0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac"
Sep 17 22:18:02.840480 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.840457    2580 scope.go:117] "RemoveContainer" containerID="a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3"
Sep 17 22:18:02.840821 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:18:02.840802    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3\": container with ID starting with a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3 not found: ID does not exist" containerID="a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3"
Sep 17 22:18:02.840876 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.840829    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3"} err="failed to get container status \"a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3\": rpc error: code = NotFound desc = could not find container \"a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3\": container with ID starting with a5b963b366761e732763870761375d9dd7067c6e5d5d11e70b75faacfaccd2c3 not found: ID does not exist"
Sep 17 22:18:02.840876 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.840844    2580 scope.go:117] "RemoveContainer" containerID="0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac"
Sep 17 22:18:02.841090 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:18:02.841076    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac\": container with ID starting with 0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac not found: ID does not exist" containerID="0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac"
Sep 17 22:18:02.841131 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.841094    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac"} err="failed to get container status \"0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac\": rpc error: code = NotFound desc = could not find container \"0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac\": container with ID starting with 0b79fa7727692e60116ddbb687e6420e12e38801fa8c4aa69a22931d41fdb6ac not found: ID does not exist"
Sep 17 22:18:02.846527 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.846504    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"]
Sep 17 22:18:02.855159 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:02.855138    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e0396-openshift-default-69658b9df8-jk6mz"]
Sep 17 22:18:03.024512 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:03.024476    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" path="/var/lib/kubelet/pods/7bcfaa96-9853-4005-99c8-221dd3dc735f/volumes"
Sep 17 22:18:03.630015 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:03.629974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:04.548214 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:04.548161    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:05.452303 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:05.452263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:06.306218 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:06.306180    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:07.810129 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:07.810101    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:08.175947 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:08.175854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:14.469379 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:14.469340    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:18:16.823293 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:16.823263    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"]
Sep 17 22:18:16.823804 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:16.823497    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" podUID="442732f6-7e88-4b96-af4f-8349944032ba" containerName="maas-api" containerID="cri-o://f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2" gracePeriod=30
Sep 17 22:18:16.856642 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:16.856599    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:16.958060 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:16.958028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:17.063193 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.063158    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:17.084424 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.084358    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:18:17.161894 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.161854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:17.249792 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.249761    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-metrics-certs\") pod \"442732f6-7e88-4b96-af4f-8349944032ba\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") "
Sep 17 22:18:17.249974 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.249831    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/442732f6-7e88-4b96-af4f-8349944032ba-openshift-service-ca\") pod \"442732f6-7e88-4b96-af4f-8349944032ba\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") "
Sep 17 22:18:17.249974 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.249891    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls\") pod \"442732f6-7e88-4b96-af4f-8349944032ba\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") "
Sep 17 22:18:17.249974 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.249907    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lcj6\" (UniqueName: \"kubernetes.io/projected/442732f6-7e88-4b96-af4f-8349944032ba-kube-api-access-6lcj6\") pod \"442732f6-7e88-4b96-af4f-8349944032ba\" (UID: \"442732f6-7e88-4b96-af4f-8349944032ba\") "
Sep 17 22:18:17.250232 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.250206    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/442732f6-7e88-4b96-af4f-8349944032ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "442732f6-7e88-4b96-af4f-8349944032ba" (UID: "442732f6-7e88-4b96-af4f-8349944032ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:18:17.252125 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.252098    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "442732f6-7e88-4b96-af4f-8349944032ba" (UID: "442732f6-7e88-4b96-af4f-8349944032ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:18:17.252248 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.252149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "442732f6-7e88-4b96-af4f-8349944032ba" (UID: "442732f6-7e88-4b96-af4f-8349944032ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:18:17.252295 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.252257    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442732f6-7e88-4b96-af4f-8349944032ba-kube-api-access-6lcj6" (OuterVolumeSpecName: "kube-api-access-6lcj6") pod "442732f6-7e88-4b96-af4f-8349944032ba" (UID: "442732f6-7e88-4b96-af4f-8349944032ba"). InnerVolumeSpecName "kube-api-access-6lcj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:18:17.351174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.351096    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:17.351174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.351123    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/442732f6-7e88-4b96-af4f-8349944032ba-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:17.351174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.351132    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/442732f6-7e88-4b96-af4f-8349944032ba-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:17.351174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.351143    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lcj6\" (UniqueName: \"kubernetes.io/projected/442732f6-7e88-4b96-af4f-8349944032ba-kube-api-access-6lcj6\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:18:17.553610 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.553425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:17.658321 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.658238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:17.906273 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.906237    2580 generic.go:356] "Generic (PLEG): container finished" podID="442732f6-7e88-4b96-af4f-8349944032ba" containerID="f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2" exitCode=0
Sep 17 22:18:17.906742 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.906301    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"
Sep 17 22:18:17.906742 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.906329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" event={"ID":"442732f6-7e88-4b96-af4f-8349944032ba","Type":"ContainerDied","Data":"f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2"}
Sep 17 22:18:17.906742 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.906425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr" event={"ID":"442732f6-7e88-4b96-af4f-8349944032ba","Type":"ContainerDied","Data":"6144916ccf7fb9b8fc868d90fda5f8f5a3cf17b0861052de334b740385088664"}
Sep 17 22:18:17.906742 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.906455    2580 scope.go:117] "RemoveContainer" containerID="f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2"
Sep 17 22:18:17.916914 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.916895    2580 scope.go:117] "RemoveContainer" containerID="f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2"
Sep 17 22:18:17.917190 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:18:17.917170    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2\": container with ID starting with f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2 not found: ID does not exist" containerID="f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2"
Sep 17 22:18:17.917248 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.917200    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2"} err="failed to get container status \"f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2\": rpc error: code = NotFound desc = could not find container \"f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2\": container with ID starting with f89c97ce7608a0b40f707cc7c511429227fbed416a6ed6a7fb2698eade01a5a2 not found: ID does not exist"
Sep 17 22:18:17.928394 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.928370    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"]
Sep 17 22:18:17.934282 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:17.934261    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a71836-845769c867-7vlfr"]
Sep 17 22:18:18.456531 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:18.456499    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:19.024282 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:19.024246    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="442732f6-7e88-4b96-af4f-8349944032ba" path="/var/lib/kubelet/pods/442732f6-7e88-4b96-af4f-8349944032ba/volumes"
Sep 17 22:18:19.374504 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:19.374410    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:20.158076 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:20.158040    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:22.752716 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:22.752681    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:26.157649 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:26.157616    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:18:31.449745 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:31.449618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:31.550466 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:31.550427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:54.078783 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:54.078747    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:54.142116 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:54.142074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:18:59.508160 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:18:59.508126    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:00.023835 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:00.023798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:05.602565 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:05.602532    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:20.103761 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:20.103708    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:20.204529 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:20.204497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:20.381608 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:20.381488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:21.053771 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:21.053732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:21.838224 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:21.838190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:31.474116 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:31.474071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:32.350533 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:32.350495    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:32.709304 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:32.709207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:33.038001 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.037963    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"]
Sep 17 22:19:33.038186 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.038162    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl" podUID="69e7f7cf-3b7e-434b-ab47-e88a3f625670" containerName="maas-api" containerID="cri-o://8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611" gracePeriod=30
Sep 17 22:19:33.055778 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.055748    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:33.154015 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.153977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:33.254065 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.254035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:33.278234 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.278211    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:19:33.316627 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.316547    2580 generic.go:356] "Generic (PLEG): container finished" podID="69e7f7cf-3b7e-434b-ab47-e88a3f625670" containerID="8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611" exitCode=0
Sep 17 22:19:33.316627 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.316597    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"
Sep 17 22:19:33.316627 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.316609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl" event={"ID":"69e7f7cf-3b7e-434b-ab47-e88a3f625670","Type":"ContainerDied","Data":"8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611"}
Sep 17 22:19:33.316858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.316736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl" event={"ID":"69e7f7cf-3b7e-434b-ab47-e88a3f625670","Type":"ContainerDied","Data":"19a55f1170694d79c8d9e999ef2f46b61095efdd5c968c93146bb7beed3ebf2d"}
Sep 17 22:19:33.316858 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.316771    2580 scope.go:117] "RemoveContainer" containerID="8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611"
Sep 17 22:19:33.328567 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.328545    2580 scope.go:117] "RemoveContainer" containerID="8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611"
Sep 17 22:19:33.328880 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:19:33.328861    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611\": container with ID starting with 8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611 not found: ID does not exist" containerID="8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611"
Sep 17 22:19:33.328961 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.328889    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611"} err="failed to get container status \"8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611\": rpc error: code = NotFound desc = could not find container \"8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611\": container with ID starting with 8a74d7652ad160d86709a2f4ecd6fcae360118de4a4d3a24dda02ede3ed23611 not found: ID does not exist"
Sep 17 22:19:33.343410 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.343363    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:33.346430 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.346404    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx78n\" (UniqueName: \"kubernetes.io/projected/69e7f7cf-3b7e-434b-ab47-e88a3f625670-kube-api-access-hx78n\") pod \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") "
Sep 17 22:19:33.346511 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.346472    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69e7f7cf-3b7e-434b-ab47-e88a3f625670-openshift-service-ca\") pod \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") "
Sep 17 22:19:33.346511 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.346496    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-metrics-certs\") pod \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") "
Sep 17 22:19:33.346587 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.346541    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls\") pod \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\" (UID: \"69e7f7cf-3b7e-434b-ab47-e88a3f625670\") "
Sep 17 22:19:33.346941 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.346905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69e7f7cf-3b7e-434b-ab47-e88a3f625670-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69e7f7cf-3b7e-434b-ab47-e88a3f625670" (UID: "69e7f7cf-3b7e-434b-ab47-e88a3f625670"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:19:33.348752 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.348726    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e7f7cf-3b7e-434b-ab47-e88a3f625670-kube-api-access-hx78n" (OuterVolumeSpecName: "kube-api-access-hx78n") pod "69e7f7cf-3b7e-434b-ab47-e88a3f625670" (UID: "69e7f7cf-3b7e-434b-ab47-e88a3f625670"). InnerVolumeSpecName "kube-api-access-hx78n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:19:33.348861 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.348793    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "69e7f7cf-3b7e-434b-ab47-e88a3f625670" (UID: "69e7f7cf-3b7e-434b-ab47-e88a3f625670"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:19:33.348861 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.348834    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69e7f7cf-3b7e-434b-ab47-e88a3f625670" (UID: "69e7f7cf-3b7e-434b-ab47-e88a3f625670"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:19:33.428293 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.428260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:33.447754 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.447726    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69e7f7cf-3b7e-434b-ab47-e88a3f625670-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:33.447754 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.447749    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:33.447754 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.447760    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69e7f7cf-3b7e-434b-ab47-e88a3f625670-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:33.447952 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.447767    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx78n\" (UniqueName: \"kubernetes.io/projected/69e7f7cf-3b7e-434b-ab47-e88a3f625670-kube-api-access-hx78n\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:33.655338 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.655299    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"]
Sep 17 22:19:33.657636 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.657611    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-813cee-69fdd96b79-nr7tl"]
Sep 17 22:19:33.858694 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.858628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:33.947542 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:33.947456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:34.748524 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:34.748485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:35.024222 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:35.024190    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69e7f7cf-3b7e-434b-ab47-e88a3f625670" path="/var/lib/kubelet/pods/69e7f7cf-3b7e-434b-ab47-e88a3f625670/volumes"
Sep 17 22:19:35.512971 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:35.512874    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:36.647664 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:36.647632    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:19:38.008062 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:38.008023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:39.669059 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:39.669010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:39.775757 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:39.775724    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:39.957294 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:39.957196    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:41.050792 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:41.050754    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:41.943002 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:41.942973    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:42.646145 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:42.646114    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:50.991545 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:50.991509    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"]
Sep 17 22:19:50.992045 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:50.991764    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h" podUID="ab6eca34-beab-47c2-ad26-907c35bf5df4" containerName="maas-api" containerID="cri-o://f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590" gracePeriod=30
Sep 17 22:19:51.058761 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.058730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:51.199229 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.199193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:51.248702 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.248606    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:19:51.304512 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.304478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:51.409484 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.409439    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:51.412140 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.412118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6eca34-beab-47c2-ad26-907c35bf5df4-openshift-service-ca\") pod \"ab6eca34-beab-47c2-ad26-907c35bf5df4\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") "
Sep 17 22:19:51.412277 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.412152    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-metrics-certs\") pod \"ab6eca34-beab-47c2-ad26-907c35bf5df4\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") "
Sep 17 22:19:51.412277 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.412203    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j6xk\" (UniqueName: \"kubernetes.io/projected/ab6eca34-beab-47c2-ad26-907c35bf5df4-kube-api-access-7j6xk\") pod \"ab6eca34-beab-47c2-ad26-907c35bf5df4\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") "
Sep 17 22:19:51.412396 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.412346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls\") pod \"ab6eca34-beab-47c2-ad26-907c35bf5df4\" (UID: \"ab6eca34-beab-47c2-ad26-907c35bf5df4\") "
Sep 17 22:19:51.412562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.412533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6eca34-beab-47c2-ad26-907c35bf5df4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab6eca34-beab-47c2-ad26-907c35bf5df4" (UID: "ab6eca34-beab-47c2-ad26-907c35bf5df4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:19:51.415487 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.415456    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6eca34-beab-47c2-ad26-907c35bf5df4-kube-api-access-7j6xk" (OuterVolumeSpecName: "kube-api-access-7j6xk") pod "ab6eca34-beab-47c2-ad26-907c35bf5df4" (UID: "ab6eca34-beab-47c2-ad26-907c35bf5df4"). InnerVolumeSpecName "kube-api-access-7j6xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:19:51.418951 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.418917    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ab6eca34-beab-47c2-ad26-907c35bf5df4" (UID: "ab6eca34-beab-47c2-ad26-907c35bf5df4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:19:51.419123 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.419097    2580 generic.go:356] "Generic (PLEG): container finished" podID="ab6eca34-beab-47c2-ad26-907c35bf5df4" containerID="f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590" exitCode=0
Sep 17 22:19:51.419258 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.419243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h" event={"ID":"ab6eca34-beab-47c2-ad26-907c35bf5df4","Type":"ContainerDied","Data":"f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590"}
Sep 17 22:19:51.419339 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.419326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h" event={"ID":"ab6eca34-beab-47c2-ad26-907c35bf5df4","Type":"ContainerDied","Data":"242adf4cd8e78841ee6a90fc84640d00ce7d47d00ed2ccb56cadb0df7d624eac"}
Sep 17 22:19:51.419392 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.419370    2580 scope.go:117] "RemoveContainer" containerID="f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590"
Sep 17 22:19:51.424188 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.424041    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"
Sep 17 22:19:51.425416 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.424840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab6eca34-beab-47c2-ad26-907c35bf5df4" (UID: "ab6eca34-beab-47c2-ad26-907c35bf5df4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:19:51.438512 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.438489    2580 scope.go:117] "RemoveContainer" containerID="f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590"
Sep 17 22:19:51.438900 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:19:51.438881    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590\": container with ID starting with f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590 not found: ID does not exist" containerID="f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590"
Sep 17 22:19:51.438981 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.438909    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590"} err="failed to get container status \"f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590\": rpc error: code = NotFound desc = could not find container \"f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590\": container with ID starting with f5313da5888153e20c6b3341703fe6eba36790c2037a06b5ccf918ee2e133590 not found: ID does not exist"
Sep 17 22:19:51.482971 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.482921    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:51.513366 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.513285    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:51.513366 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.513310    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6eca34-beab-47c2-ad26-907c35bf5df4-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:51.513366 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.513320    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6eca34-beab-47c2-ad26-907c35bf5df4-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:51.513366 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.513331    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j6xk\" (UniqueName: \"kubernetes.io/projected/ab6eca34-beab-47c2-ad26-907c35bf5df4-kube-api-access-7j6xk\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:19:51.748332 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.748284    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"]
Sep 17 22:19:51.752959 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.752928    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8f8dad-86999dcf-kz87h"]
Sep 17 22:19:51.820682 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.820613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:51.923140 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:51.923102    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:53.024636 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:53.024599    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6eca34-beab-47c2-ad26-907c35bf5df4" path="/var/lib/kubelet/pods/ab6eca34-beab-47c2-ad26-907c35bf5df4/volumes"
Sep 17 22:19:53.076489 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:53.076457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:54.259753 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:54.259722    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:19:57.943116 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:57.943081    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:58.040075 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:58.040041    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:58.263541 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:58.263447    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:58.926143 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:58.926099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:19:59.744820 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:19:59.744789    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:00.716910 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:00.716875    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:09.175021 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.174940    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"]
Sep 17 22:20:09.175466 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.175124    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz" podUID="ebca044b-a02d-446e-8d83-c91dd4295c84" containerName="maas-api" containerID="cri-o://97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5" gracePeriod=30
Sep 17 22:20:09.210676 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.210624    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:09.291890 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.291854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:09.392524 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.392488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:09.433708 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.433631    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:20:09.454799 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.454764    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls\") pod \"ebca044b-a02d-446e-8d83-c91dd4295c84\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") "
Sep 17 22:20:09.455007 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.454823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-metrics-certs\") pod \"ebca044b-a02d-446e-8d83-c91dd4295c84\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") "
Sep 17 22:20:09.455007 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.454881    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebca044b-a02d-446e-8d83-c91dd4295c84-openshift-service-ca\") pod \"ebca044b-a02d-446e-8d83-c91dd4295c84\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") "
Sep 17 22:20:09.455007 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.454935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-459dd\" (UniqueName: \"kubernetes.io/projected/ebca044b-a02d-446e-8d83-c91dd4295c84-kube-api-access-459dd\") pod \"ebca044b-a02d-446e-8d83-c91dd4295c84\" (UID: \"ebca044b-a02d-446e-8d83-c91dd4295c84\") "
Sep 17 22:20:09.455336 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.455305    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebca044b-a02d-446e-8d83-c91dd4295c84-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebca044b-a02d-446e-8d83-c91dd4295c84" (UID: "ebca044b-a02d-446e-8d83-c91dd4295c84"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:20:09.457512 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.457471    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebca044b-a02d-446e-8d83-c91dd4295c84-kube-api-access-459dd" (OuterVolumeSpecName: "kube-api-access-459dd") pod "ebca044b-a02d-446e-8d83-c91dd4295c84" (UID: "ebca044b-a02d-446e-8d83-c91dd4295c84"). InnerVolumeSpecName "kube-api-access-459dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:20:09.457512 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.457498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebca044b-a02d-446e-8d83-c91dd4295c84" (UID: "ebca044b-a02d-446e-8d83-c91dd4295c84"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:20:09.457823 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.457801    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ebca044b-a02d-446e-8d83-c91dd4295c84" (UID: "ebca044b-a02d-446e-8d83-c91dd4295c84"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:20:09.493458 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.493418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:09.519169 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.519134    2580 generic.go:356] "Generic (PLEG): container finished" podID="ebca044b-a02d-446e-8d83-c91dd4295c84" containerID="97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5" exitCode=0
Sep 17 22:20:09.519368 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.519242    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"
Sep 17 22:20:09.519368 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.519259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz" event={"ID":"ebca044b-a02d-446e-8d83-c91dd4295c84","Type":"ContainerDied","Data":"97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5"}
Sep 17 22:20:09.519368 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.519330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz" event={"ID":"ebca044b-a02d-446e-8d83-c91dd4295c84","Type":"ContainerDied","Data":"5c28ecc3680ace8ff28c2631bb94b7c0b4826669633abc4a920118d9d2356123"}
Sep 17 22:20:09.519548 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.519354    2580 scope.go:117] "RemoveContainer" containerID="97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5"
Sep 17 22:20:09.529642 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.529621    2580 scope.go:117] "RemoveContainer" containerID="97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5"
Sep 17 22:20:09.529965 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:20:09.529947    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5\": container with ID starting with 97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5 not found: ID does not exist" containerID="97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5"
Sep 17 22:20:09.530041 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.529972    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5"} err="failed to get container status \"97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5\": rpc error: code = NotFound desc = could not find container \"97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5\": container with ID starting with 97c24be0b79f167e8c5837ca29b9586e76d8d8784c7bef35d557b5b413cfdba5 not found: ID does not exist"
Sep 17 22:20:09.547740 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.547702    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"]
Sep 17 22:20:09.549981 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.549949    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-35b181-6695c55d95-2vdvz"]
Sep 17 22:20:09.555748 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.555720    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:09.555856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.555750    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebca044b-a02d-446e-8d83-c91dd4295c84-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:09.555856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.555765    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebca044b-a02d-446e-8d83-c91dd4295c84-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:09.555856 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.555778    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-459dd\" (UniqueName: \"kubernetes.io/projected/ebca044b-a02d-446e-8d83-c91dd4295c84-kube-api-access-459dd\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:09.836548 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.836518    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:09.963056 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:09.963024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:11.024363 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:11.024332    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebca044b-a02d-446e-8d83-c91dd4295c84" path="/var/lib/kubelet/pods/ebca044b-a02d-446e-8d83-c91dd4295c84/volumes"
Sep 17 22:20:12.360608 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:12.360574    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:20:16.584563 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:16.584531    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:16.660598 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:16.660566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:16.861260 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:16.861177    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"]
Sep 17 22:20:16.861414 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:16.861389    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" containerID="cri-o://9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b" gracePeriod=30
Sep 17 22:20:16.881085 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:16.881057    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 22:20:16.881227 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:16.881106    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 22:20:16.882712 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:16.882684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:20:21.973863 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:21.973831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:20:22.113835 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.113806    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:20:22.172273 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-socket\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172273 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172252    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qzbl\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-kube-api-access-6qzbl\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-envoy\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-data\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-certs\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-istio-token\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-credential-socket\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6307d789-207e-44a5-bb75-699581d9629b-istio-podinfo\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172500 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172457    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6307d789-207e-44a5-bb75-699581d9629b-istiod-ca-cert\") pod \"6307d789-207e-44a5-bb75-699581d9629b\" (UID: \"6307d789-207e-44a5-bb75-699581d9629b\") "
Sep 17 22:20:22.172896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172532    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:20:22.172896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172740    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:20:22.172896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172794    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.172896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172872    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:20:22.172896 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.172882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:20:22.173155 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.173090    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6307d789-207e-44a5-bb75-699581d9629b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:20:22.174929 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.174906    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:20:22.175048 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.174944    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:20:22.175245 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.175215    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6307d789-207e-44a5-bb75-699581d9629b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 22:20:22.175245 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.175228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-kube-api-access-6qzbl" (OuterVolumeSpecName: "kube-api-access-6qzbl") pod "6307d789-207e-44a5-bb75-699581d9629b" (UID: "6307d789-207e-44a5-bb75-699581d9629b"). InnerVolumeSpecName "kube-api-access-6qzbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:20:22.274081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274049    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qzbl\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-kube-api-access-6qzbl\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.274081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274074    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-envoy\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.274081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274084    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-istio-data\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.274081 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274092    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-workload-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.274336 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274099    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6307d789-207e-44a5-bb75-699581d9629b-istio-token\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.274336 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274107    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6307d789-207e-44a5-bb75-699581d9629b-credential-socket\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.274336 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274114    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6307d789-207e-44a5-bb75-699581d9629b-istio-podinfo\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.274336 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.274123    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6307d789-207e-44a5-bb75-699581d9629b-istiod-ca-cert\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:20:22.598497 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.598457    2580 generic.go:356] "Generic (PLEG): container finished" podID="6307d789-207e-44a5-bb75-699581d9629b" containerID="9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b" exitCode=0
Sep 17 22:20:22.598695 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.598527    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"
Sep 17 22:20:22.598695 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.598541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" event={"ID":"6307d789-207e-44a5-bb75-699581d9629b","Type":"ContainerDied","Data":"9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b"}
Sep 17 22:20:22.598695 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.598634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f" event={"ID":"6307d789-207e-44a5-bb75-699581d9629b","Type":"ContainerDied","Data":"6278e7462a046db842781d7faec5ff81141a97bde8a8db7850415ec889caf8c2"}
Sep 17 22:20:22.598695 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.598688    2580 scope.go:117] "RemoveContainer" containerID="9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b"
Sep 17 22:20:22.608182 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.608165    2580 scope.go:117] "RemoveContainer" containerID="8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b"
Sep 17 22:20:22.617201 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.617182    2580 scope.go:117] "RemoveContainer" containerID="9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b"
Sep 17 22:20:22.617487 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:20:22.617468    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b\": container with ID starting with 9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b not found: ID does not exist" containerID="9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b"
Sep 17 22:20:22.617560 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.617500    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b"} err="failed to get container status \"9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b\": rpc error: code = NotFound desc = could not find container \"9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b\": container with ID starting with 9abbf421ec05785cbd8f216470353a3597dfc379f5512e1acce850c03dfe306b not found: ID does not exist"
Sep 17 22:20:22.617560 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.617523    2580 scope.go:117] "RemoveContainer" containerID="8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b"
Sep 17 22:20:22.617832 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:20:22.617814    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b\": container with ID starting with 8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b not found: ID does not exist" containerID="8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b"
Sep 17 22:20:22.617891 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.617844    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b"} err="failed to get container status \"8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b\": rpc error: code = NotFound desc = could not find container \"8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b\": container with ID starting with 8c3d595ff449544377d5c235c81ede96a93ef803611dec627676e448d07f561b not found: ID does not exist"
Sep 17 22:20:22.623802 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.623782    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"]
Sep 17 22:20:22.628602 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:22.628582    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-35b181-openshift-default-d545877f4-nkb4f"]
Sep 17 22:20:23.024506 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:20:23.024476    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6307d789-207e-44a5-bb75-699581d9629b" path="/var/lib/kubelet/pods/6307d789-207e-44a5-bb75-699581d9629b/volumes"
Sep 17 22:21:06.400833 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:21:06.400794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:21:06.475111 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:21:06.475073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:21:08.618438 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:21:08.618400    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:21:08.628800 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:21:08.628777    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:21:43.664627 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:21:43.664589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:21:43.666650 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:21:43.666624    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:21:45.253767 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:21:45.253730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:22:23.133148 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:22:23.133109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:22:29.566352 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:22:29.566319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:22:37.493612 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:22:37.493573    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:22:44.857805 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:22:44.857769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:23:07.120562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:23:07.120456    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:23:09.006052 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:23:09.006016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:23:13.163348 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:23:13.163308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:24:18.656493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:18.656455    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:24:41.663359 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:41.663268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:24:50.955534 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:50.955492    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:24:59.666466 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.666422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"]
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.666951    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442732f6-7e88-4b96-af4f-8349944032ba" containerName="maas-api"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.666970    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="442732f6-7e88-4b96-af4f-8349944032ba" containerName="maas-api"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.666986    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.666995    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667007    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667015    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667027    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e7f7cf-3b7e-434b-ab47-e88a3f625670" containerName="maas-api"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667035    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e7f7cf-3b7e-434b-ab47-e88a3f625670" containerName="maas-api"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667047    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy"
Sep 17 22:24:59.667051 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667055    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667076    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebca044b-a02d-446e-8d83-c91dd4295c84" containerName="maas-api"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667084    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebca044b-a02d-446e-8d83-c91dd4295c84" containerName="maas-api"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667096    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6eca34-beab-47c2-ad26-907c35bf5df4" containerName="maas-api"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667104    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6eca34-beab-47c2-ad26-907c35bf5df4" containerName="maas-api"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667125    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667133    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667208    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="442732f6-7e88-4b96-af4f-8349944032ba" containerName="maas-api"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667220    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667228    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebca044b-a02d-446e-8d83-c91dd4295c84" containerName="maas-api"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667237    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667245    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bcfaa96-9853-4005-99c8-221dd3dc735f" containerName="istio-proxy"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667253    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6307d789-207e-44a5-bb75-699581d9629b" containerName="istio-proxy"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667262    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6eca34-beab-47c2-ad26-907c35bf5df4" containerName="maas-api"
Sep 17 22:24:59.667551 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.667272    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="69e7f7cf-3b7e-434b-ab47-e88a3f625670" containerName="maas-api"
Sep 17 22:24:59.670552 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.670532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.673409 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.673390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-a0433cba-kserve-self-signed-certs\""
Sep 17 22:24:59.681087 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.681065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"]
Sep 17 22:24:59.703216 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.703186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:24:59.730247 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.730218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tmp-dir\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.730247 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.730250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-dshm\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.730414 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.730287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-home\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.730414 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.730366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sflvq\" (UniqueName: \"kubernetes.io/projected/0edf20a3-60ea-4435-b6ab-7555da8b68f3-kube-api-access-sflvq\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.730490 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.730413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-model-cache\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.730490 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.730435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tls-certs\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.831730 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.831693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tmp-dir\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.831942 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.831739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-dshm\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.831942 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.831777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-home\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.831942 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.831822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sflvq\" (UniqueName: \"kubernetes.io/projected/0edf20a3-60ea-4435-b6ab-7555da8b68f3-kube-api-access-sflvq\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.831942 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.831852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-model-cache\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.831942 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.831876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tls-certs\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.832238 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.832114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tmp-dir\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.832238 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.832179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-home\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.832441 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.832420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-model-cache\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.834137 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.834111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-dshm\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.834479 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.834461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tls-certs\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.841228 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.841208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sflvq\" (UniqueName: \"kubernetes.io/projected/0edf20a3-60ea-4435-b6ab-7555da8b68f3-kube-api-access-sflvq\") pod \"e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") " pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:24:59.981055 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:24:59.980958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:25:00.257328 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:00.257299    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"]
Sep 17 22:25:00.258982 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:25:00.258954    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0edf20a3_60ea_4435_b6ab_7555da8b68f3.slice/crio-d37162538807ec86c9b9514c23fdab65d79411003890e05e6998b7f43498d75b WatchSource:0}: Error finding container d37162538807ec86c9b9514c23fdab65d79411003890e05e6998b7f43498d75b: Status 404 returned error can't find the container with id d37162538807ec86c9b9514c23fdab65d79411003890e05e6998b7f43498d75b
Sep 17 22:25:01.078631 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:01.078594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4" event={"ID":"0edf20a3-60ea-4435-b6ab-7555da8b68f3","Type":"ContainerStarted","Data":"ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487"}
Sep 17 22:25:01.078631 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:01.078640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4" event={"ID":"0edf20a3-60ea-4435-b6ab-7555da8b68f3","Type":"ContainerStarted","Data":"d37162538807ec86c9b9514c23fdab65d79411003890e05e6998b7f43498d75b"}
Sep 17 22:25:01.098074 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:01.098022    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4" podStartSLOduration=2.098005902 podStartE2EDuration="2.098005902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:25:01.096902064 +0000 UTC m=+2634.618467177" watchObservedRunningTime="2026-09-17 22:25:01.098005902 +0000 UTC m=+2634.619570832"
Sep 17 22:25:02.563525 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:02.563486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:25:09.981178 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:09.981141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:25:09.981813 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:09.981202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:25:09.993518 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:09.993493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:25:10.137532 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:10.137501    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:25:10.684586 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:10.684554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:25:14.056876 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:14.056828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:25:30.212086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:30.212054    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"]
Sep 17 22:25:30.237892 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:30.237859    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:25:31.995892 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:31.995852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:25:33.164887 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:33.164845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:25:42.358383 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:42.358349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:25:45.232319 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.232271    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4" podUID="0edf20a3-60ea-4435-b6ab-7555da8b68f3" containerName="main" containerID="cri-o://ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487" gracePeriod=45
Sep 17 22:25:45.479174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.479148    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:25:45.528145 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528120    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-home\") pod \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") "
Sep 17 22:25:45.528310 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tmp-dir\") pod \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") "
Sep 17 22:25:45.528310 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528222    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-dshm\") pod \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") "
Sep 17 22:25:45.528310 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528252    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-model-cache\") pod \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") "
Sep 17 22:25:45.528310 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sflvq\" (UniqueName: \"kubernetes.io/projected/0edf20a3-60ea-4435-b6ab-7555da8b68f3-kube-api-access-sflvq\") pod \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") "
Sep 17 22:25:45.528465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528370    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tls-certs\") pod \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\" (UID: \"0edf20a3-60ea-4435-b6ab-7555da8b68f3\") "
Sep 17 22:25:45.528465 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-home" (OuterVolumeSpecName: "home") pod "0edf20a3-60ea-4435-b6ab-7555da8b68f3" (UID: "0edf20a3-60ea-4435-b6ab-7555da8b68f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:25:45.528562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528503    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0edf20a3-60ea-4435-b6ab-7555da8b68f3" (UID: "0edf20a3-60ea-4435-b6ab-7555da8b68f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:25:45.528602 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528573    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "0edf20a3-60ea-4435-b6ab-7555da8b68f3" (UID: "0edf20a3-60ea-4435-b6ab-7555da8b68f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:25:45.528729 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528712    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-home\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:45.528801 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528734    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tmp-dir\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:45.528801 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.528744    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-model-cache\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:45.530557 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.530533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-dshm" (OuterVolumeSpecName: "dshm") pod "0edf20a3-60ea-4435-b6ab-7555da8b68f3" (UID: "0edf20a3-60ea-4435-b6ab-7555da8b68f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:25:45.530685 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.530582    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0edf20a3-60ea-4435-b6ab-7555da8b68f3" (UID: "0edf20a3-60ea-4435-b6ab-7555da8b68f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:25:45.530685 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.530596    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0edf20a3-60ea-4435-b6ab-7555da8b68f3-kube-api-access-sflvq" (OuterVolumeSpecName: "kube-api-access-sflvq") pod "0edf20a3-60ea-4435-b6ab-7555da8b68f3" (UID: "0edf20a3-60ea-4435-b6ab-7555da8b68f3"). InnerVolumeSpecName "kube-api-access-sflvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:25:45.629434 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.629399    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0edf20a3-60ea-4435-b6ab-7555da8b68f3-tls-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:45.629434 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.629428    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0edf20a3-60ea-4435-b6ab-7555da8b68f3-dshm\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:45.629434 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:45.629437    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sflvq\" (UniqueName: \"kubernetes.io/projected/0edf20a3-60ea-4435-b6ab-7555da8b68f3-kube-api-access-sflvq\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:46.317973 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.317934    2580 generic.go:356] "Generic (PLEG): container finished" podID="0edf20a3-60ea-4435-b6ab-7555da8b68f3" containerID="ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487" exitCode=0
Sep 17 22:25:46.317973 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.317973    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"
Sep 17 22:25:46.318440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.318027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4" event={"ID":"0edf20a3-60ea-4435-b6ab-7555da8b68f3","Type":"ContainerDied","Data":"ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487"}
Sep 17 22:25:46.318440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.318064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4" event={"ID":"0edf20a3-60ea-4435-b6ab-7555da8b68f3","Type":"ContainerDied","Data":"d37162538807ec86c9b9514c23fdab65d79411003890e05e6998b7f43498d75b"}
Sep 17 22:25:46.318440 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.318081    2580 scope.go:117] "RemoveContainer" containerID="ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487"
Sep 17 22:25:46.327645 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.327627    2580 scope.go:117] "RemoveContainer" containerID="ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487"
Sep 17 22:25:46.327968 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:25:46.327948    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487\": container with ID starting with ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487 not found: ID does not exist" containerID="ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487"
Sep 17 22:25:46.328024 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.327977    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487"} err="failed to get container status \"ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487\": rpc error: code = NotFound desc = could not find container \"ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487\": container with ID starting with ec4421f66e914db90f41fc687cdfcceaf848cecb560a0f39e22fca4838249487 not found: ID does not exist"
Sep 17 22:25:46.341147 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.341123    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"]
Sep 17 22:25:46.344353 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:46.344331    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-a0433cba-kserve-bc489cff5-jxnr4"]
Sep 17 22:25:47.030484 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:47.024951    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0edf20a3-60ea-4435-b6ab-7555da8b68f3" path="/var/lib/kubelet/pods/0edf20a3-60ea-4435-b6ab-7555da8b68f3/volumes"
Sep 17 22:25:50.115994 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.115958    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"]
Sep 17 22:25:50.116467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.116305    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0edf20a3-60ea-4435-b6ab-7555da8b68f3" containerName="main"
Sep 17 22:25:50.116467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.116316    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0edf20a3-60ea-4435-b6ab-7555da8b68f3" containerName="main"
Sep 17 22:25:50.116467 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.116373    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0edf20a3-60ea-4435-b6ab-7555da8b68f3" containerName="main"
Sep 17 22:25:50.120841 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.120814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.124819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.124796    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 22:25:50.124962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.124831    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bvxx5\""
Sep 17 22:25:50.124962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.124800    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 22:25:50.124962 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.124908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 22:25:50.125131 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.124993    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 22:25:50.135477 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.135451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"]
Sep 17 22:25:50.137572 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.137548    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"]
Sep 17 22:25:50.140966 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.140947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.153824 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.153798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"]
Sep 17 22:25:50.169075 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.169050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wtpf\" (UniqueName: \"kubernetes.io/projected/6326acce-8583-47f1-b9e5-a9683bcf3026-kube-api-access-6wtpf\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.169194 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.169094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-maas-api-tls\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.169194 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.169112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6326acce-8583-47f1-b9e5-a9683bcf3026-openshift-service-ca\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.169271 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.169209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-metrics-certs\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.255578 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.255548    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:25:50.270327 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-metrics-certs\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.270547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b2eed-b9f0-4d56-baee-f1e063159810-openshift-service-ca\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.270547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wtpf\" (UniqueName: \"kubernetes.io/projected/6326acce-8583-47f1-b9e5-a9683bcf3026-kube-api-access-6wtpf\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.270547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-maas-api-tls\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.270547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6326acce-8583-47f1-b9e5-a9683bcf3026-openshift-service-ca\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.270547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a24b2eed-b9f0-4d56-baee-f1e063159810-metrics-certs\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.270547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw48z\" (UniqueName: \"kubernetes.io/projected/a24b2eed-b9f0-4d56-baee-f1e063159810-kube-api-access-hw48z\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.270547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.270546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b2eed-b9f0-4d56-baee-f1e063159810-maas-api-tls\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.271146 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.271126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6326acce-8583-47f1-b9e5-a9683bcf3026-openshift-service-ca\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.272903 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.272877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-metrics-certs\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.273017 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.272996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-maas-api-tls\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.278991 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.278969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wtpf\" (UniqueName: \"kubernetes.io/projected/6326acce-8583-47f1-b9e5-a9683bcf3026-kube-api-access-6wtpf\") pod \"maas-api-d48fb5469-cmp9d\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") " pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.371279 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.371182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a24b2eed-b9f0-4d56-baee-f1e063159810-metrics-certs\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.371279 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.371223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw48z\" (UniqueName: \"kubernetes.io/projected/a24b2eed-b9f0-4d56-baee-f1e063159810-kube-api-access-hw48z\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.371279 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.371247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b2eed-b9f0-4d56-baee-f1e063159810-maas-api-tls\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.371279 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.371276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b2eed-b9f0-4d56-baee-f1e063159810-openshift-service-ca\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.372174 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.372130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b2eed-b9f0-4d56-baee-f1e063159810-openshift-service-ca\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.373877 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.373858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b2eed-b9f0-4d56-baee-f1e063159810-maas-api-tls\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.374136 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.374119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a24b2eed-b9f0-4d56-baee-f1e063159810-metrics-certs\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.379209 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.379187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw48z\" (UniqueName: \"kubernetes.io/projected/a24b2eed-b9f0-4d56-baee-f1e063159810-kube-api-access-hw48z\") pod \"maas-api-c966cd48f-dglhw\" (UID: \"a24b2eed-b9f0-4d56-baee-f1e063159810\") " pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.431931 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.431895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:50.454805 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.454772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:50.710546 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.710521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"]
Sep 17 22:25:50.712558 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:25:50.712533    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6326acce_8583_47f1_b9e5_a9683bcf3026.slice/crio-f69c205699879a288da4f4c014b45a26032efcb86f4eba0ce5910233b5f03b7c WatchSource:0}: Error finding container f69c205699879a288da4f4c014b45a26032efcb86f4eba0ce5910233b5f03b7c: Status 404 returned error can't find the container with id f69c205699879a288da4f4c014b45a26032efcb86f4eba0ce5910233b5f03b7c
Sep 17 22:25:50.713859 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.713843    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 22:25:50.746322 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:50.746298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"]
Sep 17 22:25:50.748246 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:25:50.748225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24b2eed_b9f0_4d56_baee_f1e063159810.slice/crio-08f9129907f918975ac8f1a3bb4327dac1f360500b0ca03780afc2521b36959d WatchSource:0}: Error finding container 08f9129907f918975ac8f1a3bb4327dac1f360500b0ca03780afc2521b36959d: Status 404 returned error can't find the container with id 08f9129907f918975ac8f1a3bb4327dac1f360500b0ca03780afc2521b36959d
Sep 17 22:25:51.347429 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.347391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d" event={"ID":"6326acce-8583-47f1-b9e5-a9683bcf3026","Type":"ContainerStarted","Data":"ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8"}
Sep 17 22:25:51.347920 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.347451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d" event={"ID":"6326acce-8583-47f1-b9e5-a9683bcf3026","Type":"ContainerStarted","Data":"f69c205699879a288da4f4c014b45a26032efcb86f4eba0ce5910233b5f03b7c"}
Sep 17 22:25:51.347920 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.347472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:51.349179 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.349152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw" event={"ID":"a24b2eed-b9f0-4d56-baee-f1e063159810","Type":"ContainerStarted","Data":"bb4681d55950963106234b23404f4ce80821c10b4f5719aab3008aaae4fd7fbd"}
Sep 17 22:25:51.349287 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.349199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw" event={"ID":"a24b2eed-b9f0-4d56-baee-f1e063159810","Type":"ContainerStarted","Data":"08f9129907f918975ac8f1a3bb4327dac1f360500b0ca03780afc2521b36959d"}
Sep 17 22:25:51.349329 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.349296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:51.365057 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.364969    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d" podStartSLOduration=0.972582669 podStartE2EDuration="1.364949577s" totalImagesPullingTime="392.366908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:25:51.364254824 +0000 UTC m=+2684.885819779" watchObservedRunningTime="2026-09-17 22:25:51.364949577 +0000 UTC m=+2684.886514508"
Sep 17 22:25:51.383885 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:51.383835    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw" podStartSLOduration=0.997214423 podStartE2EDuration="1.383820833s" totalImagesPullingTime="386.60641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:25:51.381752999 +0000 UTC m=+2684.903317953" watchObservedRunningTime="2026-09-17 22:25:51.383820833 +0000 UTC m=+2684.905385762"
Sep 17 22:25:57.360565 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.360527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c966cd48f-dglhw"
Sep 17 22:25:57.361041 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.360961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:57.435921 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.435891    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"]
Sep 17 22:25:57.436086 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.436066    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d" podUID="6326acce-8583-47f1-b9e5-a9683bcf3026" containerName="maas-api" containerID="cri-o://ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8" gracePeriod=30
Sep 17 22:25:57.688650 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.688620    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:57.839816 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.839770    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wtpf\" (UniqueName: \"kubernetes.io/projected/6326acce-8583-47f1-b9e5-a9683bcf3026-kube-api-access-6wtpf\") pod \"6326acce-8583-47f1-b9e5-a9683bcf3026\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") "
Sep 17 22:25:57.839816 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.839828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-maas-api-tls\") pod \"6326acce-8583-47f1-b9e5-a9683bcf3026\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") "
Sep 17 22:25:57.840043 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.839856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6326acce-8583-47f1-b9e5-a9683bcf3026-openshift-service-ca\") pod \"6326acce-8583-47f1-b9e5-a9683bcf3026\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") "
Sep 17 22:25:57.840043 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.839949    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-metrics-certs\") pod \"6326acce-8583-47f1-b9e5-a9683bcf3026\" (UID: \"6326acce-8583-47f1-b9e5-a9683bcf3026\") "
Sep 17 22:25:57.840294 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.840268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6326acce-8583-47f1-b9e5-a9683bcf3026-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6326acce-8583-47f1-b9e5-a9683bcf3026" (UID: "6326acce-8583-47f1-b9e5-a9683bcf3026"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:25:57.842151 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.842120    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6326acce-8583-47f1-b9e5-a9683bcf3026-kube-api-access-6wtpf" (OuterVolumeSpecName: "kube-api-access-6wtpf") pod "6326acce-8583-47f1-b9e5-a9683bcf3026" (UID: "6326acce-8583-47f1-b9e5-a9683bcf3026"). InnerVolumeSpecName "kube-api-access-6wtpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:25:57.842151 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.842140    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6326acce-8583-47f1-b9e5-a9683bcf3026" (UID: "6326acce-8583-47f1-b9e5-a9683bcf3026"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:25:57.842279 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.842123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6326acce-8583-47f1-b9e5-a9683bcf3026" (UID: "6326acce-8583-47f1-b9e5-a9683bcf3026"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:25:57.941393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.941301    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wtpf\" (UniqueName: \"kubernetes.io/projected/6326acce-8583-47f1-b9e5-a9683bcf3026-kube-api-access-6wtpf\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:57.941393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.941343    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-maas-api-tls\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:57.941393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.941354    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6326acce-8583-47f1-b9e5-a9683bcf3026-openshift-service-ca\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:57.941393 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:57.941362    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6326acce-8583-47f1-b9e5-a9683bcf3026-metrics-certs\") on node \"ip-10-0-138-7.ec2.internal\" DevicePath \"\""
Sep 17 22:25:58.395036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.394941    2580 generic.go:356] "Generic (PLEG): container finished" podID="6326acce-8583-47f1-b9e5-a9683bcf3026" containerID="ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8" exitCode=0
Sep 17 22:25:58.395036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.394998    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"
Sep 17 22:25:58.395036 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.394998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d" event={"ID":"6326acce-8583-47f1-b9e5-a9683bcf3026","Type":"ContainerDied","Data":"ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8"}
Sep 17 22:25:58.395600 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.395090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d" event={"ID":"6326acce-8583-47f1-b9e5-a9683bcf3026","Type":"ContainerDied","Data":"f69c205699879a288da4f4c014b45a26032efcb86f4eba0ce5910233b5f03b7c"}
Sep 17 22:25:58.395600 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.395123    2580 scope.go:117] "RemoveContainer" containerID="ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8"
Sep 17 22:25:58.404791 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.404773    2580 scope.go:117] "RemoveContainer" containerID="ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8"
Sep 17 22:25:58.405068 ip-10-0-138-7 kubenswrapper[2580]: E0917 22:25:58.405053    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8\": container with ID starting with ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8 not found: ID does not exist" containerID="ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8"
Sep 17 22:25:58.405110 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.405077    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8"} err="failed to get container status \"ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8\": rpc error: code = NotFound desc = could not find container \"ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8\": container with ID starting with ba2e5587c21909b575aa6b0cfdd247ecfba9f5405f41b1637601ffa81dace1d8 not found: ID does not exist"
Sep 17 22:25:58.417544 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.417521    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"]
Sep 17 22:25:58.422116 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.422096    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-d48fb5469-cmp9d"]
Sep 17 22:25:58.864820 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:58.864775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:25:59.024515 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:25:59.024481    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6326acce-8583-47f1-b9e5-a9683bcf3026" path="/var/lib/kubelet/pods/6326acce-8583-47f1-b9e5-a9683bcf3026/volumes"
Sep 17 22:26:06.153958 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:06.153915    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:26:08.658406 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:08.658369    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:26:08.666923 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:08.666898    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:26:12.357828 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:12.357794    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:26:18.959511 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:18.959476    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:26:19.545548 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:19.545511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fpqzq"]
Sep 17 22:26:28.139405 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:28.139379    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5v47c_385b4a84-1556-4f9d-a21c-5c70d63b8c4b/server/0.log"
Sep 17 22:26:28.265869 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:28.265837    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ccx8m_1918708d-48fb-4908-bfc3-f90195d324a6/manager/0.log"
Sep 17 22:26:28.530920 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:28.530894    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-555cdfd7b4-lzsc9_65ec2558-281d-4a72-a506-f58338d3bd11/copy-manifests/0.log"
Sep 17 22:26:28.540961 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:28.540934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-555cdfd7b4-lzsc9_65ec2558-281d-4a72-a506-f58338d3bd11/manager/0.log"
Sep 17 22:26:29.058875 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:29.058843    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c966cd48f-dglhw_a24b2eed-b9f0-4d56-baee-f1e063159810/maas-api/0.log"
Sep 17 22:26:30.957413 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:30.957384    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fpqzq_8389e4fc-7b79-4d63-84e6-e57d82f9b4d9/limitador/0.log"
Sep 17 22:26:31.573547 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:31.573513    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8dj5_061b096e-d6a7-4284-b7cb-7cef5906a24f/discovery/0.log"
Sep 17 22:26:32.308126 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:32.308094    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8498d4ff98-642dx_1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d/router/0.log"
Sep 17 22:26:32.882511 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:32.882479    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-vzx5b_6e65646a-b852-47f9-803b-ff30b08c0248/main/0.log"
Sep 17 22:26:39.352008 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:39.351968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:26:39.450070 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:39.450039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:26:42.413910 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:42.413873    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vmmb9_e608f059-87f0-4200-b697-b41ce99eca5d/global-pull-secret-syncer/0.log"
Sep 17 22:26:42.481724 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:42.481681    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log"
Sep 17 22:26:42.653758 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:42.653722    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-7.ec2.internal_638288756fad3699123da181b4a12476/haproxy/0.log"
Sep 17 22:26:47.651459 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:47.651425    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fpqzq_8389e4fc-7b79-4d63-84e6-e57d82f9b4d9/limitador/0.log"
Sep 17 22:26:49.597061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:49.597017    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-65d6h_67b3c9a6-6688-488b-8ee1-222152f6793a/cluster-monitoring-operator/0.log"
Sep 17 22:26:49.808069 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:49.808035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgfpc_ac934d9f-931a-4cd3-81c6-54cba9c465fc/node-exporter/0.log"
Sep 17 22:26:49.858114 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:49.858071    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgfpc_ac934d9f-931a-4cd3-81c6-54cba9c465fc/kube-rbac-proxy/0.log"
Sep 17 22:26:49.906509 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:49.906485    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgfpc_ac934d9f-931a-4cd3-81c6-54cba9c465fc/init-textfile/0.log"
Sep 17 22:26:50.621902 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:50.621868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fcf6ff945-cjkmk_5f0c7b57-1dd2-494e-a48b-dd079d2432d4/telemeter-client/0.log"
Sep 17 22:26:50.654642 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:50.654610    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fcf6ff945-cjkmk_5f0c7b57-1dd2-494e-a48b-dd079d2432d4/reload/0.log"
Sep 17 22:26:50.687951 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:50.687924    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fcf6ff945-cjkmk_5f0c7b57-1dd2-494e-a48b-dd079d2432d4/kube-rbac-proxy/0.log"
Sep 17 22:26:52.277886 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.277849    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-cz4df_3707ed37-65a1-4eff-936d-51675e2ca043/networking-console-plugin/0.log"
Sep 17 22:26:52.648114 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.648033    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"]
Sep 17 22:26:52.648403 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.648390    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6326acce-8583-47f1-b9e5-a9683bcf3026" containerName="maas-api"
Sep 17 22:26:52.648450 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.648405    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6326acce-8583-47f1-b9e5-a9683bcf3026" containerName="maas-api"
Sep 17 22:26:52.648497 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.648464    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6326acce-8583-47f1-b9e5-a9683bcf3026" containerName="maas-api"
Sep 17 22:26:52.651554 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.651535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.654587 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.654559    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jmg5p\"/\"openshift-service-ca.crt\""
Sep 17 22:26:52.654738 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.654606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jmg5p\"/\"kube-root-ca.crt\""
Sep 17 22:26:52.655358 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.655345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jmg5p\"/\"default-dockercfg-gg4dc\""
Sep 17 22:26:52.662777 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.662754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"]
Sep 17 22:26:52.713605 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.713572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-lib-modules\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.713794 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.713615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-sys\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.713794 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.713642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-proc\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.713794 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.713722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-podres\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.713909 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.713793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s69jt\" (UniqueName: \"kubernetes.io/projected/7b30d61c-1330-4d39-a52a-33528211b16d-kube-api-access-s69jt\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815172 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s69jt\" (UniqueName: \"kubernetes.io/projected/7b30d61c-1330-4d39-a52a-33528211b16d-kube-api-access-s69jt\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815360 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-lib-modules\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815360 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-sys\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815360 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-proc\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815360 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-podres\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815360 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-lib-modules\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-sys\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-proc\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.815562 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.815416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b30d61c-1330-4d39-a52a-33528211b16d-podres\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.824765 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.824734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s69jt\" (UniqueName: \"kubernetes.io/projected/7b30d61c-1330-4d39-a52a-33528211b16d-kube-api-access-s69jt\") pod \"perf-node-gather-daemonset-dx4v2\" (UID: \"7b30d61c-1330-4d39-a52a-33528211b16d\") " pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.962382 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.962286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:52.982797 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.982766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/2.log"
Sep 17 22:26:52.992788 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:52.992760    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m58ph_cdad6dfd-e180-4780-97e3-7a06826ff952/console-operator/3.log"
Sep 17 22:26:53.242082 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:53.242058    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"]
Sep 17 22:26:53.244116 ip-10-0-138-7 kubenswrapper[2580]: W0917 22:26:53.244086    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7b30d61c_1330_4d39_a52a_33528211b16d.slice/crio-6facb0cc303c5abc1787c6770c8f4e3838474142c472b53ea32a70c0c3ddde52 WatchSource:0}: Error finding container 6facb0cc303c5abc1787c6770c8f4e3838474142c472b53ea32a70c0c3ddde52: Status 404 returned error can't find the container with id 6facb0cc303c5abc1787c6770c8f4e3838474142c472b53ea32a70c0c3ddde52
Sep 17 22:26:53.270447 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:53.270419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7jscq_2c3eb950-75a4-4355-9115-d2c7b4b850af/konnectivity-agent/0.log" limit=1024
Sep 17 22:26:53.578061 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:53.578035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54fd6b67c-5td7v_2702873c-5f51-4b5d-9cdc-a8c9e2e5abb9/console/0.log"
Sep 17 22:26:53.697099 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:53.697065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2" event={"ID":"7b30d61c-1330-4d39-a52a-33528211b16d","Type":"ContainerStarted","Data":"f8a2796d04941ea17743e2df7de75371b0ac0e7cf21b8f6e299c0d31afcf8b0a"}
Sep 17 22:26:53.697281 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:53.697117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2" event={"ID":"7b30d61c-1330-4d39-a52a-33528211b16d","Type":"ContainerStarted","Data":"6facb0cc303c5abc1787c6770c8f4e3838474142c472b53ea32a70c0c3ddde52"}
Sep 17 22:26:53.697281 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:53.697263    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:53.715716 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:53.715668    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2" podStartSLOduration=1.715639939 podStartE2EDuration="1.715639939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 22:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:26:53.713887577 +0000 UTC m=+2747.235452529" watchObservedRunningTime="2026-09-17 22:26:53.715639939 +0000 UTC m=+2747.237204869"
Sep 17 22:26:54.316777 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:54.316746    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-9pwvt_4b2925eb-b695-470c-9ae4-1fc669384585/volume-data-source-validator/0.log"
Sep 17 22:26:55.517577 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:55.517546    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-54f7p_adca5dc3-ad89-45ad-b05a-4166ac3f40de/dns/0.log"
Sep 17 22:26:55.543356 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:55.543326    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-54f7p_adca5dc3-ad89-45ad-b05a-4166ac3f40de/kube-rbac-proxy/0.log"
Sep 17 22:26:55.692493 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:55.692465    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fc96h_6517784b-d8d3-4498-804f-cd472685bdee/dns-node-resolver/0.log"
Sep 17 22:26:56.388300 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:56.388268    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6vtqc_204f844e-14fa-43ab-8665-c53539aa4965/node-ca/0.log"
Sep 17 22:26:58.401729 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:58.401691    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8dj5_061b096e-d6a7-4284-b7cb-7cef5906a24f/discovery/0.log"
Sep 17 22:26:58.840867 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:58.840840    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8498d4ff98-642dx_1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d/router/0.log"
Sep 17 22:26:59.713520 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:59.713489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jmg5p/perf-node-gather-daemonset-dx4v2"
Sep 17 22:26:59.824742 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:26:59.824712    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q8xx_7f500dbc-7540-4445-894f-3b4648eab040/serve-healthcheck-canary/0.log"
Sep 17 22:27:00.372400 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:00.372364    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-w49hn_c6eeb779-69fd-4566-99f8-a0b24911a806/insights-operator/0.log"
Sep 17 22:27:00.373769 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:00.373752    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-w49hn_c6eeb779-69fd-4566-99f8-a0b24911a806/insights-operator/1.log"
Sep 17 22:27:00.402768 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:00.402741    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4k6ps_90241366-f8ac-4d7a-ab4b-1ad5c28d8419/kube-rbac-proxy/0.log"
Sep 17 22:27:00.427498 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:00.427473    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4k6ps_90241366-f8ac-4d7a-ab4b-1ad5c28d8419/exporter/0.log"
Sep 17 22:27:00.454363 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:00.454334    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4k6ps_90241366-f8ac-4d7a-ab4b-1ad5c28d8419/extractor/0.log"
Sep 17 22:27:03.958716 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:03.958685    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5v47c_385b4a84-1556-4f9d-a21c-5c70d63b8c4b/server/0.log"
Sep 17 22:27:04.175922 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:04.175885    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ccx8m_1918708d-48fb-4908-bfc3-f90195d324a6/manager/0.log"
Sep 17 22:27:04.321819 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:04.321787    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-555cdfd7b4-lzsc9_65ec2558-281d-4a72-a506-f58338d3bd11/manager/0.log"
Sep 17 22:27:04.358586 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:04.358554    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-555cdfd7b4-lzsc9_65ec2558-281d-4a72-a506-f58338d3bd11/copy-manifests/0.log"
Sep 17 22:27:04.546537 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:04.546505    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8dj5_061b096e-d6a7-4284-b7cb-7cef5906a24f/discovery/0.log"
Sep 17 22:27:04.693768 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:04.693734    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8498d4ff98-642dx_1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d/router/0.log"
Sep 17 22:27:05.942140 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:05.942048    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7746dd6866-bkc8s_58a3a194-c026-436f-bb9c-5237c5268037/manager/0.log"
Sep 17 22:27:06.013496 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:06.013463    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6smz8_f583038e-852c-4094-a50d-3b48c6271b7e/openshift-lws-operator/0.log"
Sep 17 22:27:07.152397 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:07.152361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-z8dj5_061b096e-d6a7-4284-b7cb-7cef5906a24f/discovery/0.log"
Sep 17 22:27:07.314852 ip-10-0-138-7 kubenswrapper[2580]: I0917 22:27:07.314821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8498d4ff98-642dx_1ac9c6cb-5cb5-485e-ba9f-49a59b690e4d/router/0.log"