Sep 10 20:55:53.686283 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 20:55:53.686295 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 20:55:53.686302 ip-10-0-134-100 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 20:55:53.686507 ip-10-0-134-100 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 20:56:03.749547 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 20:56:03.749564 ip-10-0-134-100 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 82e03da11c6e49bfa3e7e0cfea08fd1f --
Sep 10 20:57:50.972351 ip-10-0-134-100 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 20:57:51.410884 ip-10-0-134-100 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:51.410884 ip-10-0-134-100 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 20:57:51.410884 ip-10-0-134-100 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:51.410884 ip-10-0-134-100 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 20:57:51.410884 ip-10-0-134-100 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:51.413121 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.413013    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 20:57:51.416432 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416413    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.416432 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416432    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416435    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416441    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416446    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416449    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416452    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416455    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416459    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416461    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416464    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416468    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416470    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416481    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416484    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416487    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416490    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416493    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416496    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416498    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416501    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.416498 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416504    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416507    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416510    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416513    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416516    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416518    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416521    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416523    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416526    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416529    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416532    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416534    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416537    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416540    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416542    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416545    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416547    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416550    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416553    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416555    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.416983 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416558    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416561    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416563    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416567    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416571    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416574    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416578    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416583    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416586    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416588    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416592    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416594    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416597    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416599    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416603    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416606    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416609    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416611    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416614    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.417495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416616    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416619    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416621    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416624    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416627    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416630    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416632    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416635    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416638    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416641    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416643    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416647    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416649    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416652    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416655    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416658    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416661    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416664    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416666    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416669    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.417963 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416672    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416674    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416677    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416679    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416683    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416686    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416689    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416691    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416694    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416697    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416700    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416703    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416706    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416708    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416711    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416714    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416716    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416719    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.416722    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417555    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.418473 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417566    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417570    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417573    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417577    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417582    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417585    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417590    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417594    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417598    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417600    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417603    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417607    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417610    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417613    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417615    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417618    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417621    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417624    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417626    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.418992 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417629    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417632    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417634    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417637    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417640    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417642    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417646    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417649    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417651    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417654    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417656    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417659    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417661    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417666    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417668    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417671    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417674    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417676    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417679    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417681    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.419491 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417684    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417686    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417688    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417691    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417693    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417696    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417698    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417701    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417703    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417706    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417709    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417711    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417714    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417717    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417721    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417724    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417727    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417730    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417733    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.419989 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417735    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417738    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417741    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417743    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417747    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417751    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417756    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417759    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417762    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417765    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417768    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417770    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417773    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417776    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417778    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417781    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417783    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417786    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417788    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417791    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.420494 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417793    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417796    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417799    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417801    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417804    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417806    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417809    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417811    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417814    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417816    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417819    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417821    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417824    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417826    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417828    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417831    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417833    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417836    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417840    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.417843    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.420981 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418263    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418269    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418273    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418276    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418280    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418283    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418285    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418289    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418292    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418295    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418297    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418300    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418303    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418305    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418308    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418310    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418313    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418315    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418318    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.421490 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418321    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418323    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418326    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418329    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418331    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418335    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418339    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418342    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418345    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418347    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418351    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418357    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418360    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418364    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418367    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418370    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418373    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418375    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418379    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.421964 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418381    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418384    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418387    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418389    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418392    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418394    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418397    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418399    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418402    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418405    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418407    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418410    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418412    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418415    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418417    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418420    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418422    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418425    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418428    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418430    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.422450 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418433    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418435    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418438    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418442    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418445    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418448    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418450    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418453    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418456    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418458    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418461    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418464    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418466    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418469    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418471    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418474    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418477    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418480    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418482    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418486    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.422934 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418490    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418493    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418495    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418498    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418500    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418503    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418505    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418509    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418511    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418514    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418516    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418519    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418521    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418524    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418527    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418529    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418533    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418536    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418538    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418541    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.423437 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.418544    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418611    2558 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418646    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418671    2558 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418675    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418680    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418684    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418688    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418692    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418695    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418698    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418702    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418715    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418720    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418723    2558 flags.go:64] FLAG: --cgroup-root=""
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418726    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418729    2558 flags.go:64] FLAG: --client-ca-file=""
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418732    2558 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418736    2558 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418740    2558 flags.go:64] FLAG: --cluster-domain=""
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418743    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418746    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418749    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418753    2558 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 20:57:51.423951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418756    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418759    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418763    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418766    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418770    2558 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418773    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418777    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418780    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418783    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418788    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418791    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418794    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418798    2558 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418801    2558 flags.go:64] FLAG: --enable-server="true"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418803    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418808    2558 flags.go:64] FLAG: --event-burst="100"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418811    2558 flags.go:64] FLAG: --event-qps="50"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418814    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418817    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418821    2558 flags.go:64] FLAG: --eviction-hard=""
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418827    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418830    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418833    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418836    2558 flags.go:64] FLAG: --eviction-soft=""
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418839    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 20:57:51.424564 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418842    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418845    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418848    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418851    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418854    2558 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418857    2558 flags.go:64] FLAG: --feature-gates=""
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418861    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418864    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418868    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418871    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418874    2558 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418878    2558 flags.go:64] FLAG: --help="false"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418881    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418884    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418887    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418890    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418893    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418897    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418900    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418903    2558 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418905    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418908    2558 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418911    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418915    2558 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 20:57:51.425232 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418917    2558 flags.go:64] FLAG: --kube-reserved=""
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418920    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418923    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418927    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418930    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418932    2558 flags.go:64] FLAG: --lock-file=""
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418935    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418938    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418941    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418946    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418949    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418952    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418955    2558 flags.go:64] FLAG: --logging-format="text"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418958    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418961    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418964    2558 flags.go:64] FLAG: --manifest-url=""
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418967    2558 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418971    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418974    2558 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418980    2558 flags.go:64] FLAG: --max-pods="110"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418983    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418986    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418989    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418993    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418996    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 20:57:51.425822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.418999    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419002    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419009    2558 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419013    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419016    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419019    2558 flags.go:64] FLAG: --pod-cidr=""
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419022    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419027    2558 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419030    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419033    2558 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419036    2558 flags.go:64] FLAG: --port="10250"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419039    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419056    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0149e9993db7b041b"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419060    2558 flags.go:64] FLAG: --qos-reserved=""
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419063    2558 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419066    2558 flags.go:64] FLAG: --register-node="true"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419070    2558 flags.go:64] FLAG: --register-with-taints=""
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419073    2558 flags.go:64] FLAG: --registry-burst="10"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419076    2558 flags.go:64] FLAG: --registry-qps="5"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419079    2558 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419082    2558 flags.go:64] FLAG: --reserved-memory=""
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419087    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419090    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419092    2558 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419095    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 20:57:51.426453 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419098    2558 flags.go:64] FLAG: --runonce="false"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419101    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419106    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419109    2558 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419114    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419117    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419120    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419123    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419126    2558 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419129    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419132    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419135    2558 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419138    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419142    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419144    2558 flags.go:64] FLAG: --system-cgroups=""
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419147    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419153    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419156    2558 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419159    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419162    2558 flags.go:64] FLAG: --tls-min-version=""
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419165    2558 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419168    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419171    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419173    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419176    2558 flags.go:64] FLAG: --v="2"
Sep 10 20:57:51.427081 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419180    2558 flags.go:64] FLAG: --version="false"
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419184    2558 flags.go:64] FLAG: --vmodule=""
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419188    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.419191    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419316    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419320    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419323    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419326    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419330    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419334    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419337    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419342    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419345    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419348    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419350    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419353    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419355    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419359    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419362    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419365    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.427741 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419367    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419370    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419372    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419375    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419378    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419380    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419383    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419385    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419388    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419390    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419394    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419397    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419399    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419402    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419405    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419408    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419410    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419413    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419415    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419418    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.428263 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419421    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419425    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419427    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419431    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419434    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419437    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419440    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419442    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419445    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419448    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419452    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419455    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419457    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419460    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419463    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419465    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419468    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419470    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419473    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419475    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.428760 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419478    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419480    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419483    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419486    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419488    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419491    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419494    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419497    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419499    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419502    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419505    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419509    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419512    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419516    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419519    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419523    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419526    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419529    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419532    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.429338 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419535    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419538    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419540    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419543    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419549    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419552    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419555    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419557    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419560    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419562    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419565    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419567    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419570    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419573    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419576    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419580    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419582    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419585    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419588    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.429883 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419591    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419594    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419597    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419600    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.419603    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.420285    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.429147    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.429173    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.429198    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.429204    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429269    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429274    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429278    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429281    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429283    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.430370 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429286    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429289    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429292    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429295    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429298    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429301    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429303    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429306    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429309    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429313    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429317    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429321    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429323    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429326    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429330    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429332    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429335    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429338    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429342    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.430753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429345    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429348    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429351    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429354    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429357    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429367    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429370    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429373    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429376    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429378    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429382    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429386    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429389    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429392    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429395    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429397    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429400    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429402    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429405    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429408    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.431271 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429410    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429413    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429416    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429418    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429421    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429424    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429426    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429429    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429432    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429435    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429438    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429440    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429443    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429446    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429449    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429452    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429454    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429457    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429467    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429470    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.431774 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429472    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429475    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429478    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429480    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429483    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429485    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429488    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429491    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429493    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429496    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429498    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429501    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429504    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429506    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429510    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429514    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429517    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429519    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429522    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.432264 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429525    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429528    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429531    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429534    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429537    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429540    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429544    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429547    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429549    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429552    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429555    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429557    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429566    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429568    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429571    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.432719 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429574    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.429580    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429728    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429732    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429736    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429738    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429742    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429744    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429747    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429750    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429752    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429755    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429758    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429761    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429763    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:51.433124 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429765    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429768    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429772    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429776    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429779    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429782    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429785    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429788    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429791    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429794    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429797    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429800    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429803    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429806    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429809    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429817    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429820    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429823    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429825    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:51.433495 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429828    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429830    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429833    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429835    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429838    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429841    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429843    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429846    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429848    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429851    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429854    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429856    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429859    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429861    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429863    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429866    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429868    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429871    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429874    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429876    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:51.433954 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429879    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429881    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429884    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429887    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429890    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429893    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429896    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429898    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429901    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429909    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429912    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429914    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429923    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429926    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429928    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429931    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429933    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429937    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429941    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:51.434459 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429945    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429948    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429951    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429954    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429957    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429959    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429962    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429965    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429967    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429970    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429972    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429975    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429977    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429980    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429982    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429986    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429988    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429991    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429993    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429996    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:51.434929 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.429999    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.430001    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.430004    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.430012    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.430015    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.430017    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.430020    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:51.430022    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.430027    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.430202    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.432750    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.433865    2558 server.go:1019] "Starting client certificate rotation"
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.433972    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:57:51.435440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.434834    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:57:51.439433 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.439407    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:57:51.441031 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.441007    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:57:51.452478 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.452455    2558 log.go:25] "Validated CRI v1 runtime API"
Sep 10 20:57:51.456023 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.456008    2558 log.go:25] "Validated CRI v1 image API"
Sep 10 20:57:51.457012 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.456996    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 20:57:51.462849 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.462827    2558 fs.go:135] Filesystem UUIDs: map[79f7a30b-54c0-41d5-b242-c2b8a6dd1ef3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9279a9a6-2c1b-4d1d-88d6-535b5fe9add5:/dev/nvme0n1p4]
Sep 10 20:57:51.462944 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.462846    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 20:57:51.469199 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.469073    2558 manager.go:216] Machine: {Timestamp:2026-09-10 20:57:51.46658822 +0000 UTC m=+0.377868013 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100479 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea7e11471fa9e89579e3aba5c5fe5 SystemUUID:ec2ea7e1-1471-fa9e-8957-9e3aba5c5fe5 BootID:82e03da1-1c6e-49bf-a3e7-e0cfea08fd1f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:6a:df:9d:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:6a:df:9d:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:57:e1:49:79:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 20:57:51.469199 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.469186    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 20:57:51.469342 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.469275    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 20:57:51.471937 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.471919    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:57:51.473080 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.473054    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 20:57:51.473290 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.473088    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 20:57:51.474055 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.474032    2558 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 20:57:51.474119 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.474065    2558 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 20:57:51.474119 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.474078    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:57:51.474949 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.474937    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:57:51.476512 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.476500    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 20:57:51.481119 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481103    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:57:51.481261 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481250    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 20:57:51.481330 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481288    2558 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 20:57:51.481330 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481307    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 20:57:51.481330 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481327    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 20:57:51.481455 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481341    2558 kubelet.go:398] "Adding apiserver pod source"
Sep 10 20:57:51.481455 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481363    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 20:57:51.481805 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481793    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:57:51.481884 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.481816    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:57:51.484354 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.484330    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 20:57:51.488118 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.488095    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 20:57:51.488196 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.488143    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 20:57:51.490989 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.490972    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.490993    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491000    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491005    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491014    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491020    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491034    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491039    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491059    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491065    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491079    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 20:57:51.491078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.491084    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 20:57:51.492939 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.492925    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 20:57:51.492939 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.492938    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 20:57:51.495101 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.495077    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 20:57:51.495176 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.495075    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 20:57:51.497002 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.496987    2558 server.go:1268] "Started kubelet"
Sep 10 20:57:51.497142 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.497092    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 20:57:51.497200 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.497108    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 20:57:51.497200 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.497165    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 20:57:51.497988 ip-10-0-134-100 systemd[1]: Started Kubernetes Kubelet.
Sep 10 20:57:51.498990 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.498716    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 20:57:51.499292 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.499227    2558 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 20:57:51.501642 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.501610    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 20:57:51.505177 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.505149    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 20:57:51.505910 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.504776    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-100.ec2.internal.18d411350b824608  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-100.ec2.internal,UID:ip-10-0-134-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-100.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.4969554 +0000 UTC m=+0.408235195,LastTimestamp:2026-09-10 20:57:51.4969554 +0000 UTC m=+0.408235195,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-100.ec2.internal,}"
Sep 10 20:57:51.508924 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.508901    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 20:57:51.509631 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.509618    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 20:57:51.509810 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.509795    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:51.510350 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510333    2558 factory.go:55] Registering systemd factory
Sep 10 20:57:51.510424 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510353    2558 factory.go:223] Registration of the systemd container factory successfully
Sep 10 20:57:51.510589 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510573    2558 factory.go:153] Registering CRI-O factory
Sep 10 20:57:51.510589 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510589    2558 factory.go:223] Registration of the crio container factory successfully
Sep 10 20:57:51.510746 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510642    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 20:57:51.510746 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510658    2558 factory.go:103] Registering Raw factory
Sep 10 20:57:51.510746 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510677    2558 manager.go:1196] Started watching for new ooms in manager
Sep 10 20:57:51.510746 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510741    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 20:57:51.510936 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510916    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 20:57:51.510936 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.510936    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 20:57:51.511119 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.511058    2558 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 20:57:51.511119 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.511069    2558 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 20:57:51.511119 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.511062    2558 manager.go:349] Starting recovery of all containers
Sep 10 20:57:51.516096 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.512630    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 20:57:51.516096 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.512839    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 20:57:51.522117 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.521968    2558 manager.go:354] Recovery completed
Sep 10 20:57:51.528548 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.528531    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.530788 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.530755    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.530877 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.530803    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.530877 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.530817    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.530971 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.530894    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9sm6q"
Sep 10 20:57:51.531428 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.531410    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 20:57:51.531428 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.531424    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.531528 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.531427    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 20:57:51.531528 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.531483    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:57:51.532974 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.532955    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.533062 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.532982    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.533062 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.532994    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.533649 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.533636    2558 policy_none.go:49] "None policy: Start"
Sep 10 20:57:51.533708 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.533655    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 20:57:51.533708 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.533670    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 20:57:51.535632 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.535621    2558 policy_none.go:47] "Start"
Sep 10 20:57:51.542582 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.542565    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9sm6q"
Sep 10 20:57:51.543340 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.543274    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-100.ec2.internal.18d411350d86809e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-100.ec2.internal,UID:ip-10-0-134-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-100.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-100.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.530786974 +0000 UTC m=+0.442066750,LastTimestamp:2026-09-10 20:57:51.530786974 +0000 UTC m=+0.442066750,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-100.ec2.internal,}"
Sep 10 20:57:51.546271 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.546190    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-100.ec2.internal.18d411350d86d73b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-100.ec2.internal,UID:ip-10-0-134-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-100.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-100.ec2.internal,},FirstTimestamp:2026-09-10 20:57:51.530809147 +0000 UTC m=+0.442088920,LastTimestamp:2026-09-10 20:57:51.530809147 +0000 UTC m=+0.442088920,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-100.ec2.internal,}"
Sep 10 20:57:51.604705 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.604685    2558 manager.go:337] "Starting Device Plugin manager"
Sep 10 20:57:51.604856 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.604729    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 20:57:51.604856 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.604740    2558 server.go:87] "Starting device plugin registration server"
Sep 10 20:57:51.605109 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.605096    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 20:57:51.605162 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.605113    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 20:57:51.605326 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.605227    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 20:57:51.605326 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.605308    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 20:57:51.605326 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.605316    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 20:57:51.605973 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.605950    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 20:57:51.606081 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.606011    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:51.607098 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.607070    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 20:57:51.608409 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.608385    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 20:57:51.608493 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.608433    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 20:57:51.608493 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.608454    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 20:57:51.608580 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.608543    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 20:57:51.610850 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.610835    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:51.706040 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.705950    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.706941 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.706919    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.707028 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.706958    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.707028 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.706974    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.707028 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.707004    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.709190 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.709170    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"]
Sep 10 20:57:51.709251 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.709235    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.709936 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.709920    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.709996 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.709950    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.709996 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.709961    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.712142 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed333906767c71c570f41bf877f9c1e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"2ed333906767c71c570f41bf877f9c1e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.712221 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712209    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.712341 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712327    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.712390 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712357    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.712852 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712836    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.712936 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712867    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.712936 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712885    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.713014 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712867    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.713014 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712966    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.713014 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.712978    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.715146 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.715133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.715193 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.715156    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:51.715811 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.715796    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:51.715883 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.715815    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:51.715883 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.715825    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:51.716190 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.716177    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.716237 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.716196    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-100.ec2.internal\": node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:51.732584 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.732567    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-100.ec2.internal\" not found" node="ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.736153 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.736138    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-100.ec2.internal\" not found" node="ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.747502 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.747483    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:51.812308 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.812279    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed333906767c71c570f41bf877f9c1e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"2ed333906767c71c570f41bf877f9c1e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.812308 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.812313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b26f6c61717944836eeeddcfa50497e6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"b26f6c61717944836eeeddcfa50497e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.812493 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.812332    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b26f6c61717944836eeeddcfa50497e6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"b26f6c61717944836eeeddcfa50497e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.812493 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.812416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed333906767c71c570f41bf877f9c1e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"2ed333906767c71c570f41bf877f9c1e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.847734 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.847709    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:51.912876 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.912839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b26f6c61717944836eeeddcfa50497e6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"b26f6c61717944836eeeddcfa50497e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.912944 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.912877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b26f6c61717944836eeeddcfa50497e6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"b26f6c61717944836eeeddcfa50497e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.912944 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.912916    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b26f6c61717944836eeeddcfa50497e6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"b26f6c61717944836eeeddcfa50497e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.913014 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:51.912943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b26f6c61717944836eeeddcfa50497e6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"b26f6c61717944836eeeddcfa50497e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:51.948179 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:51.948150    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.035628 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.035593    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:52.038993 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.038972    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:52.048335 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:52.048311    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.151326 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:52.151286    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.253820 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:52.253746    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.303973 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.303946    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:52.354400 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:52.354362    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.433892 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.433853    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 20:57:52.434369 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.434019    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 20:57:52.434369 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.434062    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 20:57:52.455616 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:52.455578    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.547498 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.547239    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:52.547905 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.547875    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 20:52:52 +0000 UTC" deadline="2028-06-14 01:14:54.099170258 +0000 UTC"
Sep 10 20:57:52.547950 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.547907    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15412h17m1.551267016s"
Sep 10 20:57:52.548506 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.548462    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:52.548506 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.548502    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:52.548648 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.548517    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:52.556411 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:52.556387    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.657278 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:52.657243    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
Sep 10 20:57:52.666199 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.666175    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:52.675559 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:52.675520    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26f6c61717944836eeeddcfa50497e6.slice/crio-8d134c06362f73b0ec2ab9244da66865bce66ab924126024e942b5405ac7d4af WatchSource:0}: Error finding container 8d134c06362f73b0ec2ab9244da66865bce66ab924126024e942b5405ac7d4af: Status 404 returned error can't find the container with id 8d134c06362f73b0ec2ab9244da66865bce66ab924126024e942b5405ac7d4af
Sep 10 20:57:52.681378 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:52.681281    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed333906767c71c570f41bf877f9c1e.slice/crio-90273960e8342bc482772d1a7adc78f84ffc5ed5fbf14027c97f86e1d8484bf2 WatchSource:0}: Error finding container 90273960e8342bc482772d1a7adc78f84ffc5ed5fbf14027c97f86e1d8484bf2: Status 404 returned error can't find the container with id 90273960e8342bc482772d1a7adc78f84ffc5ed5fbf14027c97f86e1d8484bf2
Sep 10 20:57:52.681651 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.681631    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:57:52.710643 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.710616    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:52.727820 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.727796    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:52.728932 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.728919    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
Sep 10 20:57:52.743235 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:52.743217    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:53.086495 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.086470    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:53.334551 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.334351    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:53.483605 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.483521    2558 apiserver.go:52] "Watching apiserver"
Sep 10 20:57:53.493779 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.492730    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 20:57:53.493779 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.493328    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-wh2cv","openshift-multus/network-metrics-daemon-4sm2d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal","openshift-multus/multus-49fks","openshift-network-diagnostics/network-check-target-dh85p","openshift-network-operator/iptables-alerter-6d5hj","openshift-ovn-kubernetes/ovnkube-node-7lld2","kube-system/global-pull-secret-syncer-4htvn","kube-system/konnectivity-agent-gxs5d","kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zpm5l","openshift-dns/node-resolver-mm8nb","openshift-image-registry/node-ca-v2dq2"]
Sep 10 20:57:53.496187 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.496154    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.498952 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.498921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.499220 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.499201    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 20:57:53.499818 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.499456    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 20:57:53.499818 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.499683    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4k722\""
Sep 10 20:57:53.501445 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.501415    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.504587 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.503867    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.504587 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.504223    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 20:57:53.504752 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.504614    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5b689\""
Sep 10 20:57:53.505186 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.505161    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 20:57:53.505440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.505420    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 20:57:53.505723 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.505703    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jjq2l\""
Sep 10 20:57:53.505920 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.505896    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 20:57:53.506110 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.506094    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 20:57:53.508249 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.508222    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.509297 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.509240    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:53.509297 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.509261    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 20:57:53.509510 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.509308    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:57:53.509510 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.509348    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 20:57:53.509510 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.509372    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 20:57:53.509510 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.509473    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7xkcp\""
Sep 10 20:57:53.510480 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.510461    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 20:57:53.510612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.510550    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 20:57:53.511041 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.511021    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 20:57:53.511330 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.511312    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 20:57:53.511572 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.511553    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.511675 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.511607    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 20:57:53.511675 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.511621    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:57:53.511820 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.511690    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vv2nt\""
Sep 10 20:57:53.513788 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.513755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.516207 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.516182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:53.516314 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.516249    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:57:53.516444 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.516358    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:53.516444 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.516371    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v6bl9\""
Sep 10 20:57:53.517051 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.516872    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 20:57:53.517051 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.516990    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:53.519404 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.518875    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.522840 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.521531    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 20:57:53.522840 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.521589    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7674z\""
Sep 10 20:57:53.522840 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.521591    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 20:57:53.522840 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.521864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.523368 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5f93e88-b4d5-4485-861b-af8d84281145-hosts-file\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.523447 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-netns\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.523447 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-kubelet\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.523555 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2ab6023-1a88-44a8-96ec-40f45d1f5966-kubelet-config\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.523592 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldxrl\" (UniqueName: \"kubernetes.io/projected/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-kube-api-access-ldxrl\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.523629 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.523723 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abe5234c-2049-492d-bfb4-6532e86a38f3-agent-certs\") pod \"konnectivity-agent-gxs5d\" (UID: \"abe5234c-2049-492d-bfb4-6532e86a38f3\") " pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.523769 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-k8s-cni-cncf-io\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.523803 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2ab6023-1a88-44a8-96ec-40f45d1f5966-dbus\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.523849 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-socket-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.523884 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzkmd\" (UniqueName: \"kubernetes.io/projected/37333b6d-ae06-4308-950a-43fb79bee3aa-kube-api-access-dzkmd\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.523884 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523874    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-system-cni-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524010 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.523995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-socket-dir-parent\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524050 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-cni-bin\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524154 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-cni-multus\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524154 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-daemon-config\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524154 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:53.524311 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-registration-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.524369 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-sys-fs\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.524421 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-cnibin\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524472 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.524529 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-hostroot\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524529 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-etc-kubernetes\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524637 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-device-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.524637 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w5t5\" (UniqueName: \"kubernetes.io/projected/9eced861-f847-4b96-8e4d-3678f7acb036-kube-api-access-9w5t5\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.524637 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37333b6d-ae06-4308-950a-43fb79bee3aa-host\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.524792 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-cni-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524792 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-cni-binary-copy\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.524792 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prhjd\" (UniqueName: \"kubernetes.io/projected/d5f93e88-b4d5-4485-861b-af8d84281145-kube-api-access-prhjd\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.524792 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.524998 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5f93e88-b4d5-4485-861b-af8d84281145-tmp-dir\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.524998 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-etc-selinux\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.524998 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.524869    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37333b6d-ae06-4308-950a-43fb79bee3aa-serviceca\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.525164 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.525022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-conf-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.525164 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.525052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-multus-certs\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.525164 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.525083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abe5234c-2049-492d-bfb4-6532e86a38f3-konnectivity-ca\") pod \"konnectivity-agent-gxs5d\" (UID: \"abe5234c-2049-492d-bfb4-6532e86a38f3\") " pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.526981 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.526212    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 20:57:53.526981 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.526316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vqdb7\""
Sep 10 20:57:53.526981 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.526394    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 20:57:53.526981 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.526782    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 20:57:53.527343 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.527007    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 20:57:53.529354 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.529134    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 20:57:53.534709 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.534686    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6pfzv\""
Sep 10 20:57:53.535145 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.535112    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:57:53.535410 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.535394    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:53.535855 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.535835    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:53.536071 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.536057    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 20:57:53.580317 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.580285    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjq6p"
Sep 10 20:57:53.596285 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.596255    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjq6p"
Sep 10 20:57:53.611722 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.611693    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 20:57:53.614880 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.614823    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" event={"ID":"2ed333906767c71c570f41bf877f9c1e","Type":"ContainerStarted","Data":"90273960e8342bc482772d1a7adc78f84ffc5ed5fbf14027c97f86e1d8484bf2"}
Sep 10 20:57:53.616582 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.616556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"b26f6c61717944836eeeddcfa50497e6","Type":"ContainerStarted","Data":"8d134c06362f73b0ec2ab9244da66865bce66ab924126024e942b5405ac7d4af"}
Sep 10 20:57:53.626152 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-systemd\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.626288 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626154    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-cni-bin\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.626288 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysctl-d\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.626288 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626245    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-host\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.626288 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-tuned\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.626551 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.626551 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abe5234c-2049-492d-bfb4-6532e86a38f3-konnectivity-ca\") pod \"konnectivity-agent-gxs5d\" (UID: \"abe5234c-2049-492d-bfb4-6532e86a38f3\") " pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.626551 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5f93e88-b4d5-4485-861b-af8d84281145-hosts-file\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.626551 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-kubelet\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.626551 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-kubernetes\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.626551 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626534    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5f93e88-b4d5-4485-861b-af8d84281145-hosts-file\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626546    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-kubelet\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-systemd\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2ab6023-1a88-44a8-96ec-40f45d1f5966-kubelet-config\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-var-lib-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-node-log\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-env-overrides\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2ab6023-1a88-44a8-96ec-40f45d1f5966-kubelet-config\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abe5234c-2049-492d-bfb4-6532e86a38f3-agent-certs\") pod \"konnectivity-agent-gxs5d\" (UID: \"abe5234c-2049-492d-bfb4-6532e86a38f3\") " pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-slash\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.626895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-etc-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abe5234c-2049-492d-bfb4-6532e86a38f3-konnectivity-ca\") pod \"konnectivity-agent-gxs5d\" (UID: \"abe5234c-2049-492d-bfb4-6532e86a38f3\") " pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-socket-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.626996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkmd\" (UniqueName: \"kubernetes.io/projected/37333b6d-ae06-4308-950a-43fb79bee3aa-kube-api-access-dzkmd\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-socket-dir-parent\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-daemon-config\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-socket-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-cnibin\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-ovn\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-socket-dir-parent\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-ovnkube-config\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cace76ee-3d95-443a-b136-c0bc8c43eb3f-iptables-alerter-script\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-cnibin\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ddn\" (UniqueName: \"kubernetes.io/projected/cace76ee-3d95-443a-b136-c0bc8c43eb3f-kube-api-access-t7ddn\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-cni-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.627515 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-cni-binary-copy\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627314    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-run\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-cni-binary-copy\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-cni-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5f93e88-b4d5-4485-861b-af8d84281145-tmp-dir\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37333b6d-ae06-4308-950a-43fb79bee3aa-serviceca\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-conf-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-multus-certs\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-run-netns\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cace76ee-3d95-443a-b136-c0bc8c43eb3f-host-slash\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-kubelet\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkzb8\" (UniqueName: \"kubernetes.io/projected/583a5d2c-8614-4de5-891d-fff02318fe22-kube-api-access-jkzb8\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627633    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-sys\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-daemon-config\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-lib-modules\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.628077 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.627723    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627735    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-tmp\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-multus-conf-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-netns\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627832    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5f93e88-b4d5-4485-861b-af8d84281145-tmp-dir\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-cnibin\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldxrl\" (UniqueName: \"kubernetes.io/projected/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-kube-api-access-ldxrl\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.627948    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret podName:f2ab6023-1a88-44a8-96ec-40f45d1f5966 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:54.127904711 +0000 UTC m=+3.039184482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret") pod "global-pull-secret-syncer-4htvn" (UID: "f2ab6023-1a88-44a8-96ec-40f45d1f5966") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627973    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-multus-certs\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.627992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-netns\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-log-socket\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628144    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37333b6d-ae06-4308-950a-43fb79bee3aa-serviceca\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628166    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/583a5d2c-8614-4de5-891d-fff02318fe22-ovn-node-metrics-cert\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl88x\" (UniqueName: \"kubernetes.io/projected/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-kube-api-access-bl88x\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628226    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-system-cni-dir\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.628862 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-k8s-cni-cncf-io\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-run-k8s-cni-cncf-io\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-run-ovn-kubernetes\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628341    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-cni-binary-copy\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-modprobe-d\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysconfig\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysctl-conf\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2ab6023-1a88-44a8-96ec-40f45d1f5966-dbus\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-system-cni-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-cni-bin\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-cni-multus\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2ab6023-1a88-44a8-96ec-40f45d1f5966-dbus\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-cni-bin\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-registration-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.629743 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628747    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-host-var-lib-cni-multus\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628771    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-sys-fs\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-registration-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628836    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-system-cni-dir\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-hostroot\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-etc-kubernetes\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-hostroot\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-systemd-units\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-sys-fs\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-etc-kubernetes\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-cni-netd\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.628991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57md\" (UniqueName: \"kubernetes.io/projected/bcd26029-a0d7-47b5-871a-17c117451b7d-kube-api-access-l57md\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-device-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w5t5\" (UniqueName: \"kubernetes.io/projected/9eced861-f847-4b96-8e4d-3678f7acb036-kube-api-access-9w5t5\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37333b6d-ae06-4308-950a-43fb79bee3aa-host\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-ovnkube-script-lib\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-device-dir\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.630612 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-var-lib-kubelet\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.631570 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37333b6d-ae06-4308-950a-43fb79bee3aa-host\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.631570 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629184    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grn7d\" (UniqueName: \"kubernetes.io/projected/dabab978-57f3-4537-9f11-746e13612ee5-kube-api-access-grn7d\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.631570 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prhjd\" (UniqueName: \"kubernetes.io/projected/d5f93e88-b4d5-4485-861b-af8d84281145-kube-api-access-prhjd\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.631570 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-etc-selinux\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.631570 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.629346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9eced861-f847-4b96-8e4d-3678f7acb036-etc-selinux\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.632592 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.632572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abe5234c-2049-492d-bfb4-6532e86a38f3-agent-certs\") pod \"konnectivity-agent-gxs5d\" (UID: \"abe5234c-2049-492d-bfb4-6532e86a38f3\") " pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.636103 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.636078    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:53.636251 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.636107    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:53.636251 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.636167    2558 projected.go:196] Error preparing data for projected volume kube-api-access-nb2px for pod openshift-network-diagnostics/network-check-target-dh85p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:53.636251 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.636247    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px podName:fa6762c4-1330-4db5-a255-3867e40e3a21 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:54.13622518 +0000 UTC m=+3.047504967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nb2px" (UniqueName: "kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px") pod "network-check-target-dh85p" (UID: "fa6762c4-1330-4db5-a255-3867e40e3a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:53.638742 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.638721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzkmd\" (UniqueName: \"kubernetes.io/projected/37333b6d-ae06-4308-950a-43fb79bee3aa-kube-api-access-dzkmd\") pod \"node-ca-v2dq2\" (UID: \"37333b6d-ae06-4308-950a-43fb79bee3aa\") " pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.639337 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.639312    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldxrl\" (UniqueName: \"kubernetes.io/projected/ca7d60d4-7b8b-4684-9417-db0ad44fbc80-kube-api-access-ldxrl\") pod \"multus-49fks\" (UID: \"ca7d60d4-7b8b-4684-9417-db0ad44fbc80\") " pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.641491 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.641468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prhjd\" (UniqueName: \"kubernetes.io/projected/d5f93e88-b4d5-4485-861b-af8d84281145-kube-api-access-prhjd\") pod \"node-resolver-mm8nb\" (UID: \"d5f93e88-b4d5-4485-861b-af8d84281145\") " pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.644684 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.644661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w5t5\" (UniqueName: \"kubernetes.io/projected/9eced861-f847-4b96-8e4d-3678f7acb036-kube-api-access-9w5t5\") pod \"aws-ebs-csi-driver-node-qm44x\" (UID: \"9eced861-f847-4b96-8e4d-3678f7acb036\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.729590 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-run-netns\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.729775 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cace76ee-3d95-443a-b136-c0bc8c43eb3f-host-slash\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.729775 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729694    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-run-netns\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.729775 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.729775 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-kubelet\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.729775 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cace76ee-3d95-443a-b136-c0bc8c43eb3f-host-slash\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkzb8\" (UniqueName: \"kubernetes.io/projected/583a5d2c-8614-4de5-891d-fff02318fe22-kube-api-access-jkzb8\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-sys\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-lib-modules\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-kubelet\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-tmp\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-cnibin\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.729972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-log-socket\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/583a5d2c-8614-4de5-891d-fff02318fe22-ovn-node-metrics-cert\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730049 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl88x\" (UniqueName: \"kubernetes.io/projected/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-kube-api-access-bl88x\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-system-cni-dir\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-sys\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-run-ovn-kubernetes\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-run-ovn-kubernetes\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730183    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-modprobe-d\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-log-socket\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysconfig\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysconfig\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-modprobe-d\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysctl-conf\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-systemd-units\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-cnibin\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-cni-netd\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.730575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysctl-conf\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730475    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57md\" (UniqueName: \"kubernetes.io/projected/bcd26029-a0d7-47b5-871a-17c117451b7d-kube-api-access-l57md\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-system-cni-dir\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730623    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-cni-netd\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-ovnkube-script-lib\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.730715    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-var-lib-kubelet\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-lib-modules\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grn7d\" (UniqueName: \"kubernetes.io/projected/dabab978-57f3-4537-9f11-746e13612ee5-kube-api-access-grn7d\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-systemd-units\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-var-lib-kubelet\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-systemd\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.730989    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-systemd\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:53.731008    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:54.230955298 +0000 UTC m=+3.142235074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-cni-bin\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-cni-bin\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysctl-d\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.731517 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-host\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-tuned\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-host\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-sysctl-d\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-kubernetes\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731495    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-systemd\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-var-lib-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-kubernetes\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-node-log\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731588    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dabab978-57f3-4537-9f11-746e13612ee5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-env-overrides\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-systemd\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-node-log\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731642    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-var-lib-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-ovnkube-script-lib\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.732422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-slash\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-etc-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731779    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-ovn\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-slash\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-ovnkube-config\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-run-ovn\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cace76ee-3d95-443a-b136-c0bc8c43eb3f-iptables-alerter-script\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-etc-openvswitch\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.731982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ddn\" (UniqueName: \"kubernetes.io/projected/cace76ee-3d95-443a-b136-c0bc8c43eb3f-kube-api-access-t7ddn\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-run\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-cni-binary-copy\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732178    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-env-overrides\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/583a5d2c-8614-4de5-891d-fff02318fe22-ovnkube-config\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732602    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/583a5d2c-8614-4de5-891d-fff02318fe22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dabab978-57f3-4537-9f11-746e13612ee5-cni-binary-copy\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.733265 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-run\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.733872 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.732981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-tmp\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.733872 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.733034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cace76ee-3d95-443a-b136-c0bc8c43eb3f-iptables-alerter-script\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.733872 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.733305    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/583a5d2c-8614-4de5-891d-fff02318fe22-ovn-node-metrics-cert\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.734773 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.734748    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-etc-tuned\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.743828 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.743797    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57md\" (UniqueName: \"kubernetes.io/projected/bcd26029-a0d7-47b5-871a-17c117451b7d-kube-api-access-l57md\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:53.745434 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.745380    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkzb8\" (UniqueName: \"kubernetes.io/projected/583a5d2c-8614-4de5-891d-fff02318fe22-kube-api-access-jkzb8\") pod \"ovnkube-node-7lld2\" (UID: \"583a5d2c-8614-4de5-891d-fff02318fe22\") " pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.745546 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.745530    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ddn\" (UniqueName: \"kubernetes.io/projected/cace76ee-3d95-443a-b136-c0bc8c43eb3f-kube-api-access-t7ddn\") pod \"iptables-alerter-6d5hj\" (UID: \"cace76ee-3d95-443a-b136-c0bc8c43eb3f\") " pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.745715 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.745694    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl88x\" (UniqueName: \"kubernetes.io/projected/4af2eade-ea2a-419c-a6e9-2f97181e3ae3-kube-api-access-bl88x\") pod \"tuned-zpm5l\" (UID: \"4af2eade-ea2a-419c-a6e9-2f97181e3ae3\") " pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:53.746203 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.746104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grn7d\" (UniqueName: \"kubernetes.io/projected/dabab978-57f3-4537-9f11-746e13612ee5-kube-api-access-grn7d\") pod \"multus-additional-cni-plugins-wh2cv\" (UID: \"dabab978-57f3-4537-9f11-746e13612ee5\") " pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.813189 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.813154    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:57:53.827685 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.827650    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x"
Sep 10 20:57:53.833864 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.833839    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mm8nb"
Sep 10 20:57:53.842311 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.842286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2dq2"
Sep 10 20:57:53.863462 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.863439    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-49fks"
Sep 10 20:57:53.871455 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.871434    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6d5hj"
Sep 10 20:57:53.879387 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.879369    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wh2cv"
Sep 10 20:57:53.886294 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.886274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:57:53.888376 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:53.888359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpm5l"
Sep 10 20:57:54.135614 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:54.135521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:54.135797 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.135641    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:54.135797 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.135711    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret podName:f2ab6023-1a88-44a8-96ec-40f45d1f5966 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:55.135689726 +0000 UTC m=+4.046969512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret") pod "global-pull-secret-syncer-4htvn" (UID: "f2ab6023-1a88-44a8-96ec-40f45d1f5966") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:54.236872 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:54.236832    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:54.237089 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:54.236928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:54.237089 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.237014    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:54.237089 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.237044    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:54.237089 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.237066    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:54.237089 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.237073    2558 projected.go:196] Error preparing data for projected volume kube-api-access-nb2px for pod openshift-network-diagnostics/network-check-target-dh85p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:54.237343 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.237148    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px podName:fa6762c4-1330-4db5-a255-3867e40e3a21 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:55.237126386 +0000 UTC m=+4.148406149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb2px" (UniqueName: "kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px") pod "network-check-target-dh85p" (UID: "fa6762c4-1330-4db5-a255-3867e40e3a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:54.237343 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:54.237173    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:55.237160457 +0000 UTC m=+4.148440227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:54.599454 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:54.599368    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:54 +0000 UTC" deadline="2028-05-10 18:07:36.297079705 +0000 UTC"
Sep 10 20:57:54.599454 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:54.599403    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14589h9m41.697680171s"
Sep 10 20:57:54.771621 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.771422    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af2eade_ea2a_419c_a6e9_2f97181e3ae3.slice/crio-ee82142e06a9b35f4b96d5052d8991d076307e408577a229b2f8251cdcf65a21 WatchSource:0}: Error finding container ee82142e06a9b35f4b96d5052d8991d076307e408577a229b2f8251cdcf65a21: Status 404 returned error can't find the container with id ee82142e06a9b35f4b96d5052d8991d076307e408577a229b2f8251cdcf65a21
Sep 10 20:57:54.773336 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.773168    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583a5d2c_8614_4de5_891d_fff02318fe22.slice/crio-0d68896ef020505f6c084be54fb11bd636c3aad0c88191c36efff3385be7e439 WatchSource:0}: Error finding container 0d68896ef020505f6c084be54fb11bd636c3aad0c88191c36efff3385be7e439: Status 404 returned error can't find the container with id 0d68896ef020505f6c084be54fb11bd636c3aad0c88191c36efff3385be7e439
Sep 10 20:57:54.775897 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.775719    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eced861_f847_4b96_8e4d_3678f7acb036.slice/crio-063ea3ddd5388bce797f1b6efeb8ccd5d50adf5c1e7e45a8224f9b4db105069f WatchSource:0}: Error finding container 063ea3ddd5388bce797f1b6efeb8ccd5d50adf5c1e7e45a8224f9b4db105069f: Status 404 returned error can't find the container with id 063ea3ddd5388bce797f1b6efeb8ccd5d50adf5c1e7e45a8224f9b4db105069f
Sep 10 20:57:54.778486 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.778463    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabab978_57f3_4537_9f11_746e13612ee5.slice/crio-a9b9c050a33523e457ec616cacd4305172d7b03dd4e39a1f16b3f967a37b0bab WatchSource:0}: Error finding container a9b9c050a33523e457ec616cacd4305172d7b03dd4e39a1f16b3f967a37b0bab: Status 404 returned error can't find the container with id a9b9c050a33523e457ec616cacd4305172d7b03dd4e39a1f16b3f967a37b0bab
Sep 10 20:57:54.802422 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.802390    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37333b6d_ae06_4308_950a_43fb79bee3aa.slice/crio-c216f7b36a692438beb817b7a0c0b5be1832d035977371774ca2f5316a321c97 WatchSource:0}: Error finding container c216f7b36a692438beb817b7a0c0b5be1832d035977371774ca2f5316a321c97: Status 404 returned error can't find the container with id c216f7b36a692438beb817b7a0c0b5be1832d035977371774ca2f5316a321c97
Sep 10 20:57:54.803121 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.803092    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe5234c_2049_492d_bfb4_6532e86a38f3.slice/crio-a4c2c0f6aa28959fcb70e970ea5b64935308211c8d0f5e1f02e0e0b17e5022da WatchSource:0}: Error finding container a4c2c0f6aa28959fcb70e970ea5b64935308211c8d0f5e1f02e0e0b17e5022da: Status 404 returned error can't find the container with id a4c2c0f6aa28959fcb70e970ea5b64935308211c8d0f5e1f02e0e0b17e5022da
Sep 10 20:57:54.804622 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.804483    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7d60d4_7b8b_4684_9417_db0ad44fbc80.slice/crio-ecb70d203243561dc305034a3d355830ca0124d57224dd205f729ca17746d86a WatchSource:0}: Error finding container ecb70d203243561dc305034a3d355830ca0124d57224dd205f729ca17746d86a: Status 404 returned error can't find the container with id ecb70d203243561dc305034a3d355830ca0124d57224dd205f729ca17746d86a
Sep 10 20:57:54.806179 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.806110    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f93e88_b4d5_4485_861b_af8d84281145.slice/crio-15a0fdeca4038757544771f34c00772509dcbaa0c9dd0fd8ce078c00529717ec WatchSource:0}: Error finding container 15a0fdeca4038757544771f34c00772509dcbaa0c9dd0fd8ce078c00529717ec: Status 404 returned error can't find the container with id 15a0fdeca4038757544771f34c00772509dcbaa0c9dd0fd8ce078c00529717ec
Sep 10 20:57:54.806681 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:57:54.806587    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcace76ee_3d95_443a_b136_c0bc8c43eb3f.slice/crio-00bb86e5958fe345bc041981ec4d6fadebc283e99068010a314be8c107275b0a WatchSource:0}: Error finding container 00bb86e5958fe345bc041981ec4d6fadebc283e99068010a314be8c107275b0a: Status 404 returned error can't find the container with id 00bb86e5958fe345bc041981ec4d6fadebc283e99068010a314be8c107275b0a
Sep 10 20:57:54.836845 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:54.836818    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:55.144067 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.143968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:55.144211 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.144154    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:55.144251 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.144221    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret podName:f2ab6023-1a88-44a8-96ec-40f45d1f5966 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.144206637 +0000 UTC m=+6.055486397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret") pod "global-pull-secret-syncer-4htvn" (UID: "f2ab6023-1a88-44a8-96ec-40f45d1f5966") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:55.245876 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.245836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:55.246025 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.245891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:55.246025 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.245997    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:55.246152 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.246079    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.246043162 +0000 UTC m=+6.157322924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:55.246152 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.246105    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:55.246152 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.246128    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:55.246152 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.246148    2558 projected.go:196] Error preparing data for projected volume kube-api-access-nb2px for pod openshift-network-diagnostics/network-check-target-dh85p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:55.246291 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.246206    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px podName:fa6762c4-1330-4db5-a255-3867e40e3a21 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.246189934 +0000 UTC m=+6.157469699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb2px" (UniqueName: "kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px") pod "network-check-target-dh85p" (UID: "fa6762c4-1330-4db5-a255-3867e40e3a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:55.600038 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.599891    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:54 +0000 UTC" deadline="2028-05-29 07:18:13.210478868 +0000 UTC"
Sep 10 20:57:55.600038 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.599961    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15034h20m17.610522129s"
Sep 10 20:57:55.611272 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.611234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:55.611436 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.611377    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:57:55.611874 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.611851    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:55.611998 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.611976    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:57:55.612104 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.612090    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:55.612211 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:55.612190    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:57:55.648410 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.648367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" event={"ID":"2ed333906767c71c570f41bf877f9c1e","Type":"ContainerStarted","Data":"45aa4063322b2f9fb4bd539beba86f21017429723379ee770d6d6d6bed75a93e"}
Sep 10 20:57:55.660958 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.660921    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mm8nb" event={"ID":"d5f93e88-b4d5-4485-861b-af8d84281145","Type":"ContainerStarted","Data":"15a0fdeca4038757544771f34c00772509dcbaa0c9dd0fd8ce078c00529717ec"}
Sep 10 20:57:55.663169 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.663138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-49fks" event={"ID":"ca7d60d4-7b8b-4684-9417-db0ad44fbc80","Type":"ContainerStarted","Data":"ecb70d203243561dc305034a3d355830ca0124d57224dd205f729ca17746d86a"}
Sep 10 20:57:55.669671 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.669430    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" podStartSLOduration=2.669408881 podStartE2EDuration="2.669408881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:55.668408648 +0000 UTC m=+4.579688449" watchObservedRunningTime="2026-09-10 20:57:55.669408881 +0000 UTC m=+4.580688667"
Sep 10 20:57:55.671899 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.671870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2dq2" event={"ID":"37333b6d-ae06-4308-950a-43fb79bee3aa","Type":"ContainerStarted","Data":"c216f7b36a692438beb817b7a0c0b5be1832d035977371774ca2f5316a321c97"}
Sep 10 20:57:55.684066 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.684024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerStarted","Data":"a9b9c050a33523e457ec616cacd4305172d7b03dd4e39a1f16b3f967a37b0bab"}
Sep 10 20:57:55.687342 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.687226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"0d68896ef020505f6c084be54fb11bd636c3aad0c88191c36efff3385be7e439"}
Sep 10 20:57:55.694717 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.694682    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x" event={"ID":"9eced861-f847-4b96-8e4d-3678f7acb036","Type":"ContainerStarted","Data":"063ea3ddd5388bce797f1b6efeb8ccd5d50adf5c1e7e45a8224f9b4db105069f"}
Sep 10 20:57:55.706216 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.706181    2558 generic.go:356] "Generic (PLEG): container finished" podID="b26f6c61717944836eeeddcfa50497e6" containerID="e3351f166ee47e81deba18cb4539e3eebeb36683dfcae21a0354f598e1962c51" exitCode=0
Sep 10 20:57:55.706362 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.706274    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"b26f6c61717944836eeeddcfa50497e6","Type":"ContainerDied","Data":"e3351f166ee47e81deba18cb4539e3eebeb36683dfcae21a0354f598e1962c51"}
Sep 10 20:57:55.722853 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.722751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6d5hj" event={"ID":"cace76ee-3d95-443a-b136-c0bc8c43eb3f","Type":"ContainerStarted","Data":"00bb86e5958fe345bc041981ec4d6fadebc283e99068010a314be8c107275b0a"}
Sep 10 20:57:55.745349 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.745310    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gxs5d" event={"ID":"abe5234c-2049-492d-bfb4-6532e86a38f3","Type":"ContainerStarted","Data":"a4c2c0f6aa28959fcb70e970ea5b64935308211c8d0f5e1f02e0e0b17e5022da"}
Sep 10 20:57:55.757804 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:55.757766    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpm5l" event={"ID":"4af2eade-ea2a-419c-a6e9-2f97181e3ae3","Type":"ContainerStarted","Data":"ee82142e06a9b35f4b96d5052d8991d076307e408577a229b2f8251cdcf65a21"}
Sep 10 20:57:56.777708 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:56.777669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"b26f6c61717944836eeeddcfa50497e6","Type":"ContainerStarted","Data":"362f0b689ee85312e0c53822bf96237687e9de3ce986733eb571a6a7b620f576"}
Sep 10 20:57:56.801252 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:56.801176    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" podStartSLOduration=3.8011493119999997 podStartE2EDuration="3.801149312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:56.800307915 +0000 UTC m=+5.711587722" watchObservedRunningTime="2026-09-10 20:57:56.801149312 +0000 UTC m=+5.712429101"
Sep 10 20:57:57.165595 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:57.165511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:57.165764 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.165733    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:57.165834 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.165814    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret podName:f2ab6023-1a88-44a8-96ec-40f45d1f5966 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:01.165794198 +0000 UTC m=+10.077073981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret") pod "global-pull-secret-syncer-4htvn" (UID: "f2ab6023-1a88-44a8-96ec-40f45d1f5966") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:57.266339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:57.266428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.266553    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.266618    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 20:58:01.266598307 +0000 UTC m=+10.177878073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.267098    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.267141    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.267155    2558 projected.go:196] Error preparing data for projected volume kube-api-access-nb2px for pod openshift-network-diagnostics/network-check-target-dh85p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:57.267277 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.267213    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px podName:fa6762c4-1330-4db5-a255-3867e40e3a21 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:01.267194796 +0000 UTC m=+10.178474577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb2px" (UniqueName: "kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px") pod "network-check-target-dh85p" (UID: "fa6762c4-1330-4db5-a255-3867e40e3a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:57.613071 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:57.609419    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:57.613071 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.609596    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:57:57.613071 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:57.610032    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:57.613071 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.610161    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:57:57.613071 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:57.610231    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:57.613071 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:57.610308    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:57:59.614065 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:59.614031    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:57:59.614776 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:59.614201    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:57:59.614776 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:59.614471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:57:59.614776 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:57:59.614471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:57:59.614776 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:59.614576    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:57:59.614776 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:57:59.614721    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:01.203896 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:01.203857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:01.204461 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.203992    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:01.204461 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.204124    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret podName:f2ab6023-1a88-44a8-96ec-40f45d1f5966 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:09.204052569 +0000 UTC m=+18.115332346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret") pod "global-pull-secret-syncer-4htvn" (UID: "f2ab6023-1a88-44a8-96ec-40f45d1f5966") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:01.305190 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:01.305145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:01.305386 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:01.305240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:01.305451 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.305417    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:01.305451 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.305438    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:01.305556 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.305453    2558 projected.go:196] Error preparing data for projected volume kube-api-access-nb2px for pod openshift-network-diagnostics/network-check-target-dh85p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:01.305556 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.305515    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px podName:fa6762c4-1330-4db5-a255-3867e40e3a21 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:09.305495177 +0000 UTC m=+18.216774942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb2px" (UniqueName: "kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px") pod "network-check-target-dh85p" (UID: "fa6762c4-1330-4db5-a255-3867e40e3a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:01.305670 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.305624    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:01.305670 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.305664    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 20:58:09.305650921 +0000 UTC m=+18.216930689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:01.611300 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:01.611231    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:01.612318 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.612283    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:01.612443 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:01.612333    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:01.612507 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.612434    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:01.612507 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:01.612483    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:01.612607 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:01.612566    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:03.609073 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:03.608812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:03.609527 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:03.608864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:03.609527 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:03.608934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:03.609527 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:03.609218    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:03.609527 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:03.609288    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:03.609527 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:03.609394    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:05.609308 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:05.609273    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:05.609780 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:05.609315    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:05.609780 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:05.609395    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:05.609780 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:05.609438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:05.609780 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:05.609522    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:05.609780 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:05.609566    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:07.609079 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:07.609030    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:07.609547 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:07.609164    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:07.609547 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:07.609030    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:07.609547 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:07.609035    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:07.609547 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:07.609258    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:07.609547 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:07.609347    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:09.262861 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:09.262823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:09.263357 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.263015    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:09.263357 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.263117    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret podName:f2ab6023-1a88-44a8-96ec-40f45d1f5966 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:25.26309435 +0000 UTC m=+34.174374115 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret") pod "global-pull-secret-syncer-4htvn" (UID: "f2ab6023-1a88-44a8-96ec-40f45d1f5966") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:09.363696 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:09.363655    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:09.363867 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:09.363735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:09.363867 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.363810    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:09.363988 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.363877    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 20:58:25.363857547 +0000 UTC m=+34.275137314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:09.363988 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.363885    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:09.363988 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.363904    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:09.363988 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.363918    2558 projected.go:196] Error preparing data for projected volume kube-api-access-nb2px for pod openshift-network-diagnostics/network-check-target-dh85p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:09.363988 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.363967    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px podName:fa6762c4-1330-4db5-a255-3867e40e3a21 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:25.363951613 +0000 UTC m=+34.275231378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb2px" (UniqueName: "kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px") pod "network-check-target-dh85p" (UID: "fa6762c4-1330-4db5-a255-3867e40e3a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:09.609473 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:09.609437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:09.609473 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:09.609458    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:09.609719 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:09.609451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:09.609719 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.609568    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:09.609719 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.609669    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:09.609852 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:09.609755    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:11.610227 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:11.610177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:11.610227 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:11.610222    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:11.610712 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:11.610298    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:11.610712 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:11.610361    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:11.610712 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:11.610404    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:11.610712 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:11.610505    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:13.609646 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.609406    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:13.610426 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.609406    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:13.610426 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:13.609749    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:13.610426 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.609406    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:13.610426 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:13.609853    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:13.610426 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:13.609932    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:13.822021 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.821986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gxs5d" event={"ID":"abe5234c-2049-492d-bfb4-6532e86a38f3","Type":"ContainerStarted","Data":"2c2b4627893ff226e510ecb5b869612e9c29e5b4b1df3b74c9aa6abd57021845"}
Sep 10 20:58:13.823819 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.823788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpm5l" event={"ID":"4af2eade-ea2a-419c-a6e9-2f97181e3ae3","Type":"ContainerStarted","Data":"b7022e9a1230f02d6e7bbb7fc106ab33bdb3aaaf0495898c5ec8073eba35ea49"}
Sep 10 20:58:13.825476 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.825449    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mm8nb" event={"ID":"d5f93e88-b4d5-4485-861b-af8d84281145","Type":"ContainerStarted","Data":"7a62b32d4e8cb1d341463262a17f242079bed5f36edeb02c181a7d8c37b007e0"}
Sep 10 20:58:13.827137 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.827112    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-49fks" event={"ID":"ca7d60d4-7b8b-4684-9417-db0ad44fbc80","Type":"ContainerStarted","Data":"3659460091f250ea7f4234e1f5228634fc76ea59e267232ca910c02538a75d25"}
Sep 10 20:58:13.828755 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.828733    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2dq2" event={"ID":"37333b6d-ae06-4308-950a-43fb79bee3aa","Type":"ContainerStarted","Data":"dae49cc36f61dc519b787c919b4e9e1f0a8ee683f2510781c37daacee7703958"}
Sep 10 20:58:13.830565 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.830540    2558 generic.go:356] "Generic (PLEG): container finished" podID="dabab978-57f3-4537-9f11-746e13612ee5" containerID="61e5459a165bc38fad31c73a94c417f2e2f7bfe3386d253a8c06e2c96acf43a5" exitCode=0
Sep 10 20:58:13.830668 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.830624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerDied","Data":"61e5459a165bc38fad31c73a94c417f2e2f7bfe3386d253a8c06e2c96acf43a5"}
Sep 10 20:58:13.834535 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.834512    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"08f36c72a0517f01cbb482baf5e9fb2fb999b112b7f07615f380f972ece474ab"}
Sep 10 20:58:13.834640 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.834582    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"35f9ebfd111f124e73ba345a8ea6927c564d998e0053687944fca9d74e34610e"}
Sep 10 20:58:13.834640 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.834628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"196d743a22bab7ba30db54826048bdee51b1d7c7570f871dc4fa8f8b26b01f74"}
Sep 10 20:58:13.834750 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.834663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"0ae35e3e8327a7a5cff1fad8b0fe83110b133c335ca5c7d3bd1ac3a432aac4da"}
Sep 10 20:58:13.834750 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.834704    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"af2f6ef9ab77868b2cd195d39140ba510f8f016a6206b72ce31153eacaa2fa00"}
Sep 10 20:58:13.834852 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.834748    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"8b15b9898f078445a8a6cb89236c87a5bcb7c61d7ba699dffbdb196acc5d5455"}
Sep 10 20:58:13.836017 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.835997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x" event={"ID":"9eced861-f847-4b96-8e4d-3678f7acb036","Type":"ContainerStarted","Data":"8cd732e8017bc467e65ffaee1d0245875f8a450464cd3ef81ecf6ed07b6bba48"}
Sep 10 20:58:13.841777 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.841732    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gxs5d" podStartSLOduration=6.923043135 podStartE2EDuration="21.841716564s" totalImagesPullingTime="14.918673429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:13.841604217 +0000 UTC m=+22.752884000" watchObservedRunningTime="2026-09-10 20:58:13.841716564 +0000 UTC m=+22.752996351"
Sep 10 20:58:13.875167 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.875106    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-49fks" podStartSLOduration=3.598983285 podStartE2EDuration="21.875090643s" totalImagesPullingTime="18.276107358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:13.874747285 +0000 UTC m=+22.786027093" watchObservedRunningTime="2026-09-10 20:58:13.875090643 +0000 UTC m=+22.786370422"
Sep 10 20:58:13.981226 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.981171    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zpm5l" podStartSLOduration=3.703291151 podStartE2EDuration="21.981153675s" totalImagesPullingTime="18.277862524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:13.952411014 +0000 UTC m=+22.863690787" watchObservedRunningTime="2026-09-10 20:58:13.981153675 +0000 UTC m=+22.892433453"
Sep 10 20:58:13.981400 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:13.981269    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mm8nb" podStartSLOduration=3.766756045 podStartE2EDuration="21.981262691s" totalImagesPullingTime="18.214506646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:13.980952779 +0000 UTC m=+22.892232562" watchObservedRunningTime="2026-09-10 20:58:13.981262691 +0000 UTC m=+22.892542473"
Sep 10 20:58:14.011540 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.011492    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v2dq2" podStartSLOduration=3.790711579 podStartE2EDuration="22.011472947s" totalImagesPullingTime="18.220761368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.011006759 +0000 UTC m=+22.922286560" watchObservedRunningTime="2026-09-10 20:58:14.011472947 +0000 UTC m=+22.922752729"
Sep 10 20:58:14.120298 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.120214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:14.300948 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.300911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:14.569858 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.569695    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 20:58:14.619720 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.619598    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T20:58:14.569851543Z","UUID":"9446c39c-92ac-4571-b5bf-8555361c2296","Handler":null,"Name":"","Endpoint":""}
Sep 10 20:58:14.620982 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.620965    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 20:58:14.621116 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.620994    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 20:58:14.841135 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.841096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x" event={"ID":"9eced861-f847-4b96-8e4d-3678f7acb036","Type":"ContainerStarted","Data":"f474923f71a2612de82d28f7079eaaf9debed10d8ab0db49496f7202a5067ad8"}
Sep 10 20:58:14.842991 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:14.842965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6d5hj" event={"ID":"cace76ee-3d95-443a-b136-c0bc8c43eb3f","Type":"ContainerStarted","Data":"2dc8a4f8b6d61b11bb3fdde4ea6e762c672b0e9a8e4235ce601b2ba7849391ef"}
Sep 10 20:58:15.065123 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.065087    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:15.165518 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.165396    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:15.285898 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.285855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:15.609736 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.609709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:15.609882 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.609709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:15.609882 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:15.609824    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:15.609882 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.609839    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:15.610073 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:15.609955    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:15.610130 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:15.610071    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:15.849677 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.849639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"d2a4662e1f23795a65f6d6f999551cf194d466fbfaa15974436be650d110976d"}
Sep 10 20:58:15.852190 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.852161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x" event={"ID":"9eced861-f847-4b96-8e4d-3678f7acb036","Type":"ContainerStarted","Data":"fd1e4469644ddac5514b6bc83fd166bcaf43c4ec9dbd413dd0dd1bb829ac03ba"}
Sep 10 20:58:15.880593 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.880544    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qm44x" podStartSLOduration=3.550254922 podStartE2EDuration="23.88052074s" totalImagesPullingTime="20.330265818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:15.880283427 +0000 UTC m=+24.791563406" watchObservedRunningTime="2026-09-10 20:58:15.88052074 +0000 UTC m=+24.791800523"
Sep 10 20:58:15.880787 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:15.880768    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6d5hj" podStartSLOduration=8.96781797 podStartE2EDuration="23.880762643s" totalImagesPullingTime="14.912944673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.891967039 +0000 UTC m=+23.803246841" watchObservedRunningTime="2026-09-10 20:58:15.880762643 +0000 UTC m=+24.792042478"
Sep 10 20:58:17.609279 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:17.609247    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:17.609632 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:17.609249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:17.609632 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:17.609358    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:17.609632 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:17.609379    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:17.609632 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:17.609452    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:17.609632 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:17.609519    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:18.344486 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:18.344440    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:58:18.345210 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:18.345187    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:58:18.863086 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:18.862905    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" event={"ID":"583a5d2c-8614-4de5-891d-fff02318fe22","Type":"ContainerStarted","Data":"c7f34c7671b3906a96630e1a3b1e91687af581e400bac14135d4bace0825f5a8"}
Sep 10 20:58:18.863424 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:18.863262    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:58:18.863640 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:18.863626    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gxs5d"
Sep 10 20:58:18.947572 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:18.947522    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2" podStartSLOduration=8.642884368 podStartE2EDuration="26.947505413s" totalImagesPullingTime="18.304621045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:18.918959256 +0000 UTC m=+27.830239056" watchObservedRunningTime="2026-09-10 20:58:18.947505413 +0000 UTC m=+27.858785195"
Sep 10 20:58:19.062967 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.062935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:19.256072 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.255967    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:19.377236 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.377196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:19.483390 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.483358    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:19.609083 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.609059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:19.609240 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.609066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:19.609240 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:19.609145    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:19.609240 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.609165    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:19.609407 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:19.609237    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:19.609407 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:19.609294    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:19.867689 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.867613    2558 generic.go:356] "Generic (PLEG): container finished" podID="dabab978-57f3-4537-9f11-746e13612ee5" containerID="4461d5de18eada37e11d118db5d5b621b23f6db205780f73b25e63a44e32ad07" exitCode=0
Sep 10 20:58:19.868198 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.867690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerDied","Data":"4461d5de18eada37e11d118db5d5b621b23f6db205780f73b25e63a44e32ad07"}
Sep 10 20:58:19.868198 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.867957    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:58:19.868767 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.868383    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:58:19.868767 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.868436    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:58:19.883878 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.883854    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:58:19.884017 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:19.883970    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:58:20.151521 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.151400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:20.263680 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.263645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:20.665026 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.664983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dh85p"]
Sep 10 20:58:20.665210 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.665134    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:20.665260 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:20.665220    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:20.667556 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.667486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4sm2d"]
Sep 10 20:58:20.667684 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.667660    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:20.667806 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:20.667785    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:20.668068 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.668034    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4htvn"]
Sep 10 20:58:20.668149 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:20.668137    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:20.668230 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:20.668215    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:21.874128 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:21.873920    2558 generic.go:356] "Generic (PLEG): container finished" podID="dabab978-57f3-4537-9f11-746e13612ee5" containerID="72d2bbce2809b8e1003851b8d571d887bd4def3340a1c0f6d7797c4aca254adc" exitCode=0
Sep 10 20:58:21.874128 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:21.873994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerDied","Data":"72d2bbce2809b8e1003851b8d571d887bd4def3340a1c0f6d7797c4aca254adc"}
Sep 10 20:58:22.609575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:22.609550    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:22.609575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:22.609569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:22.609695 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:22.609661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:22.609695 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:22.609676    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:22.609775 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:22.609755    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:22.609868 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:22.609851    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:22.878424 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:22.878393    2558 generic.go:356] "Generic (PLEG): container finished" podID="dabab978-57f3-4537-9f11-746e13612ee5" containerID="ba20847a0d6b18cada810bfa2e094006fb3b40867e2df6926b637adb2876f3e9" exitCode=0
Sep 10 20:58:22.878783 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:22.878443    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerDied","Data":"ba20847a0d6b18cada810bfa2e094006fb3b40867e2df6926b637adb2876f3e9"}
Sep 10 20:58:24.608681 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:24.608653    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:24.608681 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:24.608666    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:24.609241 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:24.608745    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:24.609241 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:24.608808    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:24.609241 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:24.608908    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:24.609241 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:24.609007    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:25.184914 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:25.184884    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:25.280378 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:25.280342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:25.280564 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.280471    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:25.280564 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.280546    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret podName:f2ab6023-1a88-44a8-96ec-40f45d1f5966 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:57.280518215 +0000 UTC m=+66.191797991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret") pod "global-pull-secret-syncer-4htvn" (UID: "f2ab6023-1a88-44a8-96ec-40f45d1f5966") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:25.285299 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:25.285268    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:25.381429 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:25.381392    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:25.381591 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:25.381458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:25.381591 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.381564    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:25.381669 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.381596    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:25.381669 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.381618    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 20:58:57.381602323 +0000 UTC m=+66.292882105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:25.381669 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.381622    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:25.381669 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.381638    2558 projected.go:196] Error preparing data for projected volume kube-api-access-nb2px for pod openshift-network-diagnostics/network-check-target-dh85p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:25.381834 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:25.381694    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px podName:fa6762c4-1330-4db5-a255-3867e40e3a21 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:57.381677584 +0000 UTC m=+66.292957349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb2px" (UniqueName: "kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px") pod "network-check-target-dh85p" (UID: "fa6762c4-1330-4db5-a255-3867e40e3a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:25.387611 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:25.387567    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:26.136856 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:26.136823    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:26.242926 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:26.242887    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:26.608896 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:26.608861    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:26.608896 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:26.608878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:26.609143 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:26.608878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:26.609143 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:26.608991    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sm2d" podUID="bcd26029-a0d7-47b5-871a-17c117451b7d"
Sep 10 20:58:26.609143 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:26.609092    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4htvn" podUID="f2ab6023-1a88-44a8-96ec-40f45d1f5966"
Sep 10 20:58:26.609256 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:26.609171    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dh85p" podUID="fa6762c4-1330-4db5-a255-3867e40e3a21"
Sep 10 20:58:26.931741 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:26.931713    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeReady"
Sep 10 20:58:26.931920 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:26.931877    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 20:58:27.015276 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.015240    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5p67d"]
Sep 10 20:58:27.043363 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.043334    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sch6g"]
Sep 10 20:58:27.043540 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.043486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.048019 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.047990    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 20:58:27.048162 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.048061    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hkk2\""
Sep 10 20:58:27.048162 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.048061    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 20:58:27.063303 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.063275    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5p67d"]
Sep 10 20:58:27.063440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.063321    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sch6g"]
Sep 10 20:58:27.063440 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.063387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.066883 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.066853    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 20:58:27.066883 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.066868    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 20:58:27.067076 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.066922    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 20:58:27.067076 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.066980    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-278wb\""
Sep 10 20:58:27.195008 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.194922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.195008 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.194994    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-config-volume\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.195542 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.195055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-tmp-dir\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.195600 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.195576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr68x\" (UniqueName: \"kubernetes.io/projected/b35daeae-e0d5-4dd3-b34d-85c520c137de-kube-api-access-dr68x\") pod \"ingress-canary-sch6g\" (UID: \"b35daeae-e0d5-4dd3-b34d-85c520c137de\") " pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.198432 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.198392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4gc5\" (UniqueName: \"kubernetes.io/projected/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-kube-api-access-j4gc5\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.198568 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.198444    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b35daeae-e0d5-4dd3-b34d-85c520c137de-cert\") pod \"ingress-canary-sch6g\" (UID: \"b35daeae-e0d5-4dd3-b34d-85c520c137de\") " pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.241380 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.241340    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:27.299350 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-tmp-dir\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.299350 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr68x\" (UniqueName: \"kubernetes.io/projected/b35daeae-e0d5-4dd3-b34d-85c520c137de-kube-api-access-dr68x\") pod \"ingress-canary-sch6g\" (UID: \"b35daeae-e0d5-4dd3-b34d-85c520c137de\") " pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.299575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4gc5\" (UniqueName: \"kubernetes.io/projected/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-kube-api-access-j4gc5\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.299575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b35daeae-e0d5-4dd3-b34d-85c520c137de-cert\") pod \"ingress-canary-sch6g\" (UID: \"b35daeae-e0d5-4dd3-b34d-85c520c137de\") " pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.299575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.299575 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-config-volume\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.299753 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:27.299588    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:27.299753 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:27.299662    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls podName:b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c nodeName:}" failed. No retries permitted until 2026-09-10 20:58:27.799641957 +0000 UTC m=+36.710921718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls") pod "dns-default-5p67d" (UID: "b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:27.299753 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-tmp-dir\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.299942 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.299927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-config-volume\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.303550 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.303528    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b35daeae-e0d5-4dd3-b34d-85c520c137de-cert\") pod \"ingress-canary-sch6g\" (UID: \"b35daeae-e0d5-4dd3-b34d-85c520c137de\") " pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.313876 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.313851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4gc5\" (UniqueName: \"kubernetes.io/projected/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-kube-api-access-j4gc5\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.314226 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.314207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr68x\" (UniqueName: \"kubernetes.io/projected/b35daeae-e0d5-4dd3-b34d-85c520c137de-kube-api-access-dr68x\") pod \"ingress-canary-sch6g\" (UID: \"b35daeae-e0d5-4dd3-b34d-85c520c137de\") " pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.340463 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.340435    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:27.371350 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.371316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sch6g"
Sep 10 20:58:27.757009 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.756793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sch6g"]
Sep 10 20:58:27.762156 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:58:27.762130    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35daeae_e0d5_4dd3_b34d_85c520c137de.slice/crio-fdc89d1076c31ffb78d30742664dfe2136716a07af3fc9027d319737f638961c WatchSource:0}: Error finding container fdc89d1076c31ffb78d30742664dfe2136716a07af3fc9027d319737f638961c: Status 404 returned error can't find the container with id fdc89d1076c31ffb78d30742664dfe2136716a07af3fc9027d319737f638961c
Sep 10 20:58:27.803725 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.803695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:27.803856 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:27.803838    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:27.803910 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:27.803905    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls podName:b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c nodeName:}" failed. No retries permitted until 2026-09-10 20:58:28.803889451 +0000 UTC m=+37.715169211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls") pod "dns-default-5p67d" (UID: "b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:27.892668 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.892633    2558 generic.go:356] "Generic (PLEG): container finished" podID="dabab978-57f3-4537-9f11-746e13612ee5" containerID="b6331f852728a3cc5cd94a21a87b0c16133ee600f3c98ecaa28eccba2531fb64" exitCode=0
Sep 10 20:58:27.892816 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.892685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerDied","Data":"b6331f852728a3cc5cd94a21a87b0c16133ee600f3c98ecaa28eccba2531fb64"}
Sep 10 20:58:27.893900 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:27.893881    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sch6g" event={"ID":"b35daeae-e0d5-4dd3-b34d-85c520c137de","Type":"ContainerStarted","Data":"fdc89d1076c31ffb78d30742664dfe2136716a07af3fc9027d319737f638961c"}
Sep 10 20:58:28.609037 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.609002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:28.609712 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.609002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:28.609712 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.609006    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:28.612844 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.612822    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:58:28.613212 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.613188    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 20:58:28.613421 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.613399    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ll8tt\""
Sep 10 20:58:28.613421 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.613418    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tjcr5\""
Sep 10 20:58:28.613568 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.613439    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 20:58:28.613780 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.613765    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:58:28.812839 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.812790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:28.813065 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:28.813022    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:28.813149 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:28.813121    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls podName:b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.813099639 +0000 UTC m=+39.724379401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls") pod "dns-default-5p67d" (UID: "b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:28.900327 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.900240    2558 generic.go:356] "Generic (PLEG): container finished" podID="dabab978-57f3-4537-9f11-746e13612ee5" containerID="1d1cee0896b7d57fae39ff0b9a458a0c621f444253bb74772319c9ba5d4d76c9" exitCode=0
Sep 10 20:58:28.900327 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:28.900308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerDied","Data":"1d1cee0896b7d57fae39ff0b9a458a0c621f444253bb74772319c9ba5d4d76c9"}
Sep 10 20:58:29.120935 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:29.120898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:29.597891 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:29.597856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:29.694297 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:29.694248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:29.907867 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:29.907777    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" event={"ID":"dabab978-57f3-4537-9f11-746e13612ee5","Type":"ContainerStarted","Data":"8065df7462bbf519ae69a444bb6c3cf46a04ce1866de904559221fab5965eda3"}
Sep 10 20:58:29.945345 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:29.945283    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wh2cv" podStartSLOduration=8.36415661 podStartE2EDuration="37.945263886s" totalImagesPullingTime="29.581107276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:29.944353958 +0000 UTC m=+38.855633776" watchObservedRunningTime="2026-09-10 20:58:29.945263886 +0000 UTC m=+38.856543678"
Sep 10 20:58:30.110014 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:30.109979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:30.210066 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:30.209976    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:30.826196 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:30.825968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:30.826535 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:30.826138    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:30.826535 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:30.826323    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls podName:b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c nodeName:}" failed. No retries permitted until 2026-09-10 20:58:34.826308516 +0000 UTC m=+43.737588280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls") pod "dns-default-5p67d" (UID: "b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:30.911468 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:30.911429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sch6g" event={"ID":"b35daeae-e0d5-4dd3-b34d-85c520c137de","Type":"ContainerStarted","Data":"513fc20465724f24e95d7f1ddf5f3c1f09422dcea1d3888c6713a45a52a1dd8d"}
Sep 10 20:58:30.934089 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:30.934022    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sch6g" podStartSLOduration=2.19050579 podStartE2EDuration="4.934005805s" totalImagesPullingTime="2.743500015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:30.93233626 +0000 UTC m=+39.843616042" watchObservedRunningTime="2026-09-10 20:58:30.934005805 +0000 UTC m=+39.845285587"
Sep 10 20:58:31.268245 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:31.268168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:31.360344 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:31.360310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:34.853624 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:34.853581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:34.854111 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:34.853783    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:34.854111 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:34.853870    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls podName:b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.853847414 +0000 UTC m=+51.765127189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls") pod "dns-default-5p67d" (UID: "b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:37.289799 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:37.289763    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:37.373523 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:37.373486    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:39.192129 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:39.192092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:39.272257 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:39.272220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:40.002832 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.002796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:40.098037 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.098006    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:40.485476 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.485442    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"]
Sep 10 20:58:40.513358 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.513326    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"]
Sep 10 20:58:40.513535 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.513422    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"
Sep 10 20:58:40.517988 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.517965    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:40.518131 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.518040    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 20:58:40.518354 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.518340    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hqp7q\""
Sep 10 20:58:40.693823 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.693788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb4l5\" (UniqueName: \"kubernetes.io/projected/71c28223-175b-4940-b071-b2d3ad49d494-kube-api-access-xb4l5\") pod \"volume-data-source-validator-86695b7cc7-wwhs9\" (UID: \"71c28223-175b-4940-b071-b2d3ad49d494\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"
Sep 10 20:58:40.786322 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.786246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:40.794222 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.794201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb4l5\" (UniqueName: \"kubernetes.io/projected/71c28223-175b-4940-b071-b2d3ad49d494-kube-api-access-xb4l5\") pod \"volume-data-source-validator-86695b7cc7-wwhs9\" (UID: \"71c28223-175b-4940-b071-b2d3ad49d494\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"
Sep 10 20:58:40.809531 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.809501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb4l5\" (UniqueName: \"kubernetes.io/projected/71c28223-175b-4940-b071-b2d3ad49d494-kube-api-access-xb4l5\") pod \"volume-data-source-validator-86695b7cc7-wwhs9\" (UID: \"71c28223-175b-4940-b071-b2d3ad49d494\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"
Sep 10 20:58:40.822117 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.822097    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"
Sep 10 20:58:40.907535 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.907486    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:40.929927 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.929890    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dd54c6d84-l6btj"]
Sep 10 20:58:40.952636 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.952608    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dd54c6d84-l6btj"]
Sep 10 20:58:40.952809 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.952698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:40.955478 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.955452    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8bbrk\""
Sep 10 20:58:40.955602 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.955487    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 20:58:40.955602 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.955511    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 20:58:40.955602 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.955512    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 20:58:40.962137 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:40.962119    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 20:58:41.096244 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-certificates\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.096396 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.096396 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1387f2bb-f266-4bb4-8523-14ee3c4be4be-ca-trust-extracted\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.096396 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-installation-pull-secrets\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.096629 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-image-registry-private-configuration\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.096629 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-bound-sa-token\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.096629 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z48sq\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-kube-api-access-z48sq\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.096629 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.096508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-trusted-ca\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.108037 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.108012    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9"]
Sep 10 20:58:41.111142 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:58:41.111116    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c28223_175b_4940_b071_b2d3ad49d494.slice/crio-dd5903df8f910b2ee94ce47578c476bd132a6df4e16f06fc7df5e0cbfa24f248 WatchSource:0}: Error finding container dd5903df8f910b2ee94ce47578c476bd132a6df4e16f06fc7df5e0cbfa24f248: Status 404 returned error can't find the container with id dd5903df8f910b2ee94ce47578c476bd132a6df4e16f06fc7df5e0cbfa24f248
Sep 10 20:58:41.197697 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.197660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-trusted-ca\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.197861 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.197725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-certificates\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.197861 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.197775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.197861 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.197808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1387f2bb-f266-4bb4-8523-14ee3c4be4be-ca-trust-extracted\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.197861 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.197839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-installation-pull-secrets\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.198022 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.197889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-image-registry-private-configuration\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.198022 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:41.197912    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:41.198022 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:41.197932    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dd54c6d84-l6btj: secret "image-registry-tls" not found
Sep 10 20:58:41.198022 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:41.198000    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls podName:1387f2bb-f266-4bb4-8523-14ee3c4be4be nodeName:}" failed. No retries permitted until 2026-09-10 20:58:41.697978463 +0000 UTC m=+50.609258224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls") pod "image-registry-7dd54c6d84-l6btj" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be") : secret "image-registry-tls" not found
Sep 10 20:58:41.198258 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.198082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-bound-sa-token\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.198258 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.198127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z48sq\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-kube-api-access-z48sq\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.198498 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.198476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-certificates\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.198498 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.198499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1387f2bb-f266-4bb4-8523-14ee3c4be4be-ca-trust-extracted\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.198923 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.198902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-trusted-ca\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.200361 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.200340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-installation-pull-secrets\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.200450 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.200431    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-image-registry-private-configuration\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.209642 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.209615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-bound-sa-token\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.209717 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.209673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z48sq\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-kube-api-access-z48sq\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.701561 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.701525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:41.701931 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:41.701671    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:41.701931 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:41.701688    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dd54c6d84-l6btj: secret "image-registry-tls" not found
Sep 10 20:58:41.701931 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:41.701741    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls podName:1387f2bb-f266-4bb4-8523-14ee3c4be4be nodeName:}" failed. No retries permitted until 2026-09-10 20:58:42.7017252 +0000 UTC m=+51.613004959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls") pod "image-registry-7dd54c6d84-l6btj" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be") : secret "image-registry-tls" not found
Sep 10 20:58:41.938268 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:41.938222    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9" event={"ID":"71c28223-175b-4940-b071-b2d3ad49d494","Type":"ContainerStarted","Data":"dd5903df8f910b2ee94ce47578c476bd132a6df4e16f06fc7df5e0cbfa24f248"}
Sep 10 20:58:42.482832 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:42.482797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:42.599329 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:42.599293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:42.708923 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:42.708895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:42.709228 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:42.709030    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:42.709228 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:42.709057    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dd54c6d84-l6btj: secret "image-registry-tls" not found
Sep 10 20:58:42.709228 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:42.709110    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls podName:1387f2bb-f266-4bb4-8523-14ee3c4be4be nodeName:}" failed. No retries permitted until 2026-09-10 20:58:44.709093248 +0000 UTC m=+53.620373011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls") pod "image-registry-7dd54c6d84-l6btj" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be") : secret "image-registry-tls" not found
Sep 10 20:58:42.910969 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:42.910930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:42.911139 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:42.911096    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:42.911199 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:42.911159    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls podName:b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c nodeName:}" failed. No retries permitted until 2026-09-10 20:58:58.911142061 +0000 UTC m=+67.822421826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls") pod "dns-default-5p67d" (UID: "b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:42.941891 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:42.941858    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9" event={"ID":"71c28223-175b-4940-b071-b2d3ad49d494","Type":"ContainerStarted","Data":"dbb814556f479131a168301807724eb24a904f1696d254fbac0defc19039a5cc"}
Sep 10 20:58:42.970578 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:42.970527    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-wwhs9" podStartSLOduration=1.458665457 podStartE2EDuration="2.970510294s" totalImagesPullingTime="1.511844837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:42.970000393 +0000 UTC m=+51.881280200" watchObservedRunningTime="2026-09-10 20:58:42.970510294 +0000 UTC m=+51.881790075"
Sep 10 20:58:43.105622 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.105589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:43.372829 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.372795    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"]
Sep 10 20:58:43.390029 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.390002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.390374 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.390346    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"]
Sep 10 20:58:43.392793 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.392772    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 20:58:43.393411 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.393387    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4swgg\""
Sep 10 20:58:43.393557 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.393538    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 20:58:43.393611 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.393567    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 20:58:43.394816 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.394801    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:43.514737 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.514688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1395e3ad-48ba-4e33-a176-8966702e5402-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.514737 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.514743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1395e3ad-48ba-4e33-a176-8966702e5402-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.514934 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.514775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5pzz\" (UniqueName: \"kubernetes.io/projected/1395e3ad-48ba-4e33-a176-8966702e5402-kube-api-access-c5pzz\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.615185 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.615148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1395e3ad-48ba-4e33-a176-8966702e5402-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.615185 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.615183    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1395e3ad-48ba-4e33-a176-8966702e5402-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.615422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.615210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5pzz\" (UniqueName: \"kubernetes.io/projected/1395e3ad-48ba-4e33-a176-8966702e5402-kube-api-access-c5pzz\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.615707 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.615684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1395e3ad-48ba-4e33-a176-8966702e5402-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.617361 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.617330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1395e3ad-48ba-4e33-a176-8966702e5402-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.625765 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.625714    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5pzz\" (UniqueName: \"kubernetes.io/projected/1395e3ad-48ba-4e33-a176-8966702e5402-kube-api-access-c5pzz\") pod \"kube-storage-version-migrator-operator-6c8f84f897-47xx8\" (UID: \"1395e3ad-48ba-4e33-a176-8966702e5402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.699164 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.699119    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"
Sep 10 20:58:43.974535 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:43.974463    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8"]
Sep 10 20:58:43.977461 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:58:43.977418    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1395e3ad_48ba_4e33_a176_8966702e5402.slice/crio-37a3810fff88dfa2219fd1bd384c8a80f66fb7d87a9730df5768d851d406b7a5 WatchSource:0}: Error finding container 37a3810fff88dfa2219fd1bd384c8a80f66fb7d87a9730df5768d851d406b7a5: Status 404 returned error can't find the container with id 37a3810fff88dfa2219fd1bd384c8a80f66fb7d87a9730df5768d851d406b7a5
Sep 10 20:58:44.722143 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:44.722095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:44.722345 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:44.722263    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:44.722345 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:44.722286    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dd54c6d84-l6btj: secret "image-registry-tls" not found
Sep 10 20:58:44.722452 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:44.722376    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls podName:1387f2bb-f266-4bb4-8523-14ee3c4be4be nodeName:}" failed. No retries permitted until 2026-09-10 20:58:48.722353006 +0000 UTC m=+57.633632774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls") pod "image-registry-7dd54c6d84-l6btj" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be") : secret "image-registry-tls" not found
Sep 10 20:58:44.947833 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:44.947794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8" event={"ID":"1395e3ad-48ba-4e33-a176-8966702e5402","Type":"ContainerStarted","Data":"37a3810fff88dfa2219fd1bd384c8a80f66fb7d87a9730df5768d851d406b7a5"}
Sep 10 20:58:45.461273 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.461236    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"]
Sep 10 20:58:45.463345 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.463326    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"
Sep 10 20:58:45.466513 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.466490    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8sqrl\""
Sep 10 20:58:45.483010 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.482985    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"]
Sep 10 20:58:45.535025 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.534983    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:45.540786 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.540758    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9zjlg"]
Sep 10 20:58:45.542937 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.542904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.545257 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.545226    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 20:58:45.545394 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.545236    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 20:58:45.545394 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.545264    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 20:58:45.545723 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.545706    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 20:58:45.545960 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.545920    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k7jqh\""
Sep 10 20:58:45.566040 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.566012    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zjlg"]
Sep 10 20:58:45.628634 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.628602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbv6w\" (UniqueName: \"kubernetes.io/projected/8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7-kube-api-access-dbv6w\") pod \"network-check-source-6f8b768455-x5fnd\" (UID: \"8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"
Sep 10 20:58:45.730070 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.729964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.730070 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.730040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e21a780-6040-4adc-bffc-ac0c2a120682-crio-socket\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.730297 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.730143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxzhx\" (UniqueName: \"kubernetes.io/projected/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-api-access-vxzhx\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.730297 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.730192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e21a780-6040-4adc-bffc-ac0c2a120682-data-volume\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.730297 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.730254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbv6w\" (UniqueName: \"kubernetes.io/projected/8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7-kube-api-access-dbv6w\") pod \"network-check-source-6f8b768455-x5fnd\" (UID: \"8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"
Sep 10 20:58:45.730297 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.730281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.740557 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.740523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbv6w\" (UniqueName: \"kubernetes.io/projected/8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7-kube-api-access-dbv6w\") pod \"network-check-source-6f8b768455-x5fnd\" (UID: \"8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"
Sep 10 20:58:45.773508 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.773463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"
Sep 10 20:58:45.831589 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.831536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.831770 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.831622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.831770 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.831664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e21a780-6040-4adc-bffc-ac0c2a120682-crio-socket\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.831770 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:45.831672    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:45.831770 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.831708    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxzhx\" (UniqueName: \"kubernetes.io/projected/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-api-access-vxzhx\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.831770 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:45.831755    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:46.331734039 +0000 UTC m=+55.243013822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:45.832038 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.831803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e21a780-6040-4adc-bffc-ac0c2a120682-data-volume\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.832038 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:45.831808    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:45.832038 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:45.831882    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:46.331862798 +0000 UTC m=+55.243142559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:45.832038 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.831899    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e21a780-6040-4adc-bffc-ac0c2a120682-crio-socket\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.832243 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.832179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e21a780-6040-4adc-bffc-ac0c2a120682-data-volume\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:45.841498 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:45.841466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxzhx\" (UniqueName: \"kubernetes.io/projected/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-api-access-vxzhx\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:46.131647 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:46.128712    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd"]
Sep 10 20:58:46.132256 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:58:46.132231    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8b3034_0c5b_4b1e_ace7_2a4af3f297e7.slice/crio-92d90493f09cb73ec3102ee5d50d74119b17609410697a5be8c4ef46b45fa8d2 WatchSource:0}: Error finding container 92d90493f09cb73ec3102ee5d50d74119b17609410697a5be8c4ef46b45fa8d2: Status 404 returned error can't find the container with id 92d90493f09cb73ec3102ee5d50d74119b17609410697a5be8c4ef46b45fa8d2
Sep 10 20:58:46.336057 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:46.336004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:46.336216 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:46.336083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:46.336216 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:46.336138    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:46.336286 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:46.336220    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:47.336194244 +0000 UTC m=+56.247474013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:46.336286 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:46.336232    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:46.336352 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:46.336300    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:47.336285876 +0000 UTC m=+56.247565640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:46.946800 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:46.946759    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:46.954969 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:46.954935    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd" event={"ID":"8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7","Type":"ContainerStarted","Data":"92d90493f09cb73ec3102ee5d50d74119b17609410697a5be8c4ef46b45fa8d2"}
Sep 10 20:58:46.956793 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:46.956759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8" event={"ID":"1395e3ad-48ba-4e33-a176-8966702e5402","Type":"ContainerStarted","Data":"48f39fe0edd1732e79d6f0f5d2d928846624dfcb09237d0018c21c2295099885"}
Sep 10 20:58:46.992061 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:46.991992    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8" podStartSLOduration=2.0884755 podStartE2EDuration="3.991969591s" totalImagesPullingTime="1.903494091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:46.991672592 +0000 UTC m=+55.902952399" watchObservedRunningTime="2026-09-10 20:58:46.991969591 +0000 UTC m=+55.903249374"
Sep 10 20:58:47.023699 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.023667    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"]
Sep 10 20:58:47.025681 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.025643    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"
Sep 10 20:58:47.029063 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.029023    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7kzxq\""
Sep 10 20:58:47.029363 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.029345    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 10 20:58:47.029462 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.029422    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:47.041869 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.041684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhnnl\" (UniqueName: \"kubernetes.io/projected/ec7352cf-af57-4eff-a5b5-525d4388897a-kube-api-access-bhnnl\") pod \"migrator-8b4d697c5-jp692\" (UID: \"ec7352cf-af57-4eff-a5b5-525d4388897a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"
Sep 10 20:58:47.042191 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.042164    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"]
Sep 10 20:58:47.089447 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.089395    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:47.142481 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.142445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnnl\" (UniqueName: \"kubernetes.io/projected/ec7352cf-af57-4eff-a5b5-525d4388897a-kube-api-access-bhnnl\") pod \"migrator-8b4d697c5-jp692\" (UID: \"ec7352cf-af57-4eff-a5b5-525d4388897a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"
Sep 10 20:58:47.154117 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.154091    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhnnl\" (UniqueName: \"kubernetes.io/projected/ec7352cf-af57-4eff-a5b5-525d4388897a-kube-api-access-bhnnl\") pod \"migrator-8b4d697c5-jp692\" (UID: \"ec7352cf-af57-4eff-a5b5-525d4388897a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"
Sep 10 20:58:47.253832 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.253726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:47.338127 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.338091    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"
Sep 10 20:58:47.344696 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.344669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:47.344824 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.344733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:47.344824 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:47.344777    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:47.344945 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:47.344864    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:49.344844521 +0000 UTC m=+58.256124301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:47.344945 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:47.344886    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:47.344945 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:47.344941    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:49.344923987 +0000 UTC m=+58.256203753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:47.430970 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.430945    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mm8nb_d5f93e88-b4d5-4485-861b-af8d84281145/dns-node-resolver/0.log"
Sep 10 20:58:47.630288 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.630257    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692"]
Sep 10 20:58:47.634724 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:58:47.634689    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7352cf_af57_4eff_a5b5_525d4388897a.slice/crio-969c30133e56893c3a5d989858c6a10bf773c22f5d707d83c8fc46b4daa2f6d6 WatchSource:0}: Error finding container 969c30133e56893c3a5d989858c6a10bf773c22f5d707d83c8fc46b4daa2f6d6: Status 404 returned error can't find the container with id 969c30133e56893c3a5d989858c6a10bf773c22f5d707d83c8fc46b4daa2f6d6
Sep 10 20:58:47.961244 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:47.961154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692" event={"ID":"ec7352cf-af57-4eff-a5b5-525d4388897a","Type":"ContainerStarted","Data":"969c30133e56893c3a5d989858c6a10bf773c22f5d707d83c8fc46b4daa2f6d6"}
Sep 10 20:58:48.629852 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:48.629827    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2dq2_37333b6d-ae06-4308-950a-43fb79bee3aa/node-ca/0.log"
Sep 10 20:58:48.756336 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:48.756296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:48.756509 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:48.756442    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:48.756509 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:48.756456    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dd54c6d84-l6btj: secret "image-registry-tls" not found
Sep 10 20:58:48.756606 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:48.756512    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls podName:1387f2bb-f266-4bb4-8523-14ee3c4be4be nodeName:}" failed. No retries permitted until 2026-09-10 20:58:56.756494404 +0000 UTC m=+65.667774177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls") pod "image-registry-7dd54c6d84-l6btj" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be") : secret "image-registry-tls" not found
Sep 10 20:58:49.360804 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:49.360769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:49.361299 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:49.360836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:49.361299 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:49.360906    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:49.361299 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:49.360965    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:49.361299 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:49.361003    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:53.360981764 +0000 UTC m=+62.272261530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:49.361299 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:49.361023    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:53.361015221 +0000 UTC m=+62.272294981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:49.431591 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:49.431560    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sch6g_b35daeae-e0d5-4dd3-b34d-85c520c137de/serve-healthcheck-canary/0.log"
Sep 10 20:58:49.967834 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:49.967789    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd" event={"ID":"8f8b3034-0c5b-4b1e-ace7-2a4af3f297e7","Type":"ContainerStarted","Data":"ef7c5f2fa54bedb632a9a601a2576a2cfe81f98d4aa892fb3840ea4bba22c055"}
Sep 10 20:58:49.986646 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:49.986587    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-x5fnd" podStartSLOduration=2.203005 podStartE2EDuration="4.986570577s" totalImagesPullingTime="2.783565577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:49.985462924 +0000 UTC m=+58.896742722" watchObservedRunningTime="2026-09-10 20:58:49.986570577 +0000 UTC m=+58.897850359"
Sep 10 20:58:50.973285 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:50.973242    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692" event={"ID":"ec7352cf-af57-4eff-a5b5-525d4388897a","Type":"ContainerStarted","Data":"bf1c6f982dbace2fcec875b1796605a486dd1ef69bf309aebf9cb56932539587"}
Sep 10 20:58:50.973632 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:50.973347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692" event={"ID":"ec7352cf-af57-4eff-a5b5-525d4388897a","Type":"ContainerStarted","Data":"471b84786aba702c9f027a1c59884f9743f199a55ec738c5c274a339f95d9386"}
Sep 10 20:58:51.004755 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.004698    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jp692" podStartSLOduration=2.571342001 podStartE2EDuration="5.004678216s" totalImagesPullingTime="2.433336215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:51.003193236 +0000 UTC m=+59.914473018" watchObservedRunningTime="2026-09-10 20:58:51.004678216 +0000 UTC m=+59.915957998"
Sep 10 20:58:51.125382 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.125351    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:51.208984 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.208942    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:51.515435 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.515405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:51.625134 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.625106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:51.804180 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.804145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:51.885166 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.885138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7lld2"
Sep 10 20:58:51.894640 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:51.894618    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.110671 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:52.110586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.215419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:52.215389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.311389 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:52.311359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:53.395871 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:53.395833    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:53.396295 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:53.395885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:58:53.396295 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:53.395983    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:53.396295 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:53.396034    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:59:01.396019781 +0000 UTC m=+70.307299542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:53.396295 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:53.396079    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:53.396295 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:53.396152    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:59:01.39613198 +0000 UTC m=+70.307411742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:53.932430 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:53.932389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:54.034794 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:54.034754    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:55.785948 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:55.785914    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:56.822823 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:56.822782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:58:56.823324 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:56.822936    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 20:58:56.823324 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:56.822953    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dd54c6d84-l6btj: secret "image-registry-tls" not found
Sep 10 20:58:56.823324 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:56.823005    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls podName:1387f2bb-f266-4bb4-8523-14ee3c4be4be nodeName:}" failed. No retries permitted until 2026-09-10 20:59:12.822989939 +0000 UTC m=+81.734269704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls") pod "image-registry-7dd54c6d84-l6btj" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be") : secret "image-registry-tls" not found
Sep 10 20:58:57.326330 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.326292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:57.329559 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.329541    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:58:57.338640 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.338622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2ab6023-1a88-44a8-96ec-40f45d1f5966-original-pull-secret\") pod \"global-pull-secret-syncer-4htvn\" (UID: \"f2ab6023-1a88-44a8-96ec-40f45d1f5966\") " pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:57.427290 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.427250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 20:58:57.427458 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.427352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:57.429803 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.429784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb2px\" (UniqueName: \"kubernetes.io/projected/fa6762c4-1330-4db5-a255-3867e40e3a21-kube-api-access-nb2px\") pod \"network-check-target-dh85p\" (UID: \"fa6762c4-1330-4db5-a255-3867e40e3a21\") " pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:57.430185 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.430170    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:58:57.435186 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.435169    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4htvn"
Sep 10 20:58:57.438295 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:57.438279    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 20:58:57.438352 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:57.438341    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs podName:bcd26029-a0d7-47b5-871a-17c117451b7d nodeName:}" failed. No retries permitted until 2026-09-10 21:00:01.438325216 +0000 UTC m=+130.349604979 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs") pod "network-metrics-daemon-4sm2d" (UID: "bcd26029-a0d7-47b5-871a-17c117451b7d") : secret "metrics-daemon-secret" not found
Sep 10 20:58:57.731940 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.731875    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ll8tt\""
Sep 10 20:58:57.738271 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.738243    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4htvn"]
Sep 10 20:58:57.740323 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.740305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:57.743317 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:58:57.743290    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ab6023_1a88_44a8_96ec_40f45d1f5966.slice/crio-0121064a97c9b0bbc149142f4741ad4ecca8c9272bbd327d13b2b49225849f18 WatchSource:0}: Error finding container 0121064a97c9b0bbc149142f4741ad4ecca8c9272bbd327d13b2b49225849f18: Status 404 returned error can't find the container with id 0121064a97c9b0bbc149142f4741ad4ecca8c9272bbd327d13b2b49225849f18
Sep 10 20:58:57.929967 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.929936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:57.994786 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:57.994701    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4htvn" event={"ID":"f2ab6023-1a88-44a8-96ec-40f45d1f5966","Type":"ContainerStarted","Data":"0121064a97c9b0bbc149142f4741ad4ecca8c9272bbd327d13b2b49225849f18"}
Sep 10 20:58:58.045145 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.045114    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dh85p"]
Sep 10 20:58:58.048153 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:58:58.048122    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6762c4_1330_4db5_a255_3867e40e3a21.slice/crio-6022d057e760ca581ad316a02cfcd653fec2481039d277f8063c48a3111ca411 WatchSource:0}: Error finding container 6022d057e760ca581ad316a02cfcd653fec2481039d277f8063c48a3111ca411: Status 404 returned error can't find the container with id 6022d057e760ca581ad316a02cfcd653fec2481039d277f8063c48a3111ca411
Sep 10 20:58:58.105555 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.105526    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:58.203638 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.203604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:58.369276 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.369190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:58.476549 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.476513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:58.570158 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.570119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:58.675529 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.675449    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:58.781087 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.781034    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:58.938732 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.938651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:58:58.939258 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:58.938801    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:58.939258 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:58:58.938868    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls podName:b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c nodeName:}" failed. No retries permitted until 2026-09-10 20:59:30.938852072 +0000 UTC m=+99.850131838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls") pod "dns-default-5p67d" (UID: "b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:58.999933 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.999893    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dh85p" event={"ID":"fa6762c4-1330-4db5-a255-3867e40e3a21","Type":"ContainerStarted","Data":"7bf7905173f25678c7a9aff9c1db0fd2f9889018c53df7e636eb00b0a091a094"}
Sep 10 20:58:59.000212 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:58.999953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dh85p" event={"ID":"fa6762c4-1330-4db5-a255-3867e40e3a21","Type":"ContainerStarted","Data":"6022d057e760ca581ad316a02cfcd653fec2481039d277f8063c48a3111ca411"}
Sep 10 20:58:59.000212 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:59.000007    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:58:59.022904 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:59.022845    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dh85p" podStartSLOduration=67.022822969 podStartE2EDuration="1m7.022822969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:59.019951374 +0000 UTC m=+67.931231170" watchObservedRunningTime="2026-09-10 20:58:59.022822969 +0000 UTC m=+67.934102751"
Sep 10 20:58:59.496833 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:59.496796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:59.599861 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:59.599823    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:59.700344 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:59.700305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:59.823961 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:58:59.823923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:00.049117 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:00.049085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:00.232548 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:00.232470    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:00.440813 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:00.440781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:00.611369 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:00.611274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.455629 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:01.455414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.461078 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:01.461035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:59:01.461186 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:59:01.461141    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:59:01.461186 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:01.461165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:59:01.461290 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:59:01.461195    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls podName:6e21a780-6040-4adc-bffc-ac0c2a120682 nodeName:}" failed. No retries permitted until 2026-09-10 20:59:17.461180582 +0000 UTC m=+86.372460341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9zjlg" (UID: "6e21a780-6040-4adc-bffc-ac0c2a120682") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:59:01.461658 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:01.461639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e21a780-6040-4adc-bffc-ac0c2a120682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:59:01.633505 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:01.633460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.776105 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:01.775997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.014689 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:02.014648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4htvn" event={"ID":"f2ab6023-1a88-44a8-96ec-40f45d1f5966","Type":"ContainerStarted","Data":"d73be0f1749d3e0679efd6e965f9a955ec00993d273c87d8082e80dd2aecf08e"}
Sep 10 20:59:02.028386 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:02.028312    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.034006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:02.033967    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4htvn" podStartSLOduration=66.386831577 podStartE2EDuration="1m10.033952345s" totalImagesPullingTime="3.647120768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:02.033451715 +0000 UTC m=+70.944731497" watchObservedRunningTime="2026-09-10 20:59:02.033952345 +0000 UTC m=+70.945232127"
Sep 10 20:59:02.228418 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:02.228390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.311360 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:02.311327    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.418770 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:02.418742    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.653129 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:02.653021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:03.624877 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:03.624846    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.051262 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:04.051220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.163027 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:04.162996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.287581 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:04.287548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.417747 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:04.417658    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.526323 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:04.526281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.778079 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:04.777979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.872533 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:04.872497    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:05.156880 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:05.156849    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:05.289487 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:05.289450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:05.776156 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:05.776122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:05.986609 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:05.986578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:06.110457 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:06.110423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:06.272939 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:06.272903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:06.406273 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:06.406185    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:06.640386 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:06.640353    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:06.865395 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:06.865370    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:07.446983 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:07.446955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:07.850887 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:07.850846    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:08.062190 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:08.062156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:08.187846 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:08.187760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:08.455452 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:08.455371    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:08.834007 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:08.833974    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:09.026596 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:09.026565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.852680 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:12.852637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:59:12.854954 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:12.854923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"image-registry-7dd54c6d84-l6btj\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") " pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:59:13.064784 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:13.064747    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8bbrk\""
Sep 10 20:59:13.073031 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:13.073009    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:59:13.351449 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:13.351414    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dd54c6d84-l6btj"]
Sep 10 20:59:13.355401 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:59:13.355373    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1387f2bb_f266_4bb4_8523_14ee3c4be4be.slice/crio-c98e0ebcacb5e821c4d1f1264f0f1b4451c9f910995ea4ba702084b7fff434ca WatchSource:0}: Error finding container c98e0ebcacb5e821c4d1f1264f0f1b4451c9f910995ea4ba702084b7fff434ca: Status 404 returned error can't find the container with id c98e0ebcacb5e821c4d1f1264f0f1b4451c9f910995ea4ba702084b7fff434ca
Sep 10 20:59:14.055603 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:14.055487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj" event={"ID":"1387f2bb-f266-4bb4-8523-14ee3c4be4be","Type":"ContainerStarted","Data":"807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075"}
Sep 10 20:59:14.055603 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:14.055576    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj" event={"ID":"1387f2bb-f266-4bb4-8523-14ee3c4be4be","Type":"ContainerStarted","Data":"c98e0ebcacb5e821c4d1f1264f0f1b4451c9f910995ea4ba702084b7fff434ca"}
Sep 10 20:59:14.055981 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:14.055635    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:59:14.088073 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:14.088011    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj" podStartSLOduration=34.087962381 podStartE2EDuration="34.087962381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:14.087533069 +0000 UTC m=+82.998812894" watchObservedRunningTime="2026-09-10 20:59:14.087962381 +0000 UTC m=+82.999242199"
Sep 10 20:59:14.632316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:14.632286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:14.736654 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:14.736613    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:15.588224 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.588190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:15.729394 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.729358    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:15.805788 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.805753    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"]
Sep 10 20:59:15.810946 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.810927    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.813928 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.813901    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 20:59:15.814071 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.814004    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 20:59:15.814735 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.814720    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 20:59:15.814816 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.814754    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 20:59:15.814883 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.814868    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 20:59:15.815443 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.815423    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 20:59:15.818887 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.818872    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 20:59:15.831695 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.831671    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"]
Sep 10 20:59:15.839586 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.839534    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dd54c6d84-l6btj"]
Sep 10 20:59:15.876219 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.876189    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-ca\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.876219 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.876221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.876419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.876253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-hub\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.876419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.876325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvgk\" (UniqueName: \"kubernetes.io/projected/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-kube-api-access-kxvgk\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.876419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.876363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-additional-service-ca\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.876419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.876396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.948197 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.948151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:15.977233 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.977191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvgk\" (UniqueName: \"kubernetes.io/projected/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-kube-api-access-kxvgk\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.977419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.977257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-additional-service-ca\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.977419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.977300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.977419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.977323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-ca\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.977419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.977346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.977419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.977384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-hub\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.978119 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.978090    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-additional-service-ca\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.979960 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.979929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-ca\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.980094 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.979970    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.980094 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.979984    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-hub\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.980094 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.980025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:15.995323 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:15.995301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvgk\" (UniqueName: \"kubernetes.io/projected/1e19f1b7-3ed9-418c-9f9b-76e4e34683ba-kube-api-access-kxvgk\") pod \"cluster-proxy-proxy-agent-868d4ffb4b-6kz8k\" (UID: \"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:16.063509 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.063473    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.134647 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.134553    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"
Sep 10 20:59:16.181748 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.181693    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.292829 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.292797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.417085 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.416852    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k"]
Sep 10 20:59:16.419463 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:59:16.419435    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e19f1b7_3ed9_418c_9f9b_76e4e34683ba.slice/crio-0cb2a94fe66d7ec7d4326ed47b7589a6434453947e8d8f667e1df4e7224dd2d2 WatchSource:0}: Error finding container 0cb2a94fe66d7ec7d4326ed47b7589a6434453947e8d8f667e1df4e7224dd2d2: Status 404 returned error can't find the container with id 0cb2a94fe66d7ec7d4326ed47b7589a6434453947e8d8f667e1df4e7224dd2d2
Sep 10 20:59:16.591563 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.591529    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.687270 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.687186    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.788520 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.788474    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.964860 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:16.964770    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:17.067259 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:17.067177    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k" event={"ID":"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba","Type":"ContainerStarted","Data":"0cb2a94fe66d7ec7d4326ed47b7589a6434453947e8d8f667e1df4e7224dd2d2"}
Sep 10 20:59:17.490533 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:17.490481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:59:17.493419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:17.493385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e21a780-6040-4adc-bffc-ac0c2a120682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zjlg\" (UID: \"6e21a780-6040-4adc-bffc-ac0c2a120682\") " pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:59:17.655525 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:17.655490    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k7jqh\""
Sep 10 20:59:17.663741 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:17.663710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zjlg"
Sep 10 20:59:17.947032 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:17.946996    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zjlg"]
Sep 10 20:59:18.378391 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:18.378351    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:18.473425 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:18.473388    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:18.512443 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:59:18.512407    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e21a780_6040_4adc_bffc_ac0c2a120682.slice/crio-e09847d7c60a74c8f349f94b019a4104cfa39263d5ad671429a7d9868d71ad1f WatchSource:0}: Error finding container e09847d7c60a74c8f349f94b019a4104cfa39263d5ad671429a7d9868d71ad1f: Status 404 returned error can't find the container with id e09847d7c60a74c8f349f94b019a4104cfa39263d5ad671429a7d9868d71ad1f
Sep 10 20:59:19.076878 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:19.076839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjlg" event={"ID":"6e21a780-6040-4adc-bffc-ac0c2a120682","Type":"ContainerStarted","Data":"1900ba8253cd8e7bbce2127e73715e53bc718faaf79cd3e0657208eb1b6be8d1"}
Sep 10 20:59:19.077380 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:19.076942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjlg" event={"ID":"6e21a780-6040-4adc-bffc-ac0c2a120682","Type":"ContainerStarted","Data":"e09847d7c60a74c8f349f94b019a4104cfa39263d5ad671429a7d9868d71ad1f"}
Sep 10 20:59:20.575147 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:20.575114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:20.673409 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:20.673334    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:21.086108 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.086065    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k" event={"ID":"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba","Type":"ContainerStarted","Data":"895809b0ff275e7afc6a9631b1fd3c78e8074e3bb2b970a2a1a2c3891ebbb4b3"}
Sep 10 20:59:21.086347 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.086120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k" event={"ID":"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba","Type":"ContainerStarted","Data":"4e03535e946b61b6e41db0a641957cb8462efbf23c8d43909fc4f4a53c031f36"}
Sep 10 20:59:21.086347 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.086141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k" event={"ID":"1e19f1b7-3ed9-418c-9f9b-76e4e34683ba","Type":"ContainerStarted","Data":"fc32e43af3a37bd6026f5362da1ceb002a8f2df7da3190135d5bf499adf66044"}
Sep 10 20:59:21.087932 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.087908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjlg" event={"ID":"6e21a780-6040-4adc-bffc-ac0c2a120682","Type":"ContainerStarted","Data":"b563574964cbc2cff733ccbd197a4cd563aa6f3af6262b9a05bea990c0f64e0c"}
Sep 10 20:59:21.124031 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.123965    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-868d4ffb4b-6kz8k" podStartSLOduration=2.167550956 podStartE2EDuration="6.123946029s" totalImagesPullingTime="3.956395073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:21.122251888 +0000 UTC m=+90.033531668" watchObservedRunningTime="2026-09-10 20:59:21.123946029 +0000 UTC m=+90.035225811"
Sep 10 20:59:21.805971 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.805932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:21.897748 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.897715    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:21.982555 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:21.982528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:22.097686 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:22.097594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zjlg" event={"ID":"6e21a780-6040-4adc-bffc-ac0c2a120682","Type":"ContainerStarted","Data":"570cb45f1b32be7f826583dd78180de635d59ae5fa418241db0ddd5dcb1eda70"}
Sep 10 20:59:22.122161 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:22.122098    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9zjlg" podStartSLOduration=33.87209154 podStartE2EDuration="37.122082523s" totalImagesPullingTime="3.249990983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:58:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:22.120548233 +0000 UTC m=+91.031828015" watchObservedRunningTime="2026-09-10 20:59:22.122082523 +0000 UTC m=+91.033362307"
Sep 10 20:59:23.868261 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:23.868231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:25.966273 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:25.966239    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:26.192061 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.192009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:26.311972 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.311920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:26.328823 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.328792    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q2tg2"]
Sep 10 20:59:26.332214 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.332198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.335359 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.335340    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 20:59:26.336348 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.336330    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 20:59:26.336435 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.336360    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jp262\""
Sep 10 20:59:26.336640 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.336624    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 20:59:26.336763 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.336745    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 20:59:26.336852 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.336837    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 20:59:26.337036 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.337024    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 20:59:26.412209 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.412167    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:26.460494 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-wtmp\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460687 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-sys\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460687 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460687 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460687 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-root\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460687 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-tls\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460881 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjqf2\" (UniqueName: \"kubernetes.io/projected/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-kube-api-access-zjqf2\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460881 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-metrics-client-ca\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.460881 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.460763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-textfile\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.517638 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.517607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:26.561815 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-wtmp\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-sys\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-sys\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-root\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561966    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-root\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-wtmp\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.561983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-tls\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562425 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.562025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqf2\" (UniqueName: \"kubernetes.io/projected/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-kube-api-access-zjqf2\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562425 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.562070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-metrics-client-ca\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562425 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.562196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-textfile\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562580 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.562563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-accelerators-collector-config\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562626 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.562580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-textfile\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.562668 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.562636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-metrics-client-ca\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.564459 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.564436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.564545 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.564436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-node-exporter-tls\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.571430 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.571406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqf2\" (UniqueName: \"kubernetes.io/projected/3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055-kube-api-access-zjqf2\") pod \"node-exporter-q2tg2\" (UID: \"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055\") " pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.631062 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.628068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:26.640969 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.640943    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q2tg2"
Sep 10 20:59:26.651031 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:59:26.651009    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc5e9bb_64b6_4eed_9ac9_b4f8973ae055.slice/crio-8c64dbad90f7c33fcadefab6c10440044b868279d3bd853acf37230c8ac48d02 WatchSource:0}: Error finding container 8c64dbad90f7c33fcadefab6c10440044b868279d3bd853acf37230c8ac48d02: Status 404 returned error can't find the container with id 8c64dbad90f7c33fcadefab6c10440044b868279d3bd853acf37230c8ac48d02
Sep 10 20:59:26.726951 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.726920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:26.818602 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:26.818516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:27.114905 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:27.114820    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2tg2" event={"ID":"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055","Type":"ContainerStarted","Data":"8c64dbad90f7c33fcadefab6c10440044b868279d3bd853acf37230c8ac48d02"}
Sep 10 20:59:27.218006 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:27.217974    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:27.324958 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:27.324923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:27.421146 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:27.421064    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:28.119989 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:28.119953    2558 generic.go:356] "Generic (PLEG): container finished" podID="3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055" containerID="f7b6f31e26b32df3a99c4d9668f990f814b8b2efee8022245ed80f4ed1eb8b11" exitCode=0
Sep 10 20:59:28.120422 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:28.120004    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2tg2" event={"ID":"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055","Type":"ContainerDied","Data":"f7b6f31e26b32df3a99c4d9668f990f814b8b2efee8022245ed80f4ed1eb8b11"}
Sep 10 20:59:28.144936 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:28.144907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:29.125773 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.125739    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2tg2" event={"ID":"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055","Type":"ContainerStarted","Data":"d1002345d6670bfa79be27ecfdf7b77a070e90c211d71862cf5859d7837f8f3e"}
Sep 10 20:59:29.126259 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.125790    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q2tg2" event={"ID":"3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055","Type":"ContainerStarted","Data":"8a5e280fa778ac8e81b27169fa8cf249806c01281de9bf5c38ccdeb14f23e110"}
Sep 10 20:59:29.149412 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.149360    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q2tg2" podStartSLOduration=2.229832967 podStartE2EDuration="3.149345216s" totalImagesPullingTime="858.151642ms" totalInitContainerRuntime="61.360607ms" isStatefulPod=true podCreationTimestamp="2026-09-10 20:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:29.148524285 +0000 UTC m=+98.059804086" watchObservedRunningTime="2026-09-10 20:59:29.149345216 +0000 UTC m=+98.060624997"
Sep 10 20:59:29.191280 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.191246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:29.271512 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.271483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:29.453523 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.453442    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:29.566856 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.566817    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:29.650380 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:29.650347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:30.001401 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:30.001362    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:30.006130 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:30.006107    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dh85p"
Sep 10 20:59:30.994711 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:30.994676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:59:30.995757 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:30.995731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:30.997236 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:30.997218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c-metrics-tls\") pod \"dns-default-5p67d\" (UID: \"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c\") " pod="openshift-dns/dns-default-5p67d"
Sep 10 20:59:31.141784 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.141752    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:31.260190 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.260106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hkk2\""
Sep 10 20:59:31.265188 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.265170    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5p67d"
Sep 10 20:59:31.270828 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.270803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:31.503114 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.503078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:31.521073 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.520988    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"]
Sep 10 20:59:31.525149 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.525130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.527592 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.527559    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 20:59:31.527592 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.527579    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 20:59:31.527762 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.527565    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 20:59:31.527762 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.527565    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4nbkq\""
Sep 10 20:59:31.527762 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.527568    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 20:59:31.527762 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.527734    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 20:59:31.532293 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.532274    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 20:59:31.542895 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.542873    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5p67d"]
Sep 10 20:59:31.545843 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:59:31.545819    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77ff2ed_87a6_4ba1_8e78_a4aee60a5b3c.slice/crio-99b2702cc6d6d4eb8781c07632393310cfc1264b34b809c776a4e0be30e85543 WatchSource:0}: Error finding container 99b2702cc6d6d4eb8781c07632393310cfc1264b34b809c776a4e0be30e85543: Status 404 returned error can't find the container with id 99b2702cc6d6d4eb8781c07632393310cfc1264b34b809c776a4e0be30e85543
Sep 10 20:59:31.586979 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.586944    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"]
Sep 10 20:59:31.699592 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-secret-telemeter-client\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.699796 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699604    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-telemeter-client-tls\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.699796 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-metrics-client-ca\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.699796 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.699796 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.699796 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699764    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-serving-certs-ca-bundle\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.699796 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw7q4\" (UniqueName: \"kubernetes.io/projected/604bd90e-3ef5-47ed-8e2f-76626f7453c1-kube-api-access-xw7q4\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.700035 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.699839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-federate-client-tls\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800164 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-federate-client-tls\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800182    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-secret-telemeter-client\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-telemeter-client-tls\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-metrics-client-ca\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-serving-certs-ca-bundle\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.800316 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.800310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw7q4\" (UniqueName: \"kubernetes.io/projected/604bd90e-3ef5-47ed-8e2f-76626f7453c1-kube-api-access-xw7q4\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.801141 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.801113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-metrics-client-ca\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.801249 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.801113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-serving-certs-ca-bundle\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.801322 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.801283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604bd90e-3ef5-47ed-8e2f-76626f7453c1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.803255 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.803229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.803364 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.803289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-federate-client-tls\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.803425 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.803361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-secret-telemeter-client\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.803483 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.803445    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/604bd90e-3ef5-47ed-8e2f-76626f7453c1-telemeter-client-tls\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.811089 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.811062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw7q4\" (UniqueName: \"kubernetes.io/projected/604bd90e-3ef5-47ed-8e2f-76626f7453c1-kube-api-access-xw7q4\") pod \"telemeter-client-5fbdbd6f5d-9lkv2\" (UID: \"604bd90e-3ef5-47ed-8e2f-76626f7453c1\") " pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:31.834479 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:31.834456    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"
Sep 10 20:59:32.117710 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:32.117632    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2"]
Sep 10 20:59:32.121753 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:59:32.121723    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604bd90e_3ef5_47ed_8e2f_76626f7453c1.slice/crio-2807f3bea837554df3e8f260c0f13eb80cbc529bdba7722f7ac050534d1ea48e WatchSource:0}: Error finding container 2807f3bea837554df3e8f260c0f13eb80cbc529bdba7722f7ac050534d1ea48e: Status 404 returned error can't find the container with id 2807f3bea837554df3e8f260c0f13eb80cbc529bdba7722f7ac050534d1ea48e
Sep 10 20:59:32.137644 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:32.137613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2" event={"ID":"604bd90e-3ef5-47ed-8e2f-76626f7453c1","Type":"ContainerStarted","Data":"2807f3bea837554df3e8f260c0f13eb80cbc529bdba7722f7ac050534d1ea48e"}
Sep 10 20:59:32.138989 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:32.138960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5p67d" event={"ID":"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c","Type":"ContainerStarted","Data":"99b2702cc6d6d4eb8781c07632393310cfc1264b34b809c776a4e0be30e85543"}
Sep 10 20:59:32.467819 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:32.467735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:34.147007 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:34.146970    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5p67d" event={"ID":"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c","Type":"ContainerStarted","Data":"4d4dfe1ed47cf8e7a4b066840843c63901e05ee93e300effc5068b454ac9295c"}
Sep 10 20:59:34.147432 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:34.147024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5p67d" event={"ID":"b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c","Type":"ContainerStarted","Data":"caba240f3241d6df8aa40498d69bd838fab843fbd56ba60f091700a6bf02d5c6"}
Sep 10 20:59:34.147432 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:34.147107    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5p67d"
Sep 10 20:59:34.167767 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:34.167720    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5p67d" podStartSLOduration=66.219990383 podStartE2EDuration="1m8.167705823s" totalImagesPullingTime="1.94771544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:34.166637752 +0000 UTC m=+103.077917566" watchObservedRunningTime="2026-09-10 20:59:34.167705823 +0000 UTC m=+103.078985605"
Sep 10 20:59:35.152623 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:35.152585    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2" event={"ID":"604bd90e-3ef5-47ed-8e2f-76626f7453c1","Type":"ContainerStarted","Data":"421a7d89292fbe4f5be51677f4ae819d250a9184157408543e91c42d690b94ae"}
Sep 10 20:59:36.068785 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:36.068755    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:59:36.202263 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:36.202228    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:36.301267 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:36.301238    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:37.162822 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.162785    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2" event={"ID":"604bd90e-3ef5-47ed-8e2f-76626f7453c1","Type":"ContainerStarted","Data":"304a4e02941fc7bff13ea08a00bec952baeedbdb7bdd59c5e296d736d5637d35"}
Sep 10 20:59:37.163004 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.162847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2" event={"ID":"604bd90e-3ef5-47ed-8e2f-76626f7453c1","Type":"ContainerStarted","Data":"76f95bcc516fdefeb583ad9ad36a52c14a7c72d9d13484968425a434769cf5e2"}
Sep 10 20:59:37.191235 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.191180    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fbdbd6f5d-9lkv2" podStartSLOduration=2.1464740190000002 podStartE2EDuration="6.191141483s" totalImagesPullingTime="4.044667464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:37.190166407 +0000 UTC m=+106.101446214" watchObservedRunningTime="2026-09-10 20:59:37.191141483 +0000 UTC m=+106.102421264"
Sep 10 20:59:37.640861 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.640827    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf56d8668-vg2pn"]
Sep 10 20:59:37.644020 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.644004    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.648294 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.648271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 20:59:37.648811 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.648791    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 20:59:37.648933 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.648809    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-66nzk\""
Sep 10 20:59:37.648933 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.648823    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 20:59:37.648933 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.648848    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 20:59:37.649137 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.649078    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 20:59:37.649300 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.649269    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 20:59:37.649388 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.649301    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 20:59:37.656871 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.656848    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 20:59:37.659841 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.659820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf56d8668-vg2pn"]
Sep 10 20:59:37.756996 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.756957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-trusted-ca-bundle\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.756996 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.756996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-service-ca\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.757267 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.757075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-oauth-config\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.757267 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.757156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-console-config\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.757267 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.757186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2gv\" (UniqueName: \"kubernetes.io/projected/60327995-68c7-400d-8fec-194e9079167c-kube-api-access-rz2gv\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.757267 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.757261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-oauth-serving-cert\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.757426 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.757286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-serving-cert\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.857710 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.857682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-trusted-ca-bundle\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.857710 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.857714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-service-ca\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.857945 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.857750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-oauth-config\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.857945 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.857769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-console-config\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.857945 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.857787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2gv\" (UniqueName: \"kubernetes.io/projected/60327995-68c7-400d-8fec-194e9079167c-kube-api-access-rz2gv\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.857945 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.857819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-oauth-serving-cert\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.857945 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.857837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-serving-cert\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.858602 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.858567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-console-config\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.858602 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.858598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-service-ca\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.858777 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.858659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-trusted-ca-bundle\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.858777 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.858675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-oauth-serving-cert\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.860347 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.860328    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-serving-cert\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.860439 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.860382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-oauth-config\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.866955 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.866933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2gv\" (UniqueName: \"kubernetes.io/projected/60327995-68c7-400d-8fec-194e9079167c-kube-api-access-rz2gv\") pod \"console-7bf56d8668-vg2pn\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") " pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.888062 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.888011    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:37.953256 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.953180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:37.988158 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:37.988126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:38.229275 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:38.229155    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf56d8668-vg2pn"]
Sep 10 20:59:38.233481 ip-10-0-134-100 kubenswrapper[2558]: W0910 20:59:38.233453    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60327995_68c7_400d_8fec_194e9079167c.slice/crio-d2f2ff0e556e3d3b88292194dd787d3cf825c6c22255e01f8fa2bff94f120bb5 WatchSource:0}: Error finding container d2f2ff0e556e3d3b88292194dd787d3cf825c6c22255e01f8fa2bff94f120bb5: Status 404 returned error can't find the container with id d2f2ff0e556e3d3b88292194dd787d3cf825c6c22255e01f8fa2bff94f120bb5
Sep 10 20:59:39.172268 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:39.172219    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf56d8668-vg2pn" event={"ID":"60327995-68c7-400d-8fec-194e9079167c","Type":"ContainerStarted","Data":"d2f2ff0e556e3d3b88292194dd787d3cf825c6c22255e01f8fa2bff94f120bb5"}
Sep 10 20:59:39.434888 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:39.434801    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:39.545765 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:39.545728    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:40.476797 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:40.476752    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:41.080299 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.080258    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj" podUID="1387f2bb-f266-4bb4-8523-14ee3c4be4be" containerName="registry" containerID="cri-o://807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075" gracePeriod=30
Sep 10 20:59:41.183333 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.183238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf56d8668-vg2pn" event={"ID":"60327995-68c7-400d-8fec-194e9079167c","Type":"ContainerStarted","Data":"0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac"}
Sep 10 20:59:41.205175 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.205119    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf56d8668-vg2pn" podStartSLOduration=1.573788639 podStartE2EDuration="4.205097538s" totalImagesPullingTime="2.631308899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:41.203547268 +0000 UTC m=+110.114827043" watchObservedRunningTime="2026-09-10 20:59:41.205097538 +0000 UTC m=+110.116377321"
Sep 10 20:59:41.313287 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.313262    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:59:41.386756 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.386725    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.386756 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.386761    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1387f2bb-f266-4bb4-8523-14ee3c4be4be-ca-trust-extracted\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.386943 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.386790    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-image-registry-private-configuration\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.386943 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.386810    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z48sq\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-kube-api-access-z48sq\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.387016 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.386984    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-trusted-ca\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.388419 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.388392    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:59:41.390289 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.390259    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:59:41.390376 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.390288    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:59:41.390376 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.390299    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-kube-api-access-z48sq" (OuterVolumeSpecName: "kube-api-access-z48sq") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "kube-api-access-z48sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:59:41.398346 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.398321    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1387f2bb-f266-4bb4-8523-14ee3c4be4be-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:59:41.488326 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488247    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-installation-pull-secrets\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.488326 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488295    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-certificates\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.488326 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488312    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-bound-sa-token\") pod \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\" (UID: \"1387f2bb-f266-4bb4-8523-14ee3c4be4be\") "
Sep 10 20:59:41.488824 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488493    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.488824 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488504    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1387f2bb-f266-4bb4-8523-14ee3c4be4be-ca-trust-extracted\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.488824 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488513    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-image-registry-private-configuration\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.488824 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488523    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z48sq\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-kube-api-access-z48sq\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.488824 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488533    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-trusted-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.488824 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.488734    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:59:41.490514 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.490488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:59:41.490604 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.490506    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1387f2bb-f266-4bb4-8523-14ee3c4be4be" (UID: "1387f2bb-f266-4bb4-8523-14ee3c4be4be"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:59:41.589121 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.589084    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1387f2bb-f266-4bb4-8523-14ee3c4be4be-installation-pull-secrets\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.589121 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.589113    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1387f2bb-f266-4bb4-8523-14ee3c4be4be-registry-certificates\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.589121 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.589124    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1387f2bb-f266-4bb4-8523-14ee3c4be4be-bound-sa-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 20:59:41.626794 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.626767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:41.726529 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:41.726501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:42.188678 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.188599    2558 generic.go:356] "Generic (PLEG): container finished" podID="1387f2bb-f266-4bb4-8523-14ee3c4be4be" containerID="807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075" exitCode=0
Sep 10 20:59:42.188678 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.188647    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj"
Sep 10 20:59:42.188880 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.188686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj" event={"ID":"1387f2bb-f266-4bb4-8523-14ee3c4be4be","Type":"ContainerDied","Data":"807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075"}
Sep 10 20:59:42.188880 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.188736    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dd54c6d84-l6btj" event={"ID":"1387f2bb-f266-4bb4-8523-14ee3c4be4be","Type":"ContainerDied","Data":"c98e0ebcacb5e821c4d1f1264f0f1b4451c9f910995ea4ba702084b7fff434ca"}
Sep 10 20:59:42.188880 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.188775    2558 scope.go:117] "RemoveContainer" containerID="807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075"
Sep 10 20:59:42.197613 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.197597    2558 scope.go:117] "RemoveContainer" containerID="807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075"
Sep 10 20:59:42.197919 ip-10-0-134-100 kubenswrapper[2558]: E0910 20:59:42.197895    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075\": container with ID starting with 807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075 not found: ID does not exist" containerID="807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075"
Sep 10 20:59:42.198004 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.197930    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075"} err="failed to get container status \"807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075\": rpc error: code = NotFound desc = could not find container \"807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075\": container with ID starting with 807ca5ec244f26ecc49bc51b4a2471ca9cb0362b39a924786178cf21cdd4a075 not found: ID does not exist"
Sep 10 20:59:42.211863 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.211836    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dd54c6d84-l6btj"]
Sep 10 20:59:42.216673 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:42.216646    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dd54c6d84-l6btj"]
Sep 10 20:59:43.616744 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:43.614781    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1387f2bb-f266-4bb4-8523-14ee3c4be4be" path="/var/lib/kubelet/pods/1387f2bb-f266-4bb4-8523-14ee3c4be4be/volumes"
Sep 10 20:59:44.155127 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:44.155100    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5p67d"
Sep 10 20:59:46.210710 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:46.210676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:46.311382 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:46.311348    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:46.972346 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:46.972313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:47.073571 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:47.073544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:47.954106 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:47.954064    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:47.954548 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:47.954134    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:47.958817 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:47.958795    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:48.213938 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:48.213861    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 20:59:48.400665 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:48.400628    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:48.504814 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:48.504735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:48.604818 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:48.604781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:48.702013 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:48.701979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:51.727069 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:51.727027    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:51.826231 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:51.826199    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:51.915230 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:51.915201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:52.385398 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:52.385363    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:52.486252 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:52.486220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:52.561288 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:52.561259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:53.305131 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:53.305100    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:53.405880 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:53.405844    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:59.578107 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:59.578067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:59.652345 ip-10-0-134-100 kubenswrapper[2558]: I0910 20:59:59.652311    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:01.530881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:01.530838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 21:00:01.533200 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:01.533180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcd26029-a0d7-47b5-871a-17c117451b7d-metrics-certs\") pod \"network-metrics-daemon-4sm2d\" (UID: \"bcd26029-a0d7-47b5-871a-17c117451b7d\") " pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 21:00:01.624424 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:01.624389    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tjcr5\""
Sep 10 21:00:01.631946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:01.631904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sm2d"
Sep 10 21:00:01.907578 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:01.907539    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4sm2d"]
Sep 10 21:00:01.910678 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:00:01.910649    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd26029_a0d7_47b5_871a_17c117451b7d.slice/crio-bd66b145628f7b2b47006461f5e785948bbc9760a5a831c2611cfcd6c7e125b8 WatchSource:0}: Error finding container bd66b145628f7b2b47006461f5e785948bbc9760a5a831c2611cfcd6c7e125b8: Status 404 returned error can't find the container with id bd66b145628f7b2b47006461f5e785948bbc9760a5a831c2611cfcd6c7e125b8
Sep 10 21:00:02.259782 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:02.259693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4sm2d" event={"ID":"bcd26029-a0d7-47b5-871a-17c117451b7d","Type":"ContainerStarted","Data":"bd66b145628f7b2b47006461f5e785948bbc9760a5a831c2611cfcd6c7e125b8"}
Sep 10 21:00:04.268327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:04.268291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4sm2d" event={"ID":"bcd26029-a0d7-47b5-871a-17c117451b7d","Type":"ContainerStarted","Data":"2d5804bebf0f1eccec72b796a9cad03e811a3a01d9e5f83df35b195a774cea05"}
Sep 10 21:00:04.268735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:04.268350    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4sm2d" event={"ID":"bcd26029-a0d7-47b5-871a-17c117451b7d","Type":"ContainerStarted","Data":"86c43694b677131fcc4885f4610a48ba028e7c6d50a1f5ae8f3af2fd53e08c65"}
Sep 10 21:00:04.287830 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:04.287778    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4sm2d" podStartSLOduration=130.458961046 podStartE2EDuration="2m12.287763742s" totalImagesPullingTime="1.828802696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:04.286735236 +0000 UTC m=+133.198015018" watchObservedRunningTime="2026-09-10 21:00:04.287763742 +0000 UTC m=+133.199043524"
Sep 10 21:00:04.568938 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:04.568907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:04.670334 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:04.670290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:11.113371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:11.113329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:12.297227 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:12.297195    2558 generic.go:356] "Generic (PLEG): container finished" podID="1395e3ad-48ba-4e33-a176-8966702e5402" containerID="48f39fe0edd1732e79d6f0f5d2d928846624dfcb09237d0018c21c2295099885" exitCode=0
Sep 10 21:00:12.297598 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:12.297255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8" event={"ID":"1395e3ad-48ba-4e33-a176-8966702e5402","Type":"ContainerDied","Data":"48f39fe0edd1732e79d6f0f5d2d928846624dfcb09237d0018c21c2295099885"}
Sep 10 21:00:12.297598 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:12.297566    2558 scope.go:117] "RemoveContainer" containerID="48f39fe0edd1732e79d6f0f5d2d928846624dfcb09237d0018c21c2295099885"
Sep 10 21:00:13.302923 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:13.302887    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-47xx8" event={"ID":"1395e3ad-48ba-4e33-a176-8966702e5402","Type":"ContainerStarted","Data":"588d97970e3379677cfd9e847ff63c144ae99778b09e824014d4f02285120583"}
Sep 10 21:00:14.575725 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:14.575688    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:14.652231 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:14.652205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:42.419403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:42.419366    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:42.521322 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:42.521261    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:46.796977 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:46.796882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:46.886848 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:46.886814    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:54.285886 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:54.285847    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:54.420737 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:54.420698    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:57.655876 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:57.655836    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf56d8668-vg2pn"]
Sep 10 21:00:57.778366 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:57.778320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:57.880538 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:57.880501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:57.979870 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:57.979783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:59.678450 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:59.678417    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:59.778761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:00:59.778724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:22.674535 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:22.674474    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bf56d8668-vg2pn" podUID="60327995-68c7-400d-8fec-194e9079167c" containerName="console" containerID="cri-o://0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac" gracePeriod=15
Sep 10 21:01:22.919544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:22.919517    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 21:01:23.026527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.026437    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz2gv\" (UniqueName: \"kubernetes.io/projected/60327995-68c7-400d-8fec-194e9079167c-kube-api-access-rz2gv\") pod \"60327995-68c7-400d-8fec-194e9079167c\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") "
Sep 10 21:01:23.026527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.026475    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-trusted-ca-bundle\") pod \"60327995-68c7-400d-8fec-194e9079167c\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") "
Sep 10 21:01:23.026527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.026493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-oauth-serving-cert\") pod \"60327995-68c7-400d-8fec-194e9079167c\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") "
Sep 10 21:01:23.026527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.026512    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-service-ca\") pod \"60327995-68c7-400d-8fec-194e9079167c\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") "
Sep 10 21:01:23.026527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.026532    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-serving-cert\") pod \"60327995-68c7-400d-8fec-194e9079167c\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") "
Sep 10 21:01:23.026872 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.026561    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-oauth-config\") pod \"60327995-68c7-400d-8fec-194e9079167c\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") "
Sep 10 21:01:23.026872 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.026583    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-console-config\") pod \"60327995-68c7-400d-8fec-194e9079167c\" (UID: \"60327995-68c7-400d-8fec-194e9079167c\") "
Sep 10 21:01:23.027139 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.027102    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-service-ca" (OuterVolumeSpecName: "service-ca") pod "60327995-68c7-400d-8fec-194e9079167c" (UID: "60327995-68c7-400d-8fec-194e9079167c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:01:23.027225 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.027129    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-console-config" (OuterVolumeSpecName: "console-config") pod "60327995-68c7-400d-8fec-194e9079167c" (UID: "60327995-68c7-400d-8fec-194e9079167c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:01:23.027225 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.027142    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "60327995-68c7-400d-8fec-194e9079167c" (UID: "60327995-68c7-400d-8fec-194e9079167c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:01:23.027315 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.027269    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "60327995-68c7-400d-8fec-194e9079167c" (UID: "60327995-68c7-400d-8fec-194e9079167c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:01:23.028918 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.028884    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "60327995-68c7-400d-8fec-194e9079167c" (UID: "60327995-68c7-400d-8fec-194e9079167c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:01:23.029010 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.028920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "60327995-68c7-400d-8fec-194e9079167c" (UID: "60327995-68c7-400d-8fec-194e9079167c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:01:23.029010 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.028929    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60327995-68c7-400d-8fec-194e9079167c-kube-api-access-rz2gv" (OuterVolumeSpecName: "kube-api-access-rz2gv") pod "60327995-68c7-400d-8fec-194e9079167c" (UID: "60327995-68c7-400d-8fec-194e9079167c"). InnerVolumeSpecName "kube-api-access-rz2gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:01:23.127206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.127166    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz2gv\" (UniqueName: \"kubernetes.io/projected/60327995-68c7-400d-8fec-194e9079167c-kube-api-access-rz2gv\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:01:23.127206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.127200    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-trusted-ca-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:01:23.127206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.127212    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-oauth-serving-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:01:23.127432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.127224    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:01:23.127432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.127236    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-serving-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:01:23.127432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.127248    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60327995-68c7-400d-8fec-194e9079167c-console-oauth-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:01:23.127432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.127261    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60327995-68c7-400d-8fec-194e9079167c-console-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:01:23.553974 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.553936    2558 generic.go:356] "Generic (PLEG): container finished" podID="60327995-68c7-400d-8fec-194e9079167c" containerID="0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac" exitCode=0
Sep 10 21:01:23.554152 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.553988    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf56d8668-vg2pn"
Sep 10 21:01:23.554152 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.553984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf56d8668-vg2pn" event={"ID":"60327995-68c7-400d-8fec-194e9079167c","Type":"ContainerDied","Data":"0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac"}
Sep 10 21:01:23.554223 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.554153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf56d8668-vg2pn" event={"ID":"60327995-68c7-400d-8fec-194e9079167c","Type":"ContainerDied","Data":"d2f2ff0e556e3d3b88292194dd787d3cf825c6c22255e01f8fa2bff94f120bb5"}
Sep 10 21:01:23.554223 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.554183    2558 scope.go:117] "RemoveContainer" containerID="0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac"
Sep 10 21:01:23.562593 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.562573    2558 scope.go:117] "RemoveContainer" containerID="0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac"
Sep 10 21:01:23.562844 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:01:23.562827    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac\": container with ID starting with 0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac not found: ID does not exist" containerID="0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac"
Sep 10 21:01:23.562899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.562850    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac"} err="failed to get container status \"0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac\": rpc error: code = NotFound desc = could not find container \"0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac\": container with ID starting with 0e06e56517b71dd25428a8eb6db525970824a32419e030e0b3f221460ea4a8ac not found: ID does not exist"
Sep 10 21:01:23.577097 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.577068    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf56d8668-vg2pn"]
Sep 10 21:01:23.586820 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.586795    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bf56d8668-vg2pn"]
Sep 10 21:01:23.613127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:23.613101    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60327995-68c7-400d-8fec-194e9079167c" path="/var/lib/kubelet/pods/60327995-68c7-400d-8fec-194e9079167c/volumes"
Sep 10 21:01:44.733566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:44.733527    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:44.867213 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:44.867179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:45.697878 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.697843    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"]
Sep 10 21:01:45.698137 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.698122    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60327995-68c7-400d-8fec-194e9079167c" containerName="console"
Sep 10 21:01:45.698185 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.698139    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="60327995-68c7-400d-8fec-194e9079167c" containerName="console"
Sep 10 21:01:45.698185 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.698151    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1387f2bb-f266-4bb4-8523-14ee3c4be4be" containerName="registry"
Sep 10 21:01:45.698185 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.698160    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1387f2bb-f266-4bb4-8523-14ee3c4be4be" containerName="registry"
Sep 10 21:01:45.698278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.698236    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="60327995-68c7-400d-8fec-194e9079167c" containerName="console"
Sep 10 21:01:45.698278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.698248    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1387f2bb-f266-4bb4-8523-14ee3c4be4be" containerName="registry"
Sep 10 21:01:45.700021 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.700003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.702915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.702892    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-blhgw\""
Sep 10 21:01:45.703021 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.702953    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:01:45.706606 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.706589    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:01:45.714451 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.714429    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"]
Sep 10 21:01:45.781517 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.781480    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.781517 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.781529    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.781926 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.781562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cljr8\" (UniqueName: \"kubernetes.io/projected/de072fc4-e31f-4cea-bafd-a4927bfa57de-kube-api-access-cljr8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.882361 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.882326    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cljr8\" (UniqueName: \"kubernetes.io/projected/de072fc4-e31f-4cea-bafd-a4927bfa57de-kube-api-access-cljr8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.882499 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.882388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.882499 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.882423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.882833 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.882813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.882871 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.882825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:45.891754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:45.891725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cljr8\" (UniqueName: \"kubernetes.io/projected/de072fc4-e31f-4cea-bafd-a4927bfa57de-kube-api-access-cljr8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:46.009158 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:46.009039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:01:46.282784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:46.282699    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"]
Sep 10 21:01:46.285426 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:01:46.285398    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde072fc4_e31f_4cea_bafd_a4927bfa57de.slice/crio-5187fe7f0ebb1a5cea9e6d98e5b23fb1197ccdc21c41bed101a4e9991f762ebc WatchSource:0}: Error finding container 5187fe7f0ebb1a5cea9e6d98e5b23fb1197ccdc21c41bed101a4e9991f762ebc: Status 404 returned error can't find the container with id 5187fe7f0ebb1a5cea9e6d98e5b23fb1197ccdc21c41bed101a4e9991f762ebc
Sep 10 21:01:46.618924 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:46.618896    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:46.637656 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:46.637622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42" event={"ID":"de072fc4-e31f-4cea-bafd-a4927bfa57de","Type":"ContainerStarted","Data":"5187fe7f0ebb1a5cea9e6d98e5b23fb1197ccdc21c41bed101a4e9991f762ebc"}
Sep 10 21:01:46.697863 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:46.697807    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:52.663628 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:52.663592    2558 generic.go:356] "Generic (PLEG): container finished" podID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerID="4dec3baeefbf6d938cbdda0dfe239e034077b28fbdb3dc9964755aa16715ba45" exitCode=0
Sep 10 21:01:52.663993 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:52.663649    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42" event={"ID":"de072fc4-e31f-4cea-bafd-a4927bfa57de","Type":"ContainerDied","Data":"4dec3baeefbf6d938cbdda0dfe239e034077b28fbdb3dc9964755aa16715ba45"}
Sep 10 21:01:54.673415 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:54.673380    2558 generic.go:356] "Generic (PLEG): container finished" podID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerID="331588806f7b5c7b100faad82d13d89e7887bcad7956a10e2f29314682c06f77" exitCode=0
Sep 10 21:01:54.673858 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:01:54.673436    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42" event={"ID":"de072fc4-e31f-4cea-bafd-a4927bfa57de","Type":"ContainerDied","Data":"331588806f7b5c7b100faad82d13d89e7887bcad7956a10e2f29314682c06f77"}
Sep 10 21:02:01.701304 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:01.701269    2558 generic.go:356] "Generic (PLEG): container finished" podID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerID="8a3b46e46c0e93002fc3ab31c4d8c5c65fedd7b566dd3039d5666aca20c8bf4b" exitCode=0
Sep 10 21:02:01.701737 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:01.701311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42" event={"ID":"de072fc4-e31f-4cea-bafd-a4927bfa57de","Type":"ContainerDied","Data":"8a3b46e46c0e93002fc3ab31c4d8c5c65fedd7b566dd3039d5666aca20c8bf4b"}
Sep 10 21:02:02.819992 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:02.819970    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:02:02.916338 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:02.916288    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-bundle\") pod \"de072fc4-e31f-4cea-bafd-a4927bfa57de\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") "
Sep 10 21:02:02.916338 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:02.916352    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-util\") pod \"de072fc4-e31f-4cea-bafd-a4927bfa57de\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") "
Sep 10 21:02:02.916544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:02.916399    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cljr8\" (UniqueName: \"kubernetes.io/projected/de072fc4-e31f-4cea-bafd-a4927bfa57de-kube-api-access-cljr8\") pod \"de072fc4-e31f-4cea-bafd-a4927bfa57de\" (UID: \"de072fc4-e31f-4cea-bafd-a4927bfa57de\") "
Sep 10 21:02:02.916982 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:02.916944    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-bundle" (OuterVolumeSpecName: "bundle") pod "de072fc4-e31f-4cea-bafd-a4927bfa57de" (UID: "de072fc4-e31f-4cea-bafd-a4927bfa57de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:02.918566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:02.918538    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de072fc4-e31f-4cea-bafd-a4927bfa57de-kube-api-access-cljr8" (OuterVolumeSpecName: "kube-api-access-cljr8") pod "de072fc4-e31f-4cea-bafd-a4927bfa57de" (UID: "de072fc4-e31f-4cea-bafd-a4927bfa57de"). InnerVolumeSpecName "kube-api-access-cljr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:02.920352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:02.920327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-util" (OuterVolumeSpecName: "util") pod "de072fc4-e31f-4cea-bafd-a4927bfa57de" (UID: "de072fc4-e31f-4cea-bafd-a4927bfa57de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:03.017457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:03.017367    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cljr8\" (UniqueName: \"kubernetes.io/projected/de072fc4-e31f-4cea-bafd-a4927bfa57de-kube-api-access-cljr8\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:03.017457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:03.017414    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:03.017457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:03.017424    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de072fc4-e31f-4cea-bafd-a4927bfa57de-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:03.710227 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:03.710193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42" event={"ID":"de072fc4-e31f-4cea-bafd-a4927bfa57de","Type":"ContainerDied","Data":"5187fe7f0ebb1a5cea9e6d98e5b23fb1197ccdc21c41bed101a4e9991f762ebc"}
Sep 10 21:02:03.710366 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:03.710232    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plf42"
Sep 10 21:02:03.710366 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:03.710241    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5187fe7f0ebb1a5cea9e6d98e5b23fb1197ccdc21c41bed101a4e9991f762ebc"
Sep 10 21:02:06.985466 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:06.985428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:07.223676 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:07.223644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:07.326937 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:07.326904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:08.381803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:08.381764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:10.582414 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:10.582381    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:10.662723 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:10.662691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:12.919371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:12.919337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:13.019521 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:13.019485    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:13.310171 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:13.310138    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:13.422422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:13.422386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:14.021380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021294    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"]
Sep 10 21:02:14.021755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021585    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerName="pull"
Sep 10 21:02:14.021755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021598    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerName="pull"
Sep 10 21:02:14.021755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021606    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerName="util"
Sep 10 21:02:14.021755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021613    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerName="util"
Sep 10 21:02:14.021755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021619    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerName="extract"
Sep 10 21:02:14.021755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021625    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerName="extract"
Sep 10 21:02:14.021755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.021671    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="de072fc4-e31f-4cea-bafd-a4927bfa57de" containerName="extract"
Sep 10 21:02:14.024533 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.024517    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.027092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.027068    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:14.027224 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.027145    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:14.027288 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.027227    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-blhgw\""
Sep 10 21:02:14.034831 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.034809    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"]
Sep 10 21:02:14.094307 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.094275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2mg7\" (UniqueName: \"kubernetes.io/projected/a839e58c-027a-4add-a77e-72552eb60374-kube-api-access-q2mg7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.094468 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.094324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.094468 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.094373    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.194704 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.194664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2mg7\" (UniqueName: \"kubernetes.io/projected/a839e58c-027a-4add-a77e-72552eb60374-kube-api-access-q2mg7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.194877 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.194728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.194877 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.194747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.195103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.195087    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.195149 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.195127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.205994 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.205968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2mg7\" (UniqueName: \"kubernetes.io/projected/a839e58c-027a-4add-a77e-72552eb60374-kube-api-access-q2mg7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.333250 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.333215    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:14.607667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.607643    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"]
Sep 10 21:02:14.610125 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:02:14.610099    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda839e58c_027a_4add_a77e_72552eb60374.slice/crio-a0557be4133374de6030503fac0733810c24803f32c5e7669d9a8fc15075ced2 WatchSource:0}: Error finding container a0557be4133374de6030503fac0733810c24803f32c5e7669d9a8fc15075ced2: Status 404 returned error can't find the container with id a0557be4133374de6030503fac0733810c24803f32c5e7669d9a8fc15075ced2
Sep 10 21:02:14.752014 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.751984    2558 generic.go:356] "Generic (PLEG): container finished" podID="a839e58c-027a-4add-a77e-72552eb60374" containerID="1071ae50012777b582f57fb9bf6d0ac97ce577cb8ca01ad09be92c12f036f357" exitCode=0
Sep 10 21:02:14.752192 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.752025    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx" event={"ID":"a839e58c-027a-4add-a77e-72552eb60374","Type":"ContainerDied","Data":"1071ae50012777b582f57fb9bf6d0ac97ce577cb8ca01ad09be92c12f036f357"}
Sep 10 21:02:14.752192 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.752082    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx" event={"ID":"a839e58c-027a-4add-a77e-72552eb60374","Type":"ContainerStarted","Data":"a0557be4133374de6030503fac0733810c24803f32c5e7669d9a8fc15075ced2"}
Sep 10 21:02:14.945984 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:14.945888    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:15.333799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.333764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:15.502173 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.502085    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djpck"]
Sep 10 21:02:15.509844 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.509818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.512409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.512383    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dkpv5\""
Sep 10 21:02:15.512541 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.512440    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 21:02:15.513237 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.513209    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 21:02:15.516016 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.515997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djpck"]
Sep 10 21:02:15.608015 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.607976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6mls\" (UniqueName: \"kubernetes.io/projected/88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c-kube-api-access-m6mls\") pod \"cert-manager-webhook-6486ffd997-djpck\" (UID: \"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.608198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.608024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djpck\" (UID: \"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.709155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.709118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6mls\" (UniqueName: \"kubernetes.io/projected/88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c-kube-api-access-m6mls\") pod \"cert-manager-webhook-6486ffd997-djpck\" (UID: \"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.709331 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.709178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djpck\" (UID: \"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.716559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.716530    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"]
Sep 10 21:02:15.721371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.721344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:15.721839 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.721811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6mls\" (UniqueName: \"kubernetes.io/projected/88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c-kube-api-access-m6mls\") pod \"cert-manager-webhook-6486ffd997-djpck\" (UID: \"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.723635 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.723600    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2hj8z\""
Sep 10 21:02:15.726201 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.726175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djpck\" (UID: \"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.730663 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.730638    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"]
Sep 10 21:02:15.809729 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.809695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf46b35-43aa-4a26-8930-be3eed65262e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vbs7d\" (UID: \"cbf46b35-43aa-4a26-8930-be3eed65262e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:15.809908 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.809737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mg2\" (UniqueName: \"kubernetes.io/projected/cbf46b35-43aa-4a26-8930-be3eed65262e-kube-api-access-f4mg2\") pod \"cert-manager-cainjector-559cdd8c87-vbs7d\" (UID: \"cbf46b35-43aa-4a26-8930-be3eed65262e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:15.820752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.820725    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:15.911211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.911167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf46b35-43aa-4a26-8930-be3eed65262e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vbs7d\" (UID: \"cbf46b35-43aa-4a26-8930-be3eed65262e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:15.911384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.911228    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mg2\" (UniqueName: \"kubernetes.io/projected/cbf46b35-43aa-4a26-8930-be3eed65262e-kube-api-access-f4mg2\") pod \"cert-manager-cainjector-559cdd8c87-vbs7d\" (UID: \"cbf46b35-43aa-4a26-8930-be3eed65262e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:15.919522 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.919498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mg2\" (UniqueName: \"kubernetes.io/projected/cbf46b35-43aa-4a26-8930-be3eed65262e-kube-api-access-f4mg2\") pod \"cert-manager-cainjector-559cdd8c87-vbs7d\" (UID: \"cbf46b35-43aa-4a26-8930-be3eed65262e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:15.919665 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:15.919499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbf46b35-43aa-4a26-8930-be3eed65262e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vbs7d\" (UID: \"cbf46b35-43aa-4a26-8930-be3eed65262e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:16.045886 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:16.045851    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"
Sep 10 21:02:16.621942 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:16.621867    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d"]
Sep 10 21:02:16.624581 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:16.624556    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djpck"]
Sep 10 21:02:16.625553 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:02:16.625527    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbf46b35_43aa_4a26_8930_be3eed65262e.slice/crio-4c6d09c8423dc8378ce6099a46803099ac2851e65d5a1987220e4c76e045e4bf WatchSource:0}: Error finding container 4c6d09c8423dc8378ce6099a46803099ac2851e65d5a1987220e4c76e045e4bf: Status 404 returned error can't find the container with id 4c6d09c8423dc8378ce6099a46803099ac2851e65d5a1987220e4c76e045e4bf
Sep 10 21:02:16.627091 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:02:16.627064    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88cf9a00_0c1e_49db_a7db_b2e8ecc33d9c.slice/crio-142f2c21295e44c303629d03a5dcb825a9ca535c54da21d34215f0b8c28d0a15 WatchSource:0}: Error finding container 142f2c21295e44c303629d03a5dcb825a9ca535c54da21d34215f0b8c28d0a15: Status 404 returned error can't find the container with id 142f2c21295e44c303629d03a5dcb825a9ca535c54da21d34215f0b8c28d0a15
Sep 10 21:02:16.760446 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:16.760409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-djpck" event={"ID":"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c","Type":"ContainerStarted","Data":"142f2c21295e44c303629d03a5dcb825a9ca535c54da21d34215f0b8c28d0a15"}
Sep 10 21:02:16.761542 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:16.761519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d" event={"ID":"cbf46b35-43aa-4a26-8930-be3eed65262e","Type":"ContainerStarted","Data":"4c6d09c8423dc8378ce6099a46803099ac2851e65d5a1987220e4c76e045e4bf"}
Sep 10 21:02:16.763328 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:16.763304    2558 generic.go:356] "Generic (PLEG): container finished" podID="a839e58c-027a-4add-a77e-72552eb60374" containerID="65f96d3a72604fd5d34968874834dac9cb24d9a01bab7896d3189044c626cfa4" exitCode=0
Sep 10 21:02:16.763406 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:16.763343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx" event={"ID":"a839e58c-027a-4add-a77e-72552eb60374","Type":"ContainerDied","Data":"65f96d3a72604fd5d34968874834dac9cb24d9a01bab7896d3189044c626cfa4"}
Sep 10 21:02:17.576352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:17.576297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:17.675588 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:17.675551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:17.771647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:17.771610    2558 generic.go:356] "Generic (PLEG): container finished" podID="a839e58c-027a-4add-a77e-72552eb60374" containerID="558e0e32a7dc2d4386114531bce9ac8f10704be0fd08a8c084b1822ae26efb65" exitCode=0
Sep 10 21:02:17.771838 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:17.771664    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx" event={"ID":"a839e58c-027a-4add-a77e-72552eb60374","Type":"ContainerDied","Data":"558e0e32a7dc2d4386114531bce9ac8f10704be0fd08a8c084b1822ae26efb65"}
Sep 10 21:02:19.021670 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.021645    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:19.141718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.141697    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2mg7\" (UniqueName: \"kubernetes.io/projected/a839e58c-027a-4add-a77e-72552eb60374-kube-api-access-q2mg7\") pod \"a839e58c-027a-4add-a77e-72552eb60374\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") "
Sep 10 21:02:19.141829 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.141821    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-bundle\") pod \"a839e58c-027a-4add-a77e-72552eb60374\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") "
Sep 10 21:02:19.141889 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.141859    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-util\") pod \"a839e58c-027a-4add-a77e-72552eb60374\" (UID: \"a839e58c-027a-4add-a77e-72552eb60374\") "
Sep 10 21:02:19.142332 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.142245    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-bundle" (OuterVolumeSpecName: "bundle") pod "a839e58c-027a-4add-a77e-72552eb60374" (UID: "a839e58c-027a-4add-a77e-72552eb60374"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:19.143668 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.143640    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a839e58c-027a-4add-a77e-72552eb60374-kube-api-access-q2mg7" (OuterVolumeSpecName: "kube-api-access-q2mg7") pod "a839e58c-027a-4add-a77e-72552eb60374" (UID: "a839e58c-027a-4add-a77e-72552eb60374"). InnerVolumeSpecName "kube-api-access-q2mg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:19.148380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.148340    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-util" (OuterVolumeSpecName: "util") pod "a839e58c-027a-4add-a77e-72552eb60374" (UID: "a839e58c-027a-4add-a77e-72552eb60374"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:19.242761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.242710    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:19.242761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.242755    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2mg7\" (UniqueName: \"kubernetes.io/projected/a839e58c-027a-4add-a77e-72552eb60374-kube-api-access-q2mg7\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:19.242761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.242766    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a839e58c-027a-4add-a77e-72552eb60374-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:19.781165 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.781123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-djpck" event={"ID":"88cf9a00-0c1e-49db-a7db-b2e8ecc33d9c","Type":"ContainerStarted","Data":"3d77f61fe7779d1d2f476bedea93ca33a421a16683f5597a10e8db648d2e1193"}
Sep 10 21:02:19.781346 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.781237    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:19.782662 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.782632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d" event={"ID":"cbf46b35-43aa-4a26-8930-be3eed65262e","Type":"ContainerStarted","Data":"80afd3de2ad1dc479e9efc87e40398b827bb61395ac0d8e9d3a962a3513c807d"}
Sep 10 21:02:19.784394 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.784364    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx" event={"ID":"a839e58c-027a-4add-a77e-72552eb60374","Type":"ContainerDied","Data":"a0557be4133374de6030503fac0733810c24803f32c5e7669d9a8fc15075ced2"}
Sep 10 21:02:19.784479 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.784408    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgjrx"
Sep 10 21:02:19.784479 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.784437    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0557be4133374de6030503fac0733810c24803f32c5e7669d9a8fc15075ced2"
Sep 10 21:02:19.801939 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.801892    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-djpck" podStartSLOduration=2.352432588 podStartE2EDuration="4.801875685s" totalImagesPullingTime="2.449443097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:19.800846929 +0000 UTC m=+268.712126714" watchObservedRunningTime="2026-09-10 21:02:19.801875685 +0000 UTC m=+268.713155467"
Sep 10 21:02:19.822143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.822095    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vbs7d" podStartSLOduration=2.364791224 podStartE2EDuration="4.822077209s" totalImagesPullingTime="2.457285985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:19.820960999 +0000 UTC m=+268.732240781" watchObservedRunningTime="2026-09-10 21:02:19.822077209 +0000 UTC m=+268.733356992"
Sep 10 21:02:19.877266 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.877160    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:19.944765 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:19.944727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:22.414948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:22.414911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:22.507922 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:22.507893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:23.735913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:23.735882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:25.790869 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:25.790836    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-djpck"
Sep 10 21:02:28.903788 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:28.903750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:29.008231 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:29.008201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:30.626727 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.626688    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:30.996862 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.996782    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"]
Sep 10 21:02:30.997075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.997034    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a839e58c-027a-4add-a77e-72552eb60374" containerName="util"
Sep 10 21:02:30.997075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.997060    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a839e58c-027a-4add-a77e-72552eb60374" containerName="util"
Sep 10 21:02:30.997155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.997078    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a839e58c-027a-4add-a77e-72552eb60374" containerName="pull"
Sep 10 21:02:30.997155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.997084    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a839e58c-027a-4add-a77e-72552eb60374" containerName="pull"
Sep 10 21:02:30.997155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.997090    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a839e58c-027a-4add-a77e-72552eb60374" containerName="extract"
Sep 10 21:02:30.997155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.997097    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a839e58c-027a-4add-a77e-72552eb60374" containerName="extract"
Sep 10 21:02:30.997155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:30.997141    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a839e58c-027a-4add-a77e-72552eb60374" containerName="extract"
Sep 10 21:02:31.000303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.000285    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.002814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.002792    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:31.003380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.003365    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:31.003464 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.003393    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-blhgw\""
Sep 10 21:02:31.010531 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.010508    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"]
Sep 10 21:02:31.131697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.131653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.131697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.131694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.131899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.131716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nq5g\" (UniqueName: \"kubernetes.io/projected/a57971ac-f48c-44b1-aa2a-708901fcd35c-kube-api-access-4nq5g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.232618 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.232565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.232618 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.232612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.232817 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.232635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nq5g\" (UniqueName: \"kubernetes.io/projected/a57971ac-f48c-44b1-aa2a-708901fcd35c-kube-api-access-4nq5g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.232956 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.232936    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.233012 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.232992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.240660 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.240637    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nq5g\" (UniqueName: \"kubernetes.io/projected/a57971ac-f48c-44b1-aa2a-708901fcd35c-kube-api-access-4nq5g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.312725 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.312697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:31.583196 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.583147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"]
Sep 10 21:02:31.585734 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:02:31.585691    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57971ac_f48c_44b1_aa2a_708901fcd35c.slice/crio-b570c975ce1af7e0157acc092cf275bea86d62effdd2390c4212a065d7d518f1 WatchSource:0}: Error finding container b570c975ce1af7e0157acc092cf275bea86d62effdd2390c4212a065d7d518f1: Status 404 returned error can't find the container with id b570c975ce1af7e0157acc092cf275bea86d62effdd2390c4212a065d7d518f1
Sep 10 21:02:31.829053 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.829007    2558 generic.go:356] "Generic (PLEG): container finished" podID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerID="a738e581d76ece795d595238cb0bf6442ac00fbbba7f990dc7e7c0df9ed1604d" exitCode=0
Sep 10 21:02:31.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.829070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf" event={"ID":"a57971ac-f48c-44b1-aa2a-708901fcd35c","Type":"ContainerDied","Data":"a738e581d76ece795d595238cb0bf6442ac00fbbba7f990dc7e7c0df9ed1604d"}
Sep 10 21:02:31.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:31.829106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf" event={"ID":"a57971ac-f48c-44b1-aa2a-708901fcd35c","Type":"ContainerStarted","Data":"b570c975ce1af7e0157acc092cf275bea86d62effdd2390c4212a065d7d518f1"}
Sep 10 21:02:32.834546 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:32.834513    2558 generic.go:356] "Generic (PLEG): container finished" podID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerID="6f4e5488f91ab381985465cf9776101084fffe6a381fa6ae9281e9e1de6f49d0" exitCode=0
Sep 10 21:02:32.834920 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:32.834561    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf" event={"ID":"a57971ac-f48c-44b1-aa2a-708901fcd35c","Type":"ContainerDied","Data":"6f4e5488f91ab381985465cf9776101084fffe6a381fa6ae9281e9e1de6f49d0"}
Sep 10 21:02:33.840402 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:33.840365    2558 generic.go:356] "Generic (PLEG): container finished" podID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerID="0a8c478e90c51ab21238dccb82ba57d83d38794d0846bd3e2a48c18a7bfaf4ea" exitCode=0
Sep 10 21:02:33.840810 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:33.840454    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf" event={"ID":"a57971ac-f48c-44b1-aa2a-708901fcd35c","Type":"ContainerDied","Data":"0a8c478e90c51ab21238dccb82ba57d83d38794d0846bd3e2a48c18a7bfaf4ea"}
Sep 10 21:02:34.988749 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:34.988711    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:35.060734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.060695    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-util\") pod \"a57971ac-f48c-44b1-aa2a-708901fcd35c\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") "
Sep 10 21:02:35.060734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.060748    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-bundle\") pod \"a57971ac-f48c-44b1-aa2a-708901fcd35c\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") "
Sep 10 21:02:35.060932 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.060805    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nq5g\" (UniqueName: \"kubernetes.io/projected/a57971ac-f48c-44b1-aa2a-708901fcd35c-kube-api-access-4nq5g\") pod \"a57971ac-f48c-44b1-aa2a-708901fcd35c\" (UID: \"a57971ac-f48c-44b1-aa2a-708901fcd35c\") "
Sep 10 21:02:35.061596 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.061552    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-bundle" (OuterVolumeSpecName: "bundle") pod "a57971ac-f48c-44b1-aa2a-708901fcd35c" (UID: "a57971ac-f48c-44b1-aa2a-708901fcd35c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:35.062937 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.062904    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57971ac-f48c-44b1-aa2a-708901fcd35c-kube-api-access-4nq5g" (OuterVolumeSpecName: "kube-api-access-4nq5g") pod "a57971ac-f48c-44b1-aa2a-708901fcd35c" (UID: "a57971ac-f48c-44b1-aa2a-708901fcd35c"). InnerVolumeSpecName "kube-api-access-4nq5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:35.066722 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.066620    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-util" (OuterVolumeSpecName: "util") pod "a57971ac-f48c-44b1-aa2a-708901fcd35c" (UID: "a57971ac-f48c-44b1-aa2a-708901fcd35c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:35.161903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.161818    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:35.161903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.161848    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nq5g\" (UniqueName: \"kubernetes.io/projected/a57971ac-f48c-44b1-aa2a-708901fcd35c-kube-api-access-4nq5g\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:35.161903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.161858    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57971ac-f48c-44b1-aa2a-708901fcd35c-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:35.850718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.850680    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf" event={"ID":"a57971ac-f48c-44b1-aa2a-708901fcd35c","Type":"ContainerDied","Data":"b570c975ce1af7e0157acc092cf275bea86d62effdd2390c4212a065d7d518f1"}
Sep 10 21:02:35.850718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.850699    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af526jf"
Sep 10 21:02:35.850718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:35.850727    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b570c975ce1af7e0157acc092cf275bea86d62effdd2390c4212a065d7d518f1"
Sep 10 21:02:42.005752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.005716    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"]
Sep 10 21:02:42.006239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.005961    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerName="pull"
Sep 10 21:02:42.006239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.005972    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerName="pull"
Sep 10 21:02:42.006239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.005987    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerName="util"
Sep 10 21:02:42.006239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.005993    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerName="util"
Sep 10 21:02:42.006239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.006002    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerName="extract"
Sep 10 21:02:42.006239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.006008    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerName="extract"
Sep 10 21:02:42.006239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.006063    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57971ac-f48c-44b1-aa2a-708901fcd35c" containerName="extract"
Sep 10 21:02:42.007906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.007890    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.012207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.012184    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:42.013208 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.013189    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-blhgw\""
Sep 10 21:02:42.013313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.013254    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:42.027149 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.027116    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"]
Sep 10 21:02:42.112256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.112213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7ct\" (UniqueName: \"kubernetes.io/projected/3fa2c30e-4c86-4384-a0a2-c776d86449bd-kube-api-access-sl7ct\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.112256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.112254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.112469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.112281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.212859 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.212827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7ct\" (UniqueName: \"kubernetes.io/projected/3fa2c30e-4c86-4384-a0a2-c776d86449bd-kube-api-access-sl7ct\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.212859 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.212860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.213079 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.212883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.213310 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.213290    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.213310 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.213301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.223315 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.223288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7ct\" (UniqueName: \"kubernetes.io/projected/3fa2c30e-4c86-4384-a0a2-c776d86449bd-kube-api-access-sl7ct\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.316707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.316674    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:42.589331 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.589301    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"]
Sep 10 21:02:42.591976 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:02:42.591947    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa2c30e_4c86_4384_a0a2_c776d86449bd.slice/crio-557c6ae73396d50eca98daac91198857f10cbe82c7d68d5f67b374a8fbf31787 WatchSource:0}: Error finding container 557c6ae73396d50eca98daac91198857f10cbe82c7d68d5f67b374a8fbf31787: Status 404 returned error can't find the container with id 557c6ae73396d50eca98daac91198857f10cbe82c7d68d5f67b374a8fbf31787
Sep 10 21:02:42.879831 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.879740    2558 generic.go:356] "Generic (PLEG): container finished" podID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerID="50f45f6c10d11fa08265955a1cc97491e423ae353def11a10597fce7ff4108fb" exitCode=0
Sep 10 21:02:42.879831 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.879799    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26" event={"ID":"3fa2c30e-4c86-4384-a0a2-c776d86449bd","Type":"ContainerDied","Data":"50f45f6c10d11fa08265955a1cc97491e423ae353def11a10597fce7ff4108fb"}
Sep 10 21:02:42.880022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:42.879845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26" event={"ID":"3fa2c30e-4c86-4384-a0a2-c776d86449bd","Type":"ContainerStarted","Data":"557c6ae73396d50eca98daac91198857f10cbe82c7d68d5f67b374a8fbf31787"}
Sep 10 21:02:43.092682 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:43.092648    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:43.198557 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:43.198466    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:43.733776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:43.733744    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:43.885298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:43.885263    2558 generic.go:356] "Generic (PLEG): container finished" podID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerID="0ec5f635956f2255d4370727c9b3cea5af987ba259f856dd064c66c19ba62899" exitCode=0
Sep 10 21:02:43.885467 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:43.885332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26" event={"ID":"3fa2c30e-4c86-4384-a0a2-c776d86449bd","Type":"ContainerDied","Data":"0ec5f635956f2255d4370727c9b3cea5af987ba259f856dd064c66c19ba62899"}
Sep 10 21:02:43.993157 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:43.993072    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.106066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.106009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.170506 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.170473    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"]
Sep 10 21:02:44.172642 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.172625    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.175159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.175131    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 21:02:44.175303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.175278    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 21:02:44.175303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.175295    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 21:02:44.175421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.175318    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 21:02:44.175421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.175364    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t9kg8\""
Sep 10 21:02:44.190009 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.189971    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"]
Sep 10 21:02:44.321726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.321692    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.331750 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.331725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df418f19-8f48-4767-9d2c-266526a89c96-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.331892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.331779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df418f19-8f48-4767-9d2c-266526a89c96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.331892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.331824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df418f19-8f48-4767-9d2c-266526a89c96-manifests\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.331892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.331858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df418f19-8f48-4767-9d2c-266526a89c96-tmp\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.331892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.331885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qnx\" (UniqueName: \"kubernetes.io/projected/df418f19-8f48-4767-9d2c-266526a89c96-kube-api-access-r5qnx\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.416969 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.416932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.432952 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.432917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df418f19-8f48-4767-9d2c-266526a89c96-tmp\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.433090 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.432968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qnx\" (UniqueName: \"kubernetes.io/projected/df418f19-8f48-4767-9d2c-266526a89c96-kube-api-access-r5qnx\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.433090 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.433010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df418f19-8f48-4767-9d2c-266526a89c96-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.433090 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.433081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df418f19-8f48-4767-9d2c-266526a89c96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.433217 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.433119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df418f19-8f48-4767-9d2c-266526a89c96-manifests\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.433455 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.433433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df418f19-8f48-4767-9d2c-266526a89c96-manifests\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.435398 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.435367    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df418f19-8f48-4767-9d2c-266526a89c96-tmp\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.435504 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.435492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df418f19-8f48-4767-9d2c-266526a89c96-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.435589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.435571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df418f19-8f48-4767-9d2c-266526a89c96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.441093 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.441070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qnx\" (UniqueName: \"kubernetes.io/projected/df418f19-8f48-4767-9d2c-266526a89c96-kube-api-access-r5qnx\") pod \"opendatahub-operator-controller-manager-6d4c889df7-mzx4c\" (UID: \"df418f19-8f48-4767-9d2c-266526a89c96\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.483577 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.483535    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:44.518098 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.518063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.618261 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.618180    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.718712 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.718680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.759934 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.759908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"]
Sep 10 21:02:44.762216 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:02:44.762192    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf418f19_8f48_4767_9d2c_266526a89c96.slice/crio-d272ad890c2e17e3e55abe6e4424ec18993425ab048c6711d035145eaf0e21f0 WatchSource:0}: Error finding container d272ad890c2e17e3e55abe6e4424ec18993425ab048c6711d035145eaf0e21f0: Status 404 returned error can't find the container with id d272ad890c2e17e3e55abe6e4424ec18993425ab048c6711d035145eaf0e21f0
Sep 10 21:02:44.892856 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.892780    2558 generic.go:356] "Generic (PLEG): container finished" podID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerID="326165f20008ed2da4f6e378ce105cc5ec2d7f2660a81d715503ec7754ee78cc" exitCode=0
Sep 10 21:02:44.892856 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.892843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26" event={"ID":"3fa2c30e-4c86-4384-a0a2-c776d86449bd","Type":"ContainerDied","Data":"326165f20008ed2da4f6e378ce105cc5ec2d7f2660a81d715503ec7754ee78cc"}
Sep 10 21:02:44.894169 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:44.894148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c" event={"ID":"df418f19-8f48-4767-9d2c-266526a89c96","Type":"ContainerStarted","Data":"d272ad890c2e17e3e55abe6e4424ec18993425ab048c6711d035145eaf0e21f0"}
Sep 10 21:02:46.063258 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.063235    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:46.147914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.147880    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-bundle\") pod \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") "
Sep 10 21:02:46.148113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.147941    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-util\") pod \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") "
Sep 10 21:02:46.148113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.148028    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl7ct\" (UniqueName: \"kubernetes.io/projected/3fa2c30e-4c86-4384-a0a2-c776d86449bd-kube-api-access-sl7ct\") pod \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\" (UID: \"3fa2c30e-4c86-4384-a0a2-c776d86449bd\") "
Sep 10 21:02:46.148751 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.148724    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-bundle" (OuterVolumeSpecName: "bundle") pod "3fa2c30e-4c86-4384-a0a2-c776d86449bd" (UID: "3fa2c30e-4c86-4384-a0a2-c776d86449bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:46.150600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.150569    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa2c30e-4c86-4384-a0a2-c776d86449bd-kube-api-access-sl7ct" (OuterVolumeSpecName: "kube-api-access-sl7ct") pod "3fa2c30e-4c86-4384-a0a2-c776d86449bd" (UID: "3fa2c30e-4c86-4384-a0a2-c776d86449bd"). InnerVolumeSpecName "kube-api-access-sl7ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:46.156709 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.156661    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-util" (OuterVolumeSpecName: "util") pod "3fa2c30e-4c86-4384-a0a2-c776d86449bd" (UID: "3fa2c30e-4c86-4384-a0a2-c776d86449bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:46.249385 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.249343    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl7ct\" (UniqueName: \"kubernetes.io/projected/3fa2c30e-4c86-4384-a0a2-c776d86449bd-kube-api-access-sl7ct\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:46.249385 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.249382    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:46.249584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.249398    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa2c30e-4c86-4384-a0a2-c776d86449bd-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:46.908054 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.908009    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26"
Sep 10 21:02:46.908235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.908015    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cg26" event={"ID":"3fa2c30e-4c86-4384-a0a2-c776d86449bd","Type":"ContainerDied","Data":"557c6ae73396d50eca98daac91198857f10cbe82c7d68d5f67b374a8fbf31787"}
Sep 10 21:02:46.908235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:46.908105    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="557c6ae73396d50eca98daac91198857f10cbe82c7d68d5f67b374a8fbf31787"
Sep 10 21:02:48.918971 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:48.918930    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c" event={"ID":"df418f19-8f48-4767-9d2c-266526a89c96","Type":"ContainerStarted","Data":"2e6dc6385cf30693c735bfa7a759cd5e337c6556715526198687fe444bbe7974"}
Sep 10 21:02:49.924489 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:49.924457    2558 generic.go:356] "Generic (PLEG): container finished" podID="df418f19-8f48-4767-9d2c-266526a89c96" containerID="2e6dc6385cf30693c735bfa7a759cd5e337c6556715526198687fe444bbe7974" exitCode=0
Sep 10 21:02:49.924894 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:49.924545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c" event={"ID":"df418f19-8f48-4767-9d2c-266526a89c96","Type":"ContainerDied","Data":"2e6dc6385cf30693c735bfa7a759cd5e337c6556715526198687fe444bbe7974"}
Sep 10 21:02:50.930661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:50.930627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c" event={"ID":"df418f19-8f48-4767-9d2c-266526a89c96","Type":"ContainerStarted","Data":"856eb983455e8c1c972035a6d23100dd24efe1ef798d1db548ac388c70004446"}
Sep 10 21:02:50.931094 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:50.930746    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:02:50.963632 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:50.963575    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c" podStartSLOduration=2.372485672 podStartE2EDuration="6.96355918s" totalImagesPullingTime="3.504026723s" totalInitContainerRuntime="1.087046785s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:50.961875053 +0000 UTC m=+299.873154856" watchObservedRunningTime="2026-09-10 21:02:50.96355918 +0000 UTC m=+299.874838962"
Sep 10 21:02:51.538572 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:51.532368    2558 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 21:02:52.380502 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:52.380463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:52.490304 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:52.490267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:54.368313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:02:54.368280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:01.937702 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:01.937666    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4c889df7-mzx4c"
Sep 10 21:03:03.456275 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:03.456241    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:04.130607 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130566    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"]
Sep 10 21:03:04.130864 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130851    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerName="pull"
Sep 10 21:03:04.130910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130866    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerName="pull"
Sep 10 21:03:04.130910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130876    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerName="util"
Sep 10 21:03:04.130910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130884    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerName="util"
Sep 10 21:03:04.130910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130902    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerName="extract"
Sep 10 21:03:04.130910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130909    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerName="extract"
Sep 10 21:03:04.131077 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.130950    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa2c30e-4c86-4384-a0a2-c776d86449bd" containerName="extract"
Sep 10 21:03:04.142403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.142347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.150542 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.150519    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 21:03:04.150714 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.150694    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 21:03:04.151222 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.151200    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 21:03:04.151422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.151409    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 21:03:04.151662 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.151649    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-57zhj\""
Sep 10 21:03:04.161218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.161178    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"]
Sep 10 21:03:04.189923 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.189887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpldw\" (UniqueName: \"kubernetes.io/projected/bd69589a-578a-4968-a79b-49bbc8e49f95-kube-api-access-bpldw\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.189923 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.189926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd69589a-578a-4968-a79b-49bbc8e49f95-tmp\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.190158 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.189991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd69589a-578a-4968-a79b-49bbc8e49f95-tls-certs\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.290470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.290434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd69589a-578a-4968-a79b-49bbc8e49f95-tls-certs\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.290470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.290486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpldw\" (UniqueName: \"kubernetes.io/projected/bd69589a-578a-4968-a79b-49bbc8e49f95-kube-api-access-bpldw\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.290778 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.290509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd69589a-578a-4968-a79b-49bbc8e49f95-tmp\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.290778 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:03:04.290586    2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 21:03:04.290778 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:03:04.290663    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd69589a-578a-4968-a79b-49bbc8e49f95-tls-certs podName:bd69589a-578a-4968-a79b-49bbc8e49f95 nodeName:}" failed. No retries permitted until 2026-09-10 21:03:04.790646247 +0000 UTC m=+313.701926022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bd69589a-578a-4968-a79b-49bbc8e49f95-tls-certs") pod "kube-auth-proxy-f4cb8c76f-j8wdn" (UID: "bd69589a-578a-4968-a79b-49bbc8e49f95") : secret "kube-auth-proxy-tls" not found
Sep 10 21:03:04.292781 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.292758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd69589a-578a-4968-a79b-49bbc8e49f95-tmp\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.302893 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.302860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpldw\" (UniqueName: \"kubernetes.io/projected/bd69589a-578a-4968-a79b-49bbc8e49f95-kube-api-access-bpldw\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.794180 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.794131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd69589a-578a-4968-a79b-49bbc8e49f95-tls-certs\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:04.796731 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:04.796699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd69589a-578a-4968-a79b-49bbc8e49f95-tls-certs\") pod \"kube-auth-proxy-f4cb8c76f-j8wdn\" (UID: \"bd69589a-578a-4968-a79b-49bbc8e49f95\") " pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:05.052049 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.052019    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"
Sep 10 21:03:05.326410 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.326361    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn"]
Sep 10 21:03:05.328836 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:03:05.328804    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd69589a_578a_4968_a79b_49bbc8e49f95.slice/crio-be362a55968a4e53f79abe29be8051b4f5abe2c05eada1634b96f73de18049a8 WatchSource:0}: Error finding container be362a55968a4e53f79abe29be8051b4f5abe2c05eada1634b96f73de18049a8: Status 404 returned error can't find the container with id be362a55968a4e53f79abe29be8051b4f5abe2c05eada1634b96f73de18049a8
Sep 10 21:03:05.330770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.330748    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:03:05.464297 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.464258    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:05.564762 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.564729    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"]
Sep 10 21:03:05.569187 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.569170    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.572611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.572585    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t9zwq\""
Sep 10 21:03:05.572902 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.572885    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 21:03:05.573272 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.573251    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 21:03:05.573375 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.573256    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:03:05.573375 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.573303    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 21:03:05.589374 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.589339    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"]
Sep 10 21:03:05.599882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.599854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.600014 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.599894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.600014 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.599980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64tb\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-kube-api-access-s64tb\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.600111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.600028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccdbc0e-5c7d-440f-911a-0f1951204872-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.600111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.600077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.600111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.600099    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.600218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.600172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.615057 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.615018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:05.700895 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.700856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccdbc0e-5c7d-440f-911a-0f1951204872-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.701111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.700899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.701111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.700925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.701111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.700968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.701111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.700997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.701111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.701025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.701111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.701085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64tb\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-kube-api-access-s64tb\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.701619 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.701590    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.703502 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.703482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.703593 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.703527    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.703648 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.703631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccdbc0e-5c7d-440f-911a-0f1951204872-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.703840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.703818    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.711101 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.711078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.712010 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.711991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64tb\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-kube-api-access-s64tb\") pod \"istiod-openshift-gateway-7b7995d5cd-r69bj\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.878544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.878448    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:05.999407 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:05.999368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn" event={"ID":"bd69589a-578a-4968-a79b-49bbc8e49f95","Type":"ContainerStarted","Data":"be362a55968a4e53f79abe29be8051b4f5abe2c05eada1634b96f73de18049a8"}
Sep 10 21:03:06.158687 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:06.158654    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"]
Sep 10 21:03:06.162004 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:03:06.161968    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccdbc0e_5c7d_440f_911a_0f1951204872.slice/crio-acc5836d7bceeeda9fb9375299f9ab10af5e8e908a348c8a9fea789681500f8e WatchSource:0}: Error finding container acc5836d7bceeeda9fb9375299f9ab10af5e8e908a348c8a9fea789681500f8e: Status 404 returned error can't find the container with id acc5836d7bceeeda9fb9375299f9ab10af5e8e908a348c8a9fea789681500f8e
Sep 10 21:03:06.687855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:06.687807    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:07.005843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:07.005760    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj" event={"ID":"fccdbc0e-5c7d-440f-911a-0f1951204872","Type":"ContainerStarted","Data":"acc5836d7bceeeda9fb9375299f9ab10af5e8e908a348c8a9fea789681500f8e"}
Sep 10 21:03:09.017103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:09.017059    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn" event={"ID":"bd69589a-578a-4968-a79b-49bbc8e49f95","Type":"ContainerStarted","Data":"0c95f2b7580406bd1db3a0f2b770ada669d61cc22014222ad36ce961b767d37e"}
Sep 10 21:03:09.036010 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:09.035945    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f4cb8c76f-j8wdn" podStartSLOduration=2.329263532 podStartE2EDuration="5.035922969s" totalImagesPullingTime="2.706659437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:09.0344919 +0000 UTC m=+317.945771698" watchObservedRunningTime="2026-09-10 21:03:09.035922969 +0000 UTC m=+317.947202753"
Sep 10 21:03:09.748999 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:09.748966    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:03:09.749098 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:09.749036    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:03:10.022747 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:10.022656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj" event={"ID":"fccdbc0e-5c7d-440f-911a-0f1951204872","Type":"ContainerStarted","Data":"8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc"}
Sep 10 21:03:10.023196 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:10.022902    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:10.024694 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:10.024664    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-r69bj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:03:10.024814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:10.024723    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj" podUID="fccdbc0e-5c7d-440f-911a-0f1951204872" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:03:10.045415 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:10.045364    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj" podStartSLOduration=1.46134768 podStartE2EDuration="5.045346034s" totalImagesPullingTime="3.583998354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:10.044487026 +0000 UTC m=+318.955766819" watchObservedRunningTime="2026-09-10 21:03:10.045346034 +0000 UTC m=+318.956625815"
Sep 10 21:03:10.240833 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:10.240796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:10.321852 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:10.321812    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:11.028040 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:11.028015    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:11.169917 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:11.169880    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:11.385957 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:11.385911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:11.488404 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:11.488373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:14.960020 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:14.959985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:15.059821 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.059789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:15.514719 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.514681    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:15.628256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.628225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:15.640481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.640453    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2scfr"]
Sep 10 21:03:15.643486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.643471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:15.646487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.646465    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-88lbq\""
Sep 10 21:03:15.646726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.646712    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 21:03:15.655456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.655432    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2scfr"]
Sep 10 21:03:15.684898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.684861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvmj\" (UniqueName: \"kubernetes.io/projected/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-kube-api-access-2qvmj\") pod \"model-serving-api-54d89bd5fc-2scfr\" (UID: \"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:15.685086 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.684963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2scfr\" (UID: \"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:15.786198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.786102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvmj\" (UniqueName: \"kubernetes.io/projected/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-kube-api-access-2qvmj\") pod \"model-serving-api-54d89bd5fc-2scfr\" (UID: \"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:15.786198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.786167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2scfr\" (UID: \"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:15.786405 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:03:15.786262    2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 10 21:03:15.786405 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:03:15.786317    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-tls-certs podName:d3d47442-e9f9-4b18-8d6b-9fc2413b13e1 nodeName:}" failed. No retries permitted until 2026-09-10 21:03:16.286300867 +0000 UTC m=+325.197580626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-tls-certs") pod "model-serving-api-54d89bd5fc-2scfr" (UID: "d3d47442-e9f9-4b18-8d6b-9fc2413b13e1") : secret "model-serving-api-tls" not found
Sep 10 21:03:15.795545 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.795514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvmj\" (UniqueName: \"kubernetes.io/projected/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-kube-api-access-2qvmj\") pod \"model-serving-api-54d89bd5fc-2scfr\" (UID: \"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:15.909443 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:15.909412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:16.290925 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:16.290891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2scfr\" (UID: \"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:16.293618 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:16.293590    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d47442-e9f9-4b18-8d6b-9fc2413b13e1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2scfr\" (UID: \"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:16.553483 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:16.553447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:16.826088 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:16.826061    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2scfr"]
Sep 10 21:03:16.828773 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:03:16.828744    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d47442_e9f9_4b18_8d6b_9fc2413b13e1.slice/crio-98a5da916404e9fa0c892af9a49895615af3d95472e3fe9797767612e628e9a6 WatchSource:0}: Error finding container 98a5da916404e9fa0c892af9a49895615af3d95472e3fe9797767612e628e9a6: Status 404 returned error can't find the container with id 98a5da916404e9fa0c892af9a49895615af3d95472e3fe9797767612e628e9a6
Sep 10 21:03:17.053728 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:17.053687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2scfr" event={"ID":"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1","Type":"ContainerStarted","Data":"98a5da916404e9fa0c892af9a49895615af3d95472e3fe9797767612e628e9a6"}
Sep 10 21:03:19.065466 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:19.065429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2scfr" event={"ID":"d3d47442-e9f9-4b18-8d6b-9fc2413b13e1","Type":"ContainerStarted","Data":"562044e81fdb8db03528ea161f2699b9839a13034bf4a5806a9315b1e1e4420c"}
Sep 10 21:03:19.065843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:19.065543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:19.085637 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:19.085584    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2scfr" podStartSLOduration=2.784380838 podStartE2EDuration="4.085568259s" totalImagesPullingTime="1.301187421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:19.083562048 +0000 UTC m=+327.994841851" watchObservedRunningTime="2026-09-10 21:03:19.085568259 +0000 UTC m=+327.996848040"
Sep 10 21:03:25.158364 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.158325    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.242886 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.242849    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dt662"]
Sep 10 21:03:25.250760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.250731    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.253348 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.253318    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 21:03:25.253463 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.253441    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mpncp\""
Sep 10 21:03:25.268298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.268266    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dt662"]
Sep 10 21:03:25.280836 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.280803    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"]
Sep 10 21:03:25.283900 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.283883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.286456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.286435    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hzlpq\""
Sep 10 21:03:25.287160 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.287145    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 21:03:25.302950 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.302916    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"]
Sep 10 21:03:25.315754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.315730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.361920 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.361889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7daa75af-8038-4494-a210-503d51a3ba0f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6vc7f\" (UID: \"7daa75af-8038-4494-a210-503d51a3ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.362110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.361932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ptf\" (UniqueName: \"kubernetes.io/projected/cff1fda2-da66-4b33-994c-c01ef7f83b03-kube-api-access-t8ptf\") pod \"kserve-controller-manager-d6f4b65b8-dt662\" (UID: \"cff1fda2-da66-4b33-994c-c01ef7f83b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.362110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.361961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff1fda2-da66-4b33-994c-c01ef7f83b03-cert\") pod \"kserve-controller-manager-d6f4b65b8-dt662\" (UID: \"cff1fda2-da66-4b33-994c-c01ef7f83b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.362110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.361976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v26zw\" (UniqueName: \"kubernetes.io/projected/7daa75af-8038-4494-a210-503d51a3ba0f-kube-api-access-v26zw\") pod \"llmisvc-controller-manager-777c6bd7d5-6vc7f\" (UID: \"7daa75af-8038-4494-a210-503d51a3ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.424726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.424639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.462814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.462777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7daa75af-8038-4494-a210-503d51a3ba0f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6vc7f\" (UID: \"7daa75af-8038-4494-a210-503d51a3ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.462963 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.462834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ptf\" (UniqueName: \"kubernetes.io/projected/cff1fda2-da66-4b33-994c-c01ef7f83b03-kube-api-access-t8ptf\") pod \"kserve-controller-manager-d6f4b65b8-dt662\" (UID: \"cff1fda2-da66-4b33-994c-c01ef7f83b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.462963 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.462867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff1fda2-da66-4b33-994c-c01ef7f83b03-cert\") pod \"kserve-controller-manager-d6f4b65b8-dt662\" (UID: \"cff1fda2-da66-4b33-994c-c01ef7f83b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.462963 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.462890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v26zw\" (UniqueName: \"kubernetes.io/projected/7daa75af-8038-4494-a210-503d51a3ba0f-kube-api-access-v26zw\") pod \"llmisvc-controller-manager-777c6bd7d5-6vc7f\" (UID: \"7daa75af-8038-4494-a210-503d51a3ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.465297 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.465274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7daa75af-8038-4494-a210-503d51a3ba0f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6vc7f\" (UID: \"7daa75af-8038-4494-a210-503d51a3ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.465411 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.465364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cff1fda2-da66-4b33-994c-c01ef7f83b03-cert\") pod \"kserve-controller-manager-d6f4b65b8-dt662\" (UID: \"cff1fda2-da66-4b33-994c-c01ef7f83b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.472349 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.472324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v26zw\" (UniqueName: \"kubernetes.io/projected/7daa75af-8038-4494-a210-503d51a3ba0f-kube-api-access-v26zw\") pod \"llmisvc-controller-manager-777c6bd7d5-6vc7f\" (UID: \"7daa75af-8038-4494-a210-503d51a3ba0f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.472463 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.472332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ptf\" (UniqueName: \"kubernetes.io/projected/cff1fda2-da66-4b33-994c-c01ef7f83b03-kube-api-access-t8ptf\") pod \"kserve-controller-manager-d6f4b65b8-dt662\" (UID: \"cff1fda2-da66-4b33-994c-c01ef7f83b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.561487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.561445    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:25.572670 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.572643    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.593577 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.593541    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:25.842646 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.842622    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dt662"]
Sep 10 21:03:25.844601 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:03:25.844577    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff1fda2_da66_4b33_994c_c01ef7f83b03.slice/crio-fac0f7e038a771d119886af33fe86fcd76b66d3227a31ed021fb9e042a10b46e WatchSource:0}: Error finding container fac0f7e038a771d119886af33fe86fcd76b66d3227a31ed021fb9e042a10b46e: Status 404 returned error can't find the container with id fac0f7e038a771d119886af33fe86fcd76b66d3227a31ed021fb9e042a10b46e
Sep 10 21:03:25.878700 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:25.878547    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"]
Sep 10 21:03:25.880545 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:03:25.880516    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7daa75af_8038_4494_a210_503d51a3ba0f.slice/crio-f72d6e130edf97ef19edeaa0d250c439d60ffd37e5e8372c0b61c6562c8b30e1 WatchSource:0}: Error finding container f72d6e130edf97ef19edeaa0d250c439d60ffd37e5e8372c0b61c6562c8b30e1: Status 404 returned error can't find the container with id f72d6e130edf97ef19edeaa0d250c439d60ffd37e5e8372c0b61c6562c8b30e1
Sep 10 21:03:26.103145 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.103027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f" event={"ID":"7daa75af-8038-4494-a210-503d51a3ba0f","Type":"ContainerStarted","Data":"f72d6e130edf97ef19edeaa0d250c439d60ffd37e5e8372c0b61c6562c8b30e1"}
Sep 10 21:03:26.104268 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.104243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662" event={"ID":"cff1fda2-da66-4b33-994c-c01ef7f83b03","Type":"ContainerStarted","Data":"fac0f7e038a771d119886af33fe86fcd76b66d3227a31ed021fb9e042a10b46e"}
Sep 10 21:03:26.376586 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.376492    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"]
Sep 10 21:03:26.377070 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.376747    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj" podUID="fccdbc0e-5c7d-440f-911a-0f1951204872" containerName="discovery" containerID="cri-o://8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc" gracePeriod=30
Sep 10 21:03:26.470463 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.470427    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:26.587708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.587675    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:26.675770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.675746    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:26.773277 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773247    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-token\") pod \"fccdbc0e-5c7d-440f-911a-0f1951204872\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") "
Sep 10 21:03:26.773442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-dns-cert\") pod \"fccdbc0e-5c7d-440f-911a-0f1951204872\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") "
Sep 10 21:03:26.773442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773322    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s64tb\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-kube-api-access-s64tb\") pod \"fccdbc0e-5c7d-440f-911a-0f1951204872\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") "
Sep 10 21:03:26.773442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773368    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-ca-configmap\") pod \"fccdbc0e-5c7d-440f-911a-0f1951204872\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") "
Sep 10 21:03:26.773574 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773511    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-kubeconfig\") pod \"fccdbc0e-5c7d-440f-911a-0f1951204872\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") "
Sep 10 21:03:26.773574 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773552    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccdbc0e-5c7d-440f-911a-0f1951204872-local-certs\") pod \"fccdbc0e-5c7d-440f-911a-0f1951204872\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") "
Sep 10 21:03:26.773672 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773579    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-cacerts\") pod \"fccdbc0e-5c7d-440f-911a-0f1951204872\" (UID: \"fccdbc0e-5c7d-440f-911a-0f1951204872\") "
Sep 10 21:03:26.773797 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.773767    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "fccdbc0e-5c7d-440f-911a-0f1951204872" (UID: "fccdbc0e-5c7d-440f-911a-0f1951204872"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:03:26.775890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.775861    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "fccdbc0e-5c7d-440f-911a-0f1951204872" (UID: "fccdbc0e-5c7d-440f-911a-0f1951204872"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:03:26.776004 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.775866    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccdbc0e-5c7d-440f-911a-0f1951204872-local-certs" (OuterVolumeSpecName: "local-certs") pod "fccdbc0e-5c7d-440f-911a-0f1951204872" (UID: "fccdbc0e-5c7d-440f-911a-0f1951204872"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:26.776004 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.775979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-kube-api-access-s64tb" (OuterVolumeSpecName: "kube-api-access-s64tb") pod "fccdbc0e-5c7d-440f-911a-0f1951204872" (UID: "fccdbc0e-5c7d-440f-911a-0f1951204872"). InnerVolumeSpecName "kube-api-access-s64tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:26.776004 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.775979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-token" (OuterVolumeSpecName: "istio-token") pod "fccdbc0e-5c7d-440f-911a-0f1951204872" (UID: "fccdbc0e-5c7d-440f-911a-0f1951204872"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:26.776183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.776028    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "fccdbc0e-5c7d-440f-911a-0f1951204872" (UID: "fccdbc0e-5c7d-440f-911a-0f1951204872"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:03:26.776183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.776067    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-cacerts" (OuterVolumeSpecName: "cacerts") pod "fccdbc0e-5c7d-440f-911a-0f1951204872" (UID: "fccdbc0e-5c7d-440f-911a-0f1951204872"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:03:26.874559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.874515    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-cacerts\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:26.874559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.874556    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:26.874784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.874575    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-dns-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:26.874784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.874590    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s64tb\" (UniqueName: \"kubernetes.io/projected/fccdbc0e-5c7d-440f-911a-0f1951204872-kube-api-access-s64tb\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:26.874784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.874607    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-csr-ca-configmap\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:26.874784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.874623    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fccdbc0e-5c7d-440f-911a-0f1951204872-istio-kubeconfig\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:26.874784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:26.874637    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccdbc0e-5c7d-440f-911a-0f1951204872-local-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:27.111418 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.111382    2558 generic.go:356] "Generic (PLEG): container finished" podID="fccdbc0e-5c7d-440f-911a-0f1951204872" containerID="8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc" exitCode=0
Sep 10 21:03:27.111582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.111438    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"
Sep 10 21:03:27.111582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.111464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj" event={"ID":"fccdbc0e-5c7d-440f-911a-0f1951204872","Type":"ContainerDied","Data":"8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc"}
Sep 10 21:03:27.111582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.111530    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj" event={"ID":"fccdbc0e-5c7d-440f-911a-0f1951204872","Type":"ContainerDied","Data":"acc5836d7bceeeda9fb9375299f9ab10af5e8e908a348c8a9fea789681500f8e"}
Sep 10 21:03:27.111582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.111559    2558 scope.go:117] "RemoveContainer" containerID="8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc"
Sep 10 21:03:27.139830 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.139791    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"]
Sep 10 21:03:27.143782 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.143743    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r69bj"]
Sep 10 21:03:27.222630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.222602    2558 scope.go:117] "RemoveContainer" containerID="8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc"
Sep 10 21:03:27.223096 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:03:27.223063    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc\": container with ID starting with 8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc not found: ID does not exist" containerID="8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc"
Sep 10 21:03:27.223181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.223104    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc"} err="failed to get container status \"8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc\": rpc error: code = NotFound desc = could not find container \"8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc\": container with ID starting with 8b20058a6d99d5dacf7816b1c7f477159677984cf7a0a3a04453bef5dadba5cc not found: ID does not exist"
Sep 10 21:03:27.617598 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:27.617554    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fccdbc0e-5c7d-440f-911a-0f1951204872" path="/var/lib/kubelet/pods/fccdbc0e-5c7d-440f-911a-0f1951204872/volumes"
Sep 10 21:03:29.126835 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:29.126797    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f" event={"ID":"7daa75af-8038-4494-a210-503d51a3ba0f","Type":"ContainerStarted","Data":"8d3cc46f6955fab47e2011f37b4775cf080f1fac6fb6335059002732a6456d43"}
Sep 10 21:03:29.127280 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:29.126891    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:03:29.128487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:29.128459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662" event={"ID":"cff1fda2-da66-4b33-994c-c01ef7f83b03","Type":"ContainerStarted","Data":"65186394a5dfe4ff129922e5f5ddaa11c4f6712a4ff9be1f55aeb6124683b67c"}
Sep 10 21:03:29.128604 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:29.128584    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:03:29.147196 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:29.147147    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f" podStartSLOduration=1.407880915 podStartE2EDuration="4.147131634s" totalImagesPullingTime="2.739250719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:29.145250497 +0000 UTC m=+338.056530279" watchObservedRunningTime="2026-09-10 21:03:29.147131634 +0000 UTC m=+338.058411473"
Sep 10 21:03:29.171590 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:29.171542    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662" podStartSLOduration=1.400685541 podStartE2EDuration="4.171527915s" totalImagesPullingTime="2.770842374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:29.169389879 +0000 UTC m=+338.080669706" watchObservedRunningTime="2026-09-10 21:03:29.171527915 +0000 UTC m=+338.082807697"
Sep 10 21:03:30.074386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:30.074354    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2scfr"
Sep 10 21:03:52.987509 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:03:52.987471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:00.134727 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:00.134691    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6vc7f"
Sep 10 21:04:00.137632 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:00.137609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt662"
Sep 10 21:04:16.125812 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:16.125769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:16.228788 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:16.228747    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:19.193308 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.193269    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d96576c45-zrxmk"]
Sep 10 21:04:19.193677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.193555    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fccdbc0e-5c7d-440f-911a-0f1951204872" containerName="discovery"
Sep 10 21:04:19.193677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.193566    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fccdbc0e-5c7d-440f-911a-0f1951204872" containerName="discovery"
Sep 10 21:04:19.193677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.193643    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fccdbc0e-5c7d-440f-911a-0f1951204872" containerName="discovery"
Sep 10 21:04:19.195700 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.195682    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.199772 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.199735    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 21:04:19.199772 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.199740    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-66nzk\""
Sep 10 21:04:19.200756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.200729    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 21:04:19.200868 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.200787    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 21:04:19.200868 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.200831    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 21:04:19.200868 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.200848    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 21:04:19.201055 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.201025    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 21:04:19.201124 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.201058    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 21:04:19.203445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.203316    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 21:04:19.213662 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.213637    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d96576c45-zrxmk"]
Sep 10 21:04:19.267541 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.267509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:19.288599 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.288568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-oauth-config\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.288733 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.288601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlf7k\" (UniqueName: \"kubernetes.io/projected/86edee60-2611-495b-8ae4-7f0833d8e7b4-kube-api-access-rlf7k\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.288733 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.288634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-service-ca\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.288733 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.288649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-trusted-ca-bundle\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.288733 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.288692    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-serving-cert\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.288733 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.288731    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-oauth-serving-cert\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.288899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.288752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-config\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.365144 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.365113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:19.389307 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.389277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-service-ca\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.389431 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.389309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-trusted-ca-bundle\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.389431 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.389338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-serving-cert\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.389431 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.389389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-oauth-serving-cert\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.389431 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.389412    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-config\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.389624 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.389464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-oauth-config\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.389624 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.389487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlf7k\" (UniqueName: \"kubernetes.io/projected/86edee60-2611-495b-8ae4-7f0833d8e7b4-kube-api-access-rlf7k\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.390092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.390037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-service-ca\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.390217 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.390180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-oauth-serving-cert\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.390330 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.390307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-trusted-ca-bundle\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.390388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.390313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-config\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.391904 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.391881    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-oauth-config\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.392123 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.392103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86edee60-2611-495b-8ae4-7f0833d8e7b4-console-serving-cert\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.397521 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.397494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlf7k\" (UniqueName: \"kubernetes.io/projected/86edee60-2611-495b-8ae4-7f0833d8e7b4-kube-api-access-rlf7k\") pod \"console-5d96576c45-zrxmk\" (UID: \"86edee60-2611-495b-8ae4-7f0833d8e7b4\") " pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.506430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.506351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:19.777664 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:19.777581    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d96576c45-zrxmk"]
Sep 10 21:04:19.780987 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:19.780961    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86edee60_2611_495b_8ae4_7f0833d8e7b4.slice/crio-485f690bd78d692892895e86773bb10b84bf524057ff754b57e9c918ae6a211f WatchSource:0}: Error finding container 485f690bd78d692892895e86773bb10b84bf524057ff754b57e9c918ae6a211f: Status 404 returned error can't find the container with id 485f690bd78d692892895e86773bb10b84bf524057ff754b57e9c918ae6a211f
Sep 10 21:04:20.354529 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:20.354493    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d96576c45-zrxmk" event={"ID":"86edee60-2611-495b-8ae4-7f0833d8e7b4","Type":"ContainerStarted","Data":"04502eaca005c28b89ba2b53ac2b87ab40b29ee51eb1bda86e14b34e8cb54f3e"}
Sep 10 21:04:20.354898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:20.354546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d96576c45-zrxmk" event={"ID":"86edee60-2611-495b-8ae4-7f0833d8e7b4","Type":"ContainerStarted","Data":"485f690bd78d692892895e86773bb10b84bf524057ff754b57e9c918ae6a211f"}
Sep 10 21:04:20.381655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:20.381607    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d96576c45-zrxmk" podStartSLOduration=1.381590074 podStartE2EDuration="1.381590074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:20.380926065 +0000 UTC m=+389.292205858" watchObservedRunningTime="2026-09-10 21:04:20.381590074 +0000 UTC m=+389.292869856"
Sep 10 21:04:23.271485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.271448    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"]
Sep 10 21:04:23.274787 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.274770    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.277127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.277105    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:04:23.277743 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.277728    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-blhgw\""
Sep 10 21:04:23.277791 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.277762    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:04:23.315667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.315635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.315802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.315670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.315802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.315752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vr7v\" (UniqueName: \"kubernetes.io/projected/4505fcb1-c515-4d8a-bd92-d9e877a1004c-kube-api-access-4vr7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.340119 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.340087    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"]
Sep 10 21:04:23.368500 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.368468    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"]
Sep 10 21:04:23.371970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.371952    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.382287 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.382262    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"]
Sep 10 21:04:23.416114 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q92j\" (UniqueName: \"kubernetes.io/projected/50eee24c-e844-4e5c-8074-61afefab61c3-kube-api-access-8q92j\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.416243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vr7v\" (UniqueName: \"kubernetes.io/projected/4505fcb1-c515-4d8a-bd92-d9e877a1004c-kube-api-access-4vr7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.416243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.416243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.416243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.416243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416218    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.416593 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.416630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.416614    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.424099 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.424074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vr7v\" (UniqueName: \"kubernetes.io/projected/4505fcb1-c515-4d8a-bd92-d9e877a1004c-kube-api-access-4vr7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.473961 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.473929    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"]
Sep 10 21:04:23.477406 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.477389    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.487714 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.487688    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"]
Sep 10 21:04:23.517337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.517493 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.517493 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.517493 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q92j\" (UniqueName: \"kubernetes.io/projected/50eee24c-e844-4e5c-8074-61afefab61c3-kube-api-access-8q92j\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.517493 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4tn4\" (UniqueName: \"kubernetes.io/projected/44124bbd-c695-4fe6-8bea-da9cc42614c7-kube-api-access-b4tn4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.517668 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517502    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.517668 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.517734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.517704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.525504 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.525462    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q92j\" (UniqueName: \"kubernetes.io/projected/50eee24c-e844-4e5c-8074-61afefab61c3-kube-api-access-8q92j\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.579116 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.579084    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"]
Sep 10 21:04:23.582588 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.582571    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.584669 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.584649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:23.618661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.618628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.618816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.618688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w8pv\" (UniqueName: \"kubernetes.io/projected/1f8aebac-8e50-445b-81fe-599cefb6a6b9-kube-api-access-4w8pv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.618816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.618784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.618901 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.618871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.618950 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.618909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4tn4\" (UniqueName: \"kubernetes.io/projected/44124bbd-c695-4fe6-8bea-da9cc42614c7-kube-api-access-b4tn4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.618993 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.618974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.619068 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.619030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.619277 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.619260    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.627994 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.627969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4tn4\" (UniqueName: \"kubernetes.io/projected/44124bbd-c695-4fe6-8bea-da9cc42614c7-kube-api-access-b4tn4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.631336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.631313    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"]
Sep 10 21:04:23.680586 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.680554    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:23.719572 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.719538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.719572 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.719581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.719815 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.719633    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w8pv\" (UniqueName: \"kubernetes.io/projected/1f8aebac-8e50-445b-81fe-599cefb6a6b9-kube-api-access-4w8pv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.723080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.720292    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.723080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.720460    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.730303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.730277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w8pv\" (UniqueName: \"kubernetes.io/projected/1f8aebac-8e50-445b-81fe-599cefb6a6b9-kube-api-access-4w8pv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.786390 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.786316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:23.863711 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.863648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"]
Sep 10 21:04:23.865772 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:23.865747    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4505fcb1_c515_4d8a_bd92_d9e877a1004c.slice/crio-d54d7b3dee5c663abd9c20bae5cd03120f6d02e117f8c0262260bf48452c34da WatchSource:0}: Error finding container d54d7b3dee5c663abd9c20bae5cd03120f6d02e117f8c0262260bf48452c34da: Status 404 returned error can't find the container with id d54d7b3dee5c663abd9c20bae5cd03120f6d02e117f8c0262260bf48452c34da
Sep 10 21:04:23.892873 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.892847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:23.959270 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:23.959233    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"]
Sep 10 21:04:23.962313 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:23.962283    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50eee24c_e844_4e5c_8074_61afefab61c3.slice/crio-22625827063e69ba9d734dfba6b70f739db1a1e307e358da8884319f8765a845 WatchSource:0}: Error finding container 22625827063e69ba9d734dfba6b70f739db1a1e307e358da8884319f8765a845: Status 404 returned error can't find the container with id 22625827063e69ba9d734dfba6b70f739db1a1e307e358da8884319f8765a845
Sep 10 21:04:24.059281 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.059250    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"]
Sep 10 21:04:24.061110 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:24.061084    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44124bbd_c695_4fe6_8bea_da9cc42614c7.slice/crio-3adcd3ba5d67ab6e522dee30ef6e62c47020157ab98f4829780f312764f2a4ee WatchSource:0}: Error finding container 3adcd3ba5d67ab6e522dee30ef6e62c47020157ab98f4829780f312764f2a4ee: Status 404 returned error can't find the container with id 3adcd3ba5d67ab6e522dee30ef6e62c47020157ab98f4829780f312764f2a4ee
Sep 10 21:04:24.168898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.168875    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"]
Sep 10 21:04:24.171878 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:24.171852    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8aebac_8e50_445b_81fe_599cefb6a6b9.slice/crio-51ffd9717921e329dca1ee8b2c2413699dbf5472b00c29b6a3b4152243997f98 WatchSource:0}: Error finding container 51ffd9717921e329dca1ee8b2c2413699dbf5472b00c29b6a3b4152243997f98: Status 404 returned error can't find the container with id 51ffd9717921e329dca1ee8b2c2413699dbf5472b00c29b6a3b4152243997f98
Sep 10 21:04:24.372946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.372913    2558 generic.go:356] "Generic (PLEG): container finished" podID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerID="b85f3c7554f4aa08c0f6b89f0374e48c3a153691b6b663ace24e9a3ccd8b976c" exitCode=0
Sep 10 21:04:24.373398 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.373002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm" event={"ID":"44124bbd-c695-4fe6-8bea-da9cc42614c7","Type":"ContainerDied","Data":"b85f3c7554f4aa08c0f6b89f0374e48c3a153691b6b663ace24e9a3ccd8b976c"}
Sep 10 21:04:24.373398 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.373072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm" event={"ID":"44124bbd-c695-4fe6-8bea-da9cc42614c7","Type":"ContainerStarted","Data":"3adcd3ba5d67ab6e522dee30ef6e62c47020157ab98f4829780f312764f2a4ee"}
Sep 10 21:04:24.374748 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.374725    2558 generic.go:356] "Generic (PLEG): container finished" podID="50eee24c-e844-4e5c-8074-61afefab61c3" containerID="d832262945dc7e1a805f6510852d1cb5747e0436a9f73471fd8fd37899add370" exitCode=0
Sep 10 21:04:24.374862 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.374839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l" event={"ID":"50eee24c-e844-4e5c-8074-61afefab61c3","Type":"ContainerDied","Data":"d832262945dc7e1a805f6510852d1cb5747e0436a9f73471fd8fd37899add370"}
Sep 10 21:04:24.374931 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.374904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l" event={"ID":"50eee24c-e844-4e5c-8074-61afefab61c3","Type":"ContainerStarted","Data":"22625827063e69ba9d734dfba6b70f739db1a1e307e358da8884319f8765a845"}
Sep 10 21:04:24.376725 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.376699    2558 generic.go:356] "Generic (PLEG): container finished" podID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerID="908e4b68a343994dab02af5ee494adf2ea40157d74241878af8b2aff52eb8c23" exitCode=0
Sep 10 21:04:24.376825 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.376810    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2" event={"ID":"4505fcb1-c515-4d8a-bd92-d9e877a1004c","Type":"ContainerDied","Data":"908e4b68a343994dab02af5ee494adf2ea40157d74241878af8b2aff52eb8c23"}
Sep 10 21:04:24.376863 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.376846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2" event={"ID":"4505fcb1-c515-4d8a-bd92-d9e877a1004c","Type":"ContainerStarted","Data":"d54d7b3dee5c663abd9c20bae5cd03120f6d02e117f8c0262260bf48452c34da"}
Sep 10 21:04:24.378673 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.378651    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerID="2b0d003b76fd1af51c552c5b4d87d59d604feb8c50bfb83bd134d854bbab4e3b" exitCode=0
Sep 10 21:04:24.378784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.378687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f" event={"ID":"1f8aebac-8e50-445b-81fe-599cefb6a6b9","Type":"ContainerDied","Data":"2b0d003b76fd1af51c552c5b4d87d59d604feb8c50bfb83bd134d854bbab4e3b"}
Sep 10 21:04:24.378784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:24.378718    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f" event={"ID":"1f8aebac-8e50-445b-81fe-599cefb6a6b9","Type":"ContainerStarted","Data":"51ffd9717921e329dca1ee8b2c2413699dbf5472b00c29b6a3b4152243997f98"}
Sep 10 21:04:25.384877 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.384804    2558 generic.go:356] "Generic (PLEG): container finished" podID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerID="62aafff8fc4e02c388bda2f9e6383e2c4918bc2abaeceff7efa1ede3b57e35c8" exitCode=0
Sep 10 21:04:25.385261 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.384890    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2" event={"ID":"4505fcb1-c515-4d8a-bd92-d9e877a1004c","Type":"ContainerDied","Data":"62aafff8fc4e02c388bda2f9e6383e2c4918bc2abaeceff7efa1ede3b57e35c8"}
Sep 10 21:04:25.387007 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.386987    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerID="70e7d97e3d1ccb106667f09791612e6176a0dde838735348ed45914efef0ba33" exitCode=0
Sep 10 21:04:25.387113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.387086    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f" event={"ID":"1f8aebac-8e50-445b-81fe-599cefb6a6b9","Type":"ContainerDied","Data":"70e7d97e3d1ccb106667f09791612e6176a0dde838735348ed45914efef0ba33"}
Sep 10 21:04:25.388959 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.388941    2558 generic.go:356] "Generic (PLEG): container finished" podID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerID="c9dab3819538e735760e5e511ef91db646f540124c9627aaaf7bdd580ca51f41" exitCode=0
Sep 10 21:04:25.389060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.389006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm" event={"ID":"44124bbd-c695-4fe6-8bea-da9cc42614c7","Type":"ContainerDied","Data":"c9dab3819538e735760e5e511ef91db646f540124c9627aaaf7bdd580ca51f41"}
Sep 10 21:04:25.391128 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.391106    2558 generic.go:356] "Generic (PLEG): container finished" podID="50eee24c-e844-4e5c-8074-61afefab61c3" containerID="89ecda199435d49fb0c939079ba03924d092aadf9b6663ff60f48c0ee623ac92" exitCode=0
Sep 10 21:04:25.391223 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:25.391147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l" event={"ID":"50eee24c-e844-4e5c-8074-61afefab61c3","Type":"ContainerDied","Data":"89ecda199435d49fb0c939079ba03924d092aadf9b6663ff60f48c0ee623ac92"}
Sep 10 21:04:26.397989 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.397949    2558 generic.go:356] "Generic (PLEG): container finished" podID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerID="111fecf832546cf2692e03006c308c3de0aec6ca9f0e80016483d77fa51430e0" exitCode=0
Sep 10 21:04:26.398450 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.398039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2" event={"ID":"4505fcb1-c515-4d8a-bd92-d9e877a1004c","Type":"ContainerDied","Data":"111fecf832546cf2692e03006c308c3de0aec6ca9f0e80016483d77fa51430e0"}
Sep 10 21:04:26.400178 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.400155    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerID="311bf32ec2286b085439d9e3d79e5714af82424ae8bab7b436a96ebc1e4d936c" exitCode=0
Sep 10 21:04:26.400294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.400204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f" event={"ID":"1f8aebac-8e50-445b-81fe-599cefb6a6b9","Type":"ContainerDied","Data":"311bf32ec2286b085439d9e3d79e5714af82424ae8bab7b436a96ebc1e4d936c"}
Sep 10 21:04:26.402292 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.402274    2558 generic.go:356] "Generic (PLEG): container finished" podID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerID="93b61857b9f10b8f097da6115fb608616634b7cd5e58f18a49ac6e4590db025d" exitCode=0
Sep 10 21:04:26.402367 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.402335    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm" event={"ID":"44124bbd-c695-4fe6-8bea-da9cc42614c7","Type":"ContainerDied","Data":"93b61857b9f10b8f097da6115fb608616634b7cd5e58f18a49ac6e4590db025d"}
Sep 10 21:04:26.404380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.404361    2558 generic.go:356] "Generic (PLEG): container finished" podID="50eee24c-e844-4e5c-8074-61afefab61c3" containerID="bbd0042b364a9ae3a1270f518db88ddc26fdef0bef1c0318e9fec58f8c63e67c" exitCode=0
Sep 10 21:04:26.404476 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:26.404407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l" event={"ID":"50eee24c-e844-4e5c-8074-61afefab61c3","Type":"ContainerDied","Data":"bbd0042b364a9ae3a1270f518db88ddc26fdef0bef1c0318e9fec58f8c63e67c"}
Sep 10 21:04:27.556165 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.556136    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:27.595243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.595212    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:27.609945 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.609916    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:27.618882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.618859    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:27.648255 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648224    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-util\") pod \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") "
Sep 10 21:04:27.648434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648263    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-bundle\") pod \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") "
Sep 10 21:04:27.648434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648315    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-bundle\") pod \"44124bbd-c695-4fe6-8bea-da9cc42614c7\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") "
Sep 10 21:04:27.648434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648358    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vr7v\" (UniqueName: \"kubernetes.io/projected/4505fcb1-c515-4d8a-bd92-d9e877a1004c-kube-api-access-4vr7v\") pod \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") "
Sep 10 21:04:27.648434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648384    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-util\") pod \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") "
Sep 10 21:04:27.648434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-util\") pod \"50eee24c-e844-4e5c-8074-61afefab61c3\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") "
Sep 10 21:04:27.648728 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648704    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q92j\" (UniqueName: \"kubernetes.io/projected/50eee24c-e844-4e5c-8074-61afefab61c3-kube-api-access-8q92j\") pod \"50eee24c-e844-4e5c-8074-61afefab61c3\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") "
Sep 10 21:04:27.648793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648768    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-bundle\") pod \"50eee24c-e844-4e5c-8074-61afefab61c3\" (UID: \"50eee24c-e844-4e5c-8074-61afefab61c3\") "
Sep 10 21:04:27.648853 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648796    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4tn4\" (UniqueName: \"kubernetes.io/projected/44124bbd-c695-4fe6-8bea-da9cc42614c7-kube-api-access-b4tn4\") pod \"44124bbd-c695-4fe6-8bea-da9cc42614c7\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") "
Sep 10 21:04:27.648853 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648843    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-bundle\") pod \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\" (UID: \"4505fcb1-c515-4d8a-bd92-d9e877a1004c\") "
Sep 10 21:04:27.648948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648871    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w8pv\" (UniqueName: \"kubernetes.io/projected/1f8aebac-8e50-445b-81fe-599cefb6a6b9-kube-api-access-4w8pv\") pod \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\" (UID: \"1f8aebac-8e50-445b-81fe-599cefb6a6b9\") "
Sep 10 21:04:27.648948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648910    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-util\") pod \"44124bbd-c695-4fe6-8bea-da9cc42614c7\" (UID: \"44124bbd-c695-4fe6-8bea-da9cc42614c7\") "
Sep 10 21:04:27.649075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.648980    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-bundle" (OuterVolumeSpecName: "bundle") pod "1f8aebac-8e50-445b-81fe-599cefb6a6b9" (UID: "1f8aebac-8e50-445b-81fe-599cefb6a6b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.649436 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.649402    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.649529 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.649460    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-bundle" (OuterVolumeSpecName: "bundle") pod "44124bbd-c695-4fe6-8bea-da9cc42614c7" (UID: "44124bbd-c695-4fe6-8bea-da9cc42614c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.649859 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.649839    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-bundle" (OuterVolumeSpecName: "bundle") pod "50eee24c-e844-4e5c-8074-61afefab61c3" (UID: "50eee24c-e844-4e5c-8074-61afefab61c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.650387 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.650349    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-bundle" (OuterVolumeSpecName: "bundle") pod "4505fcb1-c515-4d8a-bd92-d9e877a1004c" (UID: "4505fcb1-c515-4d8a-bd92-d9e877a1004c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.651464 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.651427    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4505fcb1-c515-4d8a-bd92-d9e877a1004c-kube-api-access-4vr7v" (OuterVolumeSpecName: "kube-api-access-4vr7v") pod "4505fcb1-c515-4d8a-bd92-d9e877a1004c" (UID: "4505fcb1-c515-4d8a-bd92-d9e877a1004c"). InnerVolumeSpecName "kube-api-access-4vr7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:27.651782 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.651751    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50eee24c-e844-4e5c-8074-61afefab61c3-kube-api-access-8q92j" (OuterVolumeSpecName: "kube-api-access-8q92j") pod "50eee24c-e844-4e5c-8074-61afefab61c3" (UID: "50eee24c-e844-4e5c-8074-61afefab61c3"). InnerVolumeSpecName "kube-api-access-8q92j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:27.651983 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.651958    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44124bbd-c695-4fe6-8bea-da9cc42614c7-kube-api-access-b4tn4" (OuterVolumeSpecName: "kube-api-access-b4tn4") pod "44124bbd-c695-4fe6-8bea-da9cc42614c7" (UID: "44124bbd-c695-4fe6-8bea-da9cc42614c7"). InnerVolumeSpecName "kube-api-access-b4tn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:27.652957 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.652932    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8aebac-8e50-445b-81fe-599cefb6a6b9-kube-api-access-4w8pv" (OuterVolumeSpecName: "kube-api-access-4w8pv") pod "1f8aebac-8e50-445b-81fe-599cefb6a6b9" (UID: "1f8aebac-8e50-445b-81fe-599cefb6a6b9"). InnerVolumeSpecName "kube-api-access-4w8pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:27.655968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.655938    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-util" (OuterVolumeSpecName: "util") pod "50eee24c-e844-4e5c-8074-61afefab61c3" (UID: "50eee24c-e844-4e5c-8074-61afefab61c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.656576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.656528    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-util" (OuterVolumeSpecName: "util") pod "1f8aebac-8e50-445b-81fe-599cefb6a6b9" (UID: "1f8aebac-8e50-445b-81fe-599cefb6a6b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.658110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.658088    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-util" (OuterVolumeSpecName: "util") pod "4505fcb1-c515-4d8a-bd92-d9e877a1004c" (UID: "4505fcb1-c515-4d8a-bd92-d9e877a1004c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.658802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.658786    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-util" (OuterVolumeSpecName: "util") pod "44124bbd-c695-4fe6-8bea-da9cc42614c7" (UID: "44124bbd-c695-4fe6-8bea-da9cc42614c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:27.750576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750477    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750515    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q92j\" (UniqueName: \"kubernetes.io/projected/50eee24c-e844-4e5c-8074-61afefab61c3-kube-api-access-8q92j\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750529    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50eee24c-e844-4e5c-8074-61afefab61c3-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750542    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4tn4\" (UniqueName: \"kubernetes.io/projected/44124bbd-c695-4fe6-8bea-da9cc42614c7-kube-api-access-b4tn4\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750553    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750564    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w8pv\" (UniqueName: \"kubernetes.io/projected/1f8aebac-8e50-445b-81fe-599cefb6a6b9-kube-api-access-4w8pv\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750576    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750588    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4505fcb1-c515-4d8a-bd92-d9e877a1004c-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750598    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44124bbd-c695-4fe6-8bea-da9cc42614c7-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750608    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vr7v\" (UniqueName: \"kubernetes.io/projected/4505fcb1-c515-4d8a-bd92-d9e877a1004c-kube-api-access-4vr7v\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:27.750948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:27.750620    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f8aebac-8e50-445b-81fe-599cefb6a6b9-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:28.415851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.415819    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2"
Sep 10 21:04:28.415851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.415833    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kxtj2" event={"ID":"4505fcb1-c515-4d8a-bd92-d9e877a1004c","Type":"ContainerDied","Data":"d54d7b3dee5c663abd9c20bae5cd03120f6d02e117f8c0262260bf48452c34da"}
Sep 10 21:04:28.416106 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.415883    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d54d7b3dee5c663abd9c20bae5cd03120f6d02e117f8c0262260bf48452c34da"
Sep 10 21:04:28.417832 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.417809    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f"
Sep 10 21:04:28.417832 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.417818    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpxf2f" event={"ID":"1f8aebac-8e50-445b-81fe-599cefb6a6b9","Type":"ContainerDied","Data":"51ffd9717921e329dca1ee8b2c2413699dbf5472b00c29b6a3b4152243997f98"}
Sep 10 21:04:28.418022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.417863    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51ffd9717921e329dca1ee8b2c2413699dbf5472b00c29b6a3b4152243997f98"
Sep 10 21:04:28.419791 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.419767    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm" event={"ID":"44124bbd-c695-4fe6-8bea-da9cc42614c7","Type":"ContainerDied","Data":"3adcd3ba5d67ab6e522dee30ef6e62c47020157ab98f4829780f312764f2a4ee"}
Sep 10 21:04:28.419878 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.419791    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahcrbm"
Sep 10 21:04:28.419878 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.419800    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3adcd3ba5d67ab6e522dee30ef6e62c47020157ab98f4829780f312764f2a4ee"
Sep 10 21:04:28.421871 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.421849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l" event={"ID":"50eee24c-e844-4e5c-8074-61afefab61c3","Type":"ContainerDied","Data":"22625827063e69ba9d734dfba6b70f739db1a1e307e358da8884319f8765a845"}
Sep 10 21:04:28.421964 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.421887    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22625827063e69ba9d734dfba6b70f739db1a1e307e358da8884319f8765a845"
Sep 10 21:04:28.421964 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:28.421857    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64lq8l"
Sep 10 21:04:29.506780 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:29.506737    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:29.507278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:29.506840    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:29.511673 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:29.511650    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:30.436184 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:30.436158    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d96576c45-zrxmk"
Sep 10 21:04:30.620303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:30.620270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:30.748362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:30.748314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:31.984698 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:31.984658    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:32.777427 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:32.777389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:33.617680 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:33.617643    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:34.769393 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:34.769357    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:34.869073 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:34.869018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:36.499331 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499290    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"]
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499723    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerName="extract"
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499742    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerName="extract"
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499762    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerName="util"
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499770    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerName="util"
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499779    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50eee24c-e844-4e5c-8074-61afefab61c3" containerName="pull"
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499787    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="50eee24c-e844-4e5c-8074-61afefab61c3" containerName="pull"
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499796    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerName="pull"
Sep 10 21:04:36.499814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499803    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerName="pull"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499820    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499828    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499837    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50eee24c-e844-4e5c-8074-61afefab61c3" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="50eee24c-e844-4e5c-8074-61afefab61c3" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499862    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerName="util"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499870    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerName="util"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499881    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerName="pull"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499889    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerName="pull"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499899    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerName="pull"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499907    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerName="pull"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499921    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50eee24c-e844-4e5c-8074-61afefab61c3" containerName="util"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499929    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="50eee24c-e844-4e5c-8074-61afefab61c3" containerName="util"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499941    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerName="util"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499951    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerName="util"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499963    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.499971    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.500083    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4505fcb1-c515-4d8a-bd92-d9e877a1004c" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.500098    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8aebac-8e50-445b-81fe-599cefb6a6b9" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.500107    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="50eee24c-e844-4e5c-8074-61afefab61c3" containerName="extract"
Sep 10 21:04:36.500238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.500119    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="44124bbd-c695-4fe6-8bea-da9cc42614c7" containerName="extract"
Sep 10 21:04:36.504584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.504563    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.507297 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.507272    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 21:04:36.507474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.507467    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 21:04:36.507546 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.507506    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nrtth\""
Sep 10 21:04:36.511452 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.511388    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:36.521669 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.521644    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"]
Sep 10 21:04:36.625950 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.625916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:36.626128 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.625991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/255a26c0-8983-4aab-be70-f323355dccc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.626128 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.626040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6j9g\" (UniqueName: \"kubernetes.io/projected/255a26c0-8983-4aab-be70-f323355dccc6-kube-api-access-t6j9g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.726767 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.726726    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6j9g\" (UniqueName: \"kubernetes.io/projected/255a26c0-8983-4aab-be70-f323355dccc6-kube-api-access-t6j9g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.726916 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.726805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/255a26c0-8983-4aab-be70-f323355dccc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.727181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.727163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/255a26c0-8983-4aab-be70-f323355dccc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.740816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.740794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6j9g\" (UniqueName: \"kubernetes.io/projected/255a26c0-8983-4aab-be70-f323355dccc6-kube-api-access-t6j9g\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.815254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.815218    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:36.998691 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:36.998652    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:37.096748 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:37.096710    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"]
Sep 10 21:04:37.099005 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:37.098983    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255a26c0_8983_4aab_be70_f323355dccc6.slice/crio-bc02fa7bd5527bc5bbe830bad51c759c893323a9dedb2570bdd6785282610232 WatchSource:0}: Error finding container bc02fa7bd5527bc5bbe830bad51c759c893323a9dedb2570bdd6785282610232: Status 404 returned error can't find the container with id bc02fa7bd5527bc5bbe830bad51c759c893323a9dedb2570bdd6785282610232
Sep 10 21:04:37.469202 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:37.469111    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8" event={"ID":"255a26c0-8983-4aab-be70-f323355dccc6","Type":"ContainerStarted","Data":"bc02fa7bd5527bc5bbe830bad51c759c893323a9dedb2570bdd6785282610232"}
Sep 10 21:04:38.432510 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.432338    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"]
Sep 10 21:04:38.436019 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.435992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:38.438847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.438650    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5h9lr\""
Sep 10 21:04:38.453400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.453366    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"]
Sep 10 21:04:38.544085 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.544006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr9xs\" (UniqueName: \"kubernetes.io/projected/4e4e639a-e78b-401e-a100-23aa003acab2-kube-api-access-lr9xs\") pod \"limitador-operator-controller-manager-74495c69f8-qvqnm\" (UID: \"4e4e639a-e78b-401e-a100-23aa003acab2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:38.645456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.645413    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr9xs\" (UniqueName: \"kubernetes.io/projected/4e4e639a-e78b-401e-a100-23aa003acab2-kube-api-access-lr9xs\") pod \"limitador-operator-controller-manager-74495c69f8-qvqnm\" (UID: \"4e4e639a-e78b-401e-a100-23aa003acab2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:38.655482 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.655451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr9xs\" (UniqueName: \"kubernetes.io/projected/4e4e639a-e78b-401e-a100-23aa003acab2-kube-api-access-lr9xs\") pod \"limitador-operator-controller-manager-74495c69f8-qvqnm\" (UID: \"4e4e639a-e78b-401e-a100-23aa003acab2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:38.751369 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:38.751295    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:39.051474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:39.051281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:39.052579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:39.052553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"]
Sep 10 21:04:39.155584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:39.155545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:39.655717 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:39.655682    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4e639a_e78b_401e_a100_23aa003acab2.slice/crio-1eebb7570de66e634a0325cb0c1fff3181fed443ea32f28d373fdf6f63401135 WatchSource:0}: Error finding container 1eebb7570de66e634a0325cb0c1fff3181fed443ea32f28d373fdf6f63401135: Status 404 returned error can't find the container with id 1eebb7570de66e634a0325cb0c1fff3181fed443ea32f28d373fdf6f63401135
Sep 10 21:04:40.219581 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.219539    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:40.491393 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.491307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm" event={"ID":"4e4e639a-e78b-401e-a100-23aa003acab2","Type":"ContainerStarted","Data":"1eebb7570de66e634a0325cb0c1fff3181fed443ea32f28d373fdf6f63401135"}
Sep 10 21:04:40.602661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.602623    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"]
Sep 10 21:04:40.606502 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.606476    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"
Sep 10 21:04:40.608916 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.608887    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 21:04:40.609019 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.608924    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rv7dv\""
Sep 10 21:04:40.626951 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.626906    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"]
Sep 10 21:04:40.664293 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.664259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9wgg\" (UniqueName: \"kubernetes.io/projected/e659077c-8270-4f2a-9652-a255985070c6-kube-api-access-h9wgg\") pod \"dns-operator-controller-manager-7b84cd7c9c-x5g5h\" (UID: \"e659077c-8270-4f2a-9652-a255985070c6\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"
Sep 10 21:04:40.765629 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.765536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9wgg\" (UniqueName: \"kubernetes.io/projected/e659077c-8270-4f2a-9652-a255985070c6-kube-api-access-h9wgg\") pod \"dns-operator-controller-manager-7b84cd7c9c-x5g5h\" (UID: \"e659077c-8270-4f2a-9652-a255985070c6\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"
Sep 10 21:04:40.776762 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.776732    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9wgg\" (UniqueName: \"kubernetes.io/projected/e659077c-8270-4f2a-9652-a255985070c6-kube-api-access-h9wgg\") pod \"dns-operator-controller-manager-7b84cd7c9c-x5g5h\" (UID: \"e659077c-8270-4f2a-9652-a255985070c6\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"
Sep 10 21:04:40.918797 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.918759    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"
Sep 10 21:04:40.993705 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:40.993669    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:41.382325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:41.382291    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:41.403139 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:41.403101    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"]
Sep 10 21:04:41.404533 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:41.404501    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode659077c_8270_4f2a_9652_a255985070c6.slice/crio-134308542e09d30b2bd4dc5b31f7c3c9aafba74002f81a48780cfb44eda306a6 WatchSource:0}: Error finding container 134308542e09d30b2bd4dc5b31f7c3c9aafba74002f81a48780cfb44eda306a6: Status 404 returned error can't find the container with id 134308542e09d30b2bd4dc5b31f7c3c9aafba74002f81a48780cfb44eda306a6
Sep 10 21:04:41.499200 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:41.499164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h" event={"ID":"e659077c-8270-4f2a-9652-a255985070c6","Type":"ContainerStarted","Data":"134308542e09d30b2bd4dc5b31f7c3c9aafba74002f81a48780cfb44eda306a6"}
Sep 10 21:04:41.501280 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:41.501251    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8" event={"ID":"255a26c0-8983-4aab-be70-f323355dccc6","Type":"ContainerStarted","Data":"f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041"}
Sep 10 21:04:41.501410 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:41.501364    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:41.532558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:41.532487    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8" podStartSLOduration=1.426166451 podStartE2EDuration="5.532467302s" totalImagesPullingTime="4.106300851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:41.53126368 +0000 UTC m=+410.442543482" watchObservedRunningTime="2026-09-10 21:04:41.532467302 +0000 UTC m=+410.443747084"
Sep 10 21:04:42.418286 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:42.418251    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:42.509376 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:42.509337    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm" event={"ID":"4e4e639a-e78b-401e-a100-23aa003acab2","Type":"ContainerStarted","Data":"6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb"}
Sep 10 21:04:42.509564 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:42.509423    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:42.533646 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:42.533593    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm" podStartSLOduration=2.226118235 podStartE2EDuration="4.533575889s" totalImagesPullingTime="2.307457654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:42.531642112 +0000 UTC m=+411.442921917" watchObservedRunningTime="2026-09-10 21:04:42.533575889 +0000 UTC m=+411.444855670"
Sep 10 21:04:43.502070 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.502015    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-h26rn"]
Sep 10 21:04:43.505431 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.505411    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-h26rn"
Sep 10 21:04:43.507761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.507737    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cg7lm\""
Sep 10 21:04:43.516103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.516076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h" event={"ID":"e659077c-8270-4f2a-9652-a255985070c6","Type":"ContainerStarted","Data":"f97a432bfe0f04327ac40e42158dc7b689c37ea090753e61d5a73bec9709751a"}
Sep 10 21:04:43.516250 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.516233    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"
Sep 10 21:04:43.526410 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.526389    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-h26rn"]
Sep 10 21:04:43.557651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.557586    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h" podStartSLOduration=2.052920304 podStartE2EDuration="3.557553348s" totalImagesPullingTime="1.504633044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:43.556940949 +0000 UTC m=+412.468220755" watchObservedRunningTime="2026-09-10 21:04:43.557553348 +0000 UTC m=+412.468833130"
Sep 10 21:04:43.589384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.589342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6tjz\" (UniqueName: \"kubernetes.io/projected/9a5ee140-5233-4c96-b8ee-c9b6905eb214-kube-api-access-d6tjz\") pod \"authorino-operator-76b478bd78-h26rn\" (UID: \"9a5ee140-5233-4c96-b8ee-c9b6905eb214\") " pod="kuadrant-system/authorino-operator-76b478bd78-h26rn"
Sep 10 21:04:43.690309 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.690272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6tjz\" (UniqueName: \"kubernetes.io/projected/9a5ee140-5233-4c96-b8ee-c9b6905eb214-kube-api-access-d6tjz\") pod \"authorino-operator-76b478bd78-h26rn\" (UID: \"9a5ee140-5233-4c96-b8ee-c9b6905eb214\") " pod="kuadrant-system/authorino-operator-76b478bd78-h26rn"
Sep 10 21:04:43.700881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.700850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6tjz\" (UniqueName: \"kubernetes.io/projected/9a5ee140-5233-4c96-b8ee-c9b6905eb214-kube-api-access-d6tjz\") pod \"authorino-operator-76b478bd78-h26rn\" (UID: \"9a5ee140-5233-4c96-b8ee-c9b6905eb214\") " pod="kuadrant-system/authorino-operator-76b478bd78-h26rn"
Sep 10 21:04:43.816014 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:43.815980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-h26rn"
Sep 10 21:04:44.091452 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:44.091422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-h26rn"]
Sep 10 21:04:44.093110 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:44.093086    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5ee140_5233_4c96_b8ee_c9b6905eb214.slice/crio-4d6c647180491652604f33fffccf7658dad023eedd70b494db36c1997333ecac WatchSource:0}: Error finding container 4d6c647180491652604f33fffccf7658dad023eedd70b494db36c1997333ecac: Status 404 returned error can't find the container with id 4d6c647180491652604f33fffccf7658dad023eedd70b494db36c1997333ecac
Sep 10 21:04:44.202304 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:44.202269    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:44.301981 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:44.301934    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:44.522652 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:44.522563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-h26rn" event={"ID":"9a5ee140-5233-4c96-b8ee-c9b6905eb214","Type":"ContainerStarted","Data":"4d6c647180491652604f33fffccf7658dad023eedd70b494db36c1997333ecac"}
Sep 10 21:04:45.529556 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:45.529523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-h26rn" event={"ID":"9a5ee140-5233-4c96-b8ee-c9b6905eb214","Type":"ContainerStarted","Data":"824e1b7cec88d4fabc1195a513881e997d67d7bf3b44f5fcd4ce8bf5f3ed3ba1"}
Sep 10 21:04:45.529922 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:45.529612    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-h26rn"
Sep 10 21:04:45.550699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:45.550652    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-h26rn" podStartSLOduration=1.271409829 podStartE2EDuration="2.550636478s" totalImagesPullingTime="1.279226649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:45.548470996 +0000 UTC m=+414.459750777" watchObservedRunningTime="2026-09-10 21:04:45.550636478 +0000 UTC m=+414.461916259"
Sep 10 21:04:46.994460 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:46.994417    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:47.078757 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:47.078721    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:47.380108 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:47.380074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:47.459536 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:47.459502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:47.802339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:47.802298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:47.883183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:47.883145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:52.511695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:52.511666    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:53.519094 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:53.519060    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:54.023313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.023255    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:54.135967 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.135927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:54.525474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.525442    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x5g5h"
Sep 10 21:04:54.732982 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.732946    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"]
Sep 10 21:04:54.733179 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.733159    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8" podUID="255a26c0-8983-4aab-be70-f323355dccc6" containerName="manager" containerID="cri-o://f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041" gracePeriod=2
Sep 10 21:04:54.742352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.742325    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"]
Sep 10 21:04:54.756085 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.756040    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"]
Sep 10 21:04:54.756272 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.756253    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" containerName="manager" containerID="cri-o://6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb" gracePeriod=2
Sep 10 21:04:54.758164 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:54.758131    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="255a26c0-8983-4aab-be70-f323355dccc6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:54.759291 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.759262    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"]
Sep 10 21:04:54.759768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.759746    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255a26c0-8983-4aab-be70-f323355dccc6" containerName="manager"
Sep 10 21:04:54.759768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.759768    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="255a26c0-8983-4aab-be70-f323355dccc6" containerName="manager"
Sep 10 21:04:54.759898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.759845    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="255a26c0-8983-4aab-be70-f323355dccc6" containerName="manager"
Sep 10 21:04:54.763217 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.763202    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:54.766295 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.766262    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"]
Sep 10 21:04:54.769903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.769880    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:54.771806 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.771781    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"]
Sep 10 21:04:54.780209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.780148    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"]
Sep 10 21:04:54.787879 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:54.787840    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4e4e639a-e78b-401e-a100-23aa003acab2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-qvqnm\": pods \"limitador-operator-controller-manager-74495c69f8-qvqnm\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:54.791368 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.791336    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"]
Sep 10 21:04:54.794559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.794538    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"]
Sep 10 21:04:54.794912 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.794869    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" containerName="manager"
Sep 10 21:04:54.794912 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.794889    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" containerName="manager"
Sep 10 21:04:54.795066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.794980    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" containerName="manager"
Sep 10 21:04:54.798206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.798191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"
Sep 10 21:04:54.810455 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.810433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"]
Sep 10 21:04:54.844133 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:54.844097    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="255a26c0-8983-4aab-be70-f323355dccc6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:54.845992 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:54.845961    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-qvqnm\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:54.847714 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:54.847689    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="255a26c0-8983-4aab-be70-f323355dccc6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:54.875213 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:54.875144    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-qvqnm\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:54.882358 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.882329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thxzd\" (UniqueName: \"kubernetes.io/projected/64895201-d3a3-4db8-8740-9ee6a2312c2e-kube-api-access-thxzd\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7f4x4\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:54.882472 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.882366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64895201-d3a3-4db8-8740-9ee6a2312c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7f4x4\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:54.882472 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.882446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwppr\" (UniqueName: \"kubernetes.io/projected/113dcc13-0869-40fc-bb8a-ace6041594ab-kube-api-access-nwppr\") pod \"limitador-operator-controller-manager-74495c69f8-sqvr6\" (UID: \"113dcc13-0869-40fc-bb8a-ace6041594ab\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"
Sep 10 21:04:54.882582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.882494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20ba6f88-e554-4610-b20e-cd1c238da802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sf2j9\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:54.882582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.882526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkx7h\" (UniqueName: \"kubernetes.io/projected/20ba6f88-e554-4610-b20e-cd1c238da802-kube-api-access-bkx7h\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sf2j9\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:54.982964 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.982930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwppr\" (UniqueName: \"kubernetes.io/projected/113dcc13-0869-40fc-bb8a-ace6041594ab-kube-api-access-nwppr\") pod \"limitador-operator-controller-manager-74495c69f8-sqvr6\" (UID: \"113dcc13-0869-40fc-bb8a-ace6041594ab\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"
Sep 10 21:04:54.983096 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.982981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20ba6f88-e554-4610-b20e-cd1c238da802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sf2j9\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:54.983096 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.983012    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkx7h\" (UniqueName: \"kubernetes.io/projected/20ba6f88-e554-4610-b20e-cd1c238da802-kube-api-access-bkx7h\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sf2j9\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:54.983096 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.983082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thxzd\" (UniqueName: \"kubernetes.io/projected/64895201-d3a3-4db8-8740-9ee6a2312c2e-kube-api-access-thxzd\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7f4x4\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:54.983259 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.983117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64895201-d3a3-4db8-8740-9ee6a2312c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7f4x4\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:54.983448 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.983419    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20ba6f88-e554-4610-b20e-cd1c238da802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sf2j9\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:54.983567 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.983548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64895201-d3a3-4db8-8740-9ee6a2312c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7f4x4\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:54.995873 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.995848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwppr\" (UniqueName: \"kubernetes.io/projected/113dcc13-0869-40fc-bb8a-ace6041594ab-kube-api-access-nwppr\") pod \"limitador-operator-controller-manager-74495c69f8-sqvr6\" (UID: \"113dcc13-0869-40fc-bb8a-ace6041594ab\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"
Sep 10 21:04:54.995873 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.995871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thxzd\" (UniqueName: \"kubernetes.io/projected/64895201-d3a3-4db8-8740-9ee6a2312c2e-kube-api-access-thxzd\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7f4x4\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:54.996025 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.995998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkx7h\" (UniqueName: \"kubernetes.io/projected/20ba6f88-e554-4610-b20e-cd1c238da802-kube-api-access-bkx7h\") pod \"kuadrant-operator-controller-manager-76f8f686bf-sf2j9\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:54.997809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:54.997792    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:54.999845 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:54.999819    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-qvqnm\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:55.001543 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:55.001519    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="255a26c0-8983-4aab-be70-f323355dccc6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:55.008086 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.008069    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:55.010132 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:55.010103    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="255a26c0-8983-4aab-be70-f323355dccc6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:55.011969 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:55.011948    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-qvqnm\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:55.084451 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.084421    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/255a26c0-8983-4aab-be70-f323355dccc6-extensions-socket-volume\") pod \"255a26c0-8983-4aab-be70-f323355dccc6\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") "
Sep 10 21:04:55.084583 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.084466    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6j9g\" (UniqueName: \"kubernetes.io/projected/255a26c0-8983-4aab-be70-f323355dccc6-kube-api-access-t6j9g\") pod \"255a26c0-8983-4aab-be70-f323355dccc6\" (UID: \"255a26c0-8983-4aab-be70-f323355dccc6\") "
Sep 10 21:04:55.084583 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.084500    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr9xs\" (UniqueName: \"kubernetes.io/projected/4e4e639a-e78b-401e-a100-23aa003acab2-kube-api-access-lr9xs\") pod \"4e4e639a-e78b-401e-a100-23aa003acab2\" (UID: \"4e4e639a-e78b-401e-a100-23aa003acab2\") "
Sep 10 21:04:55.084888 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.084852    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255a26c0-8983-4aab-be70-f323355dccc6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "255a26c0-8983-4aab-be70-f323355dccc6" (UID: "255a26c0-8983-4aab-be70-f323355dccc6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:55.086724 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.086700    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4e639a-e78b-401e-a100-23aa003acab2-kube-api-access-lr9xs" (OuterVolumeSpecName: "kube-api-access-lr9xs") pod "4e4e639a-e78b-401e-a100-23aa003acab2" (UID: "4e4e639a-e78b-401e-a100-23aa003acab2"). InnerVolumeSpecName "kube-api-access-lr9xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:55.086724 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.086717    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255a26c0-8983-4aab-be70-f323355dccc6-kube-api-access-t6j9g" (OuterVolumeSpecName: "kube-api-access-t6j9g") pod "255a26c0-8983-4aab-be70-f323355dccc6" (UID: "255a26c0-8983-4aab-be70-f323355dccc6"). InnerVolumeSpecName "kube-api-access-t6j9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:55.169606 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.169568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:55.177697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.177669    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:55.185270 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.185247    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"
Sep 10 21:04:55.185508 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.185488    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/255a26c0-8983-4aab-be70-f323355dccc6-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:55.185574 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.185515    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6j9g\" (UniqueName: \"kubernetes.io/projected/255a26c0-8983-4aab-be70-f323355dccc6-kube-api-access-t6j9g\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:55.185574 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.185527    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr9xs\" (UniqueName: \"kubernetes.io/projected/4e4e639a-e78b-401e-a100-23aa003acab2-kube-api-access-lr9xs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:55.468348 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.468317    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"]
Sep 10 21:04:55.468801 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:55.468775    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ba6f88_e554_4610_b20e_cd1c238da802.slice/crio-761840cb65b1c0731dd8c3826030df17e77d0f58d258a106bf459f48eb44565b WatchSource:0}: Error finding container 761840cb65b1c0731dd8c3826030df17e77d0f58d258a106bf459f48eb44565b: Status 404 returned error can't find the container with id 761840cb65b1c0731dd8c3826030df17e77d0f58d258a106bf459f48eb44565b
Sep 10 21:04:55.493642 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.493616    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"]
Sep 10 21:04:55.496021 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.495996    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"]
Sep 10 21:04:55.496268 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:55.496249    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113dcc13_0869_40fc_bb8a_ace6041594ab.slice/crio-76ca37f798a4b323aa16b9b98c674681a74e868beddcf8da33b38f774bbc00df WatchSource:0}: Error finding container 76ca37f798a4b323aa16b9b98c674681a74e868beddcf8da33b38f774bbc00df: Status 404 returned error can't find the container with id 76ca37f798a4b323aa16b9b98c674681a74e868beddcf8da33b38f774bbc00df
Sep 10 21:04:55.496889 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:04:55.496870    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64895201_d3a3_4db8_8740_9ee6a2312c2e.slice/crio-086a14bfdb9b024d3db5b1f751bcfd0733c1b652f8687e079ab952281b9490b4 WatchSource:0}: Error finding container 086a14bfdb9b024d3db5b1f751bcfd0733c1b652f8687e079ab952281b9490b4: Status 404 returned error can't find the container with id 086a14bfdb9b024d3db5b1f751bcfd0733c1b652f8687e079ab952281b9490b4
Sep 10 21:04:55.588073 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.588008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4" event={"ID":"64895201-d3a3-4db8-8740-9ee6a2312c2e","Type":"ContainerStarted","Data":"295d089d92d12edd530836b537a4e1c02945fc86c9f8b943f3a800a58d316884"}
Sep 10 21:04:55.588603 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.588085    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4" event={"ID":"64895201-d3a3-4db8-8740-9ee6a2312c2e","Type":"ContainerStarted","Data":"086a14bfdb9b024d3db5b1f751bcfd0733c1b652f8687e079ab952281b9490b4"}
Sep 10 21:04:55.588603 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.588114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:04:55.589814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.589786    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9" event={"ID":"20ba6f88-e554-4610-b20e-cd1c238da802","Type":"ContainerStarted","Data":"893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32"}
Sep 10 21:04:55.589959 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.589841    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:04:55.589959 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.589866    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9" event={"ID":"20ba6f88-e554-4610-b20e-cd1c238da802","Type":"ContainerStarted","Data":"761840cb65b1c0731dd8c3826030df17e77d0f58d258a106bf459f48eb44565b"}
Sep 10 21:04:55.591027 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:55.591003    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mz8j8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="255a26c0-8983-4aab-be70-f323355dccc6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:55.591509 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.591489    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6" event={"ID":"113dcc13-0869-40fc-bb8a-ace6041594ab","Type":"ContainerStarted","Data":"c361f516b9c16841a498c778a71bc821651774a3cae0fd2444ad5a10834be809"}
Sep 10 21:04:55.591617 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.591531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6" event={"ID":"113dcc13-0869-40fc-bb8a-ace6041594ab","Type":"ContainerStarted","Data":"76ca37f798a4b323aa16b9b98c674681a74e868beddcf8da33b38f774bbc00df"}
Sep 10 21:04:55.591617 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.591580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"
Sep 10 21:04:55.592798 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.592775    2558 generic.go:356] "Generic (PLEG): container finished" podID="255a26c0-8983-4aab-be70-f323355dccc6" containerID="f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041" exitCode=0
Sep 10 21:04:55.592875 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.592811    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mz8j8"
Sep 10 21:04:55.592927 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.592874    2558 scope.go:117] "RemoveContainer" containerID="f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041"
Sep 10 21:04:55.593384 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:55.593358    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-qvqnm\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:55.600929 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.600901    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e4e639a-e78b-401e-a100-23aa003acab2" containerID="6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb" exitCode=0
Sep 10 21:04:55.601006 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.600969    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-qvqnm"
Sep 10 21:04:55.608650 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.608618    2558 scope.go:117] "RemoveContainer" containerID="f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041"
Sep 10 21:04:55.608933 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:55.608909    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041\": container with ID starting with f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041 not found: ID does not exist" containerID="f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041"
Sep 10 21:04:55.609006 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.608941    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041"} err="failed to get container status \"f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041\": rpc error: code = NotFound desc = could not find container \"f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041\": container with ID starting with f7dec125819d79c6c7a19a3c58098d83dbd5445fd705f7d8548a124a56037041 not found: ID does not exist"
Sep 10 21:04:55.609006 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.608960    2558 scope.go:117] "RemoveContainer" containerID="6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb"
Sep 10 21:04:55.615232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.615211    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255a26c0-8983-4aab-be70-f323355dccc6" path="/var/lib/kubelet/pods/255a26c0-8983-4aab-be70-f323355dccc6/volumes"
Sep 10 21:04:55.615517 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.615505    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e4e639a-e78b-401e-a100-23aa003acab2" path="/var/lib/kubelet/pods/4e4e639a-e78b-401e-a100-23aa003acab2/volumes"
Sep 10 21:04:55.617236 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.617219    2558 scope.go:117] "RemoveContainer" containerID="6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb"
Sep 10 21:04:55.617518 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:04:55.617500    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb\": container with ID starting with 6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb not found: ID does not exist" containerID="6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb"
Sep 10 21:04:55.617518 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.617523    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb"} err="failed to get container status \"6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb\": rpc error: code = NotFound desc = could not find container \"6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb\": container with ID starting with 6b59612f24403434d1747740c1cbb3627405311ef7a5aeb0d5e691bc238d98eb not found: ID does not exist"
Sep 10 21:04:55.629151 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.629108    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4" podStartSLOduration=1.629095633 podStartE2EDuration="1.629095633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:55.626968667 +0000 UTC m=+424.538248470" watchObservedRunningTime="2026-09-10 21:04:55.629095633 +0000 UTC m=+424.540375414"
Sep 10 21:04:55.657149 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.657089    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9" podStartSLOduration=1.6570748069999999 podStartE2EDuration="1.657074807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:55.655926799 +0000 UTC m=+424.567206592" watchObservedRunningTime="2026-09-10 21:04:55.657074807 +0000 UTC m=+424.568354590"
Sep 10 21:04:55.678438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:55.678378    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6" podStartSLOduration=1.6783580059999998 podStartE2EDuration="1.678358006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:55.675926297 +0000 UTC m=+424.587206079" watchObservedRunningTime="2026-09-10 21:04:55.678358006 +0000 UTC m=+424.589637787"
Sep 10 21:04:56.537546 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:56.537515    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-h26rn"
Sep 10 21:04:56.617747 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:56.617719    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:57.041000 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:04:57.040961    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:03.046603 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:03.046564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:03.143474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:03.143437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:03.260972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:03.260943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:04.057948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:04.057914    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:06.611820 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:06.611791    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:05:06.612233 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:06.611856    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-sqvr6"
Sep 10 21:05:06.612233 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:06.611891    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:05:06.758391 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:06.758356    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"]
Sep 10 21:05:06.758692 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:06.758660    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9" podUID="20ba6f88-e554-4610-b20e-cd1c238da802" containerName="manager" containerID="cri-o://893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32" gracePeriod=10
Sep 10 21:05:07.004199 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.004168    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:05:07.088252 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.088223    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20ba6f88-e554-4610-b20e-cd1c238da802-extensions-socket-volume\") pod \"20ba6f88-e554-4610-b20e-cd1c238da802\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") "
Sep 10 21:05:07.088425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.088261    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkx7h\" (UniqueName: \"kubernetes.io/projected/20ba6f88-e554-4610-b20e-cd1c238da802-kube-api-access-bkx7h\") pod \"20ba6f88-e554-4610-b20e-cd1c238da802\" (UID: \"20ba6f88-e554-4610-b20e-cd1c238da802\") "
Sep 10 21:05:07.088596 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.088566    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ba6f88-e554-4610-b20e-cd1c238da802-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20ba6f88-e554-4610-b20e-cd1c238da802" (UID: "20ba6f88-e554-4610-b20e-cd1c238da802"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:07.090302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.090282    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ba6f88-e554-4610-b20e-cd1c238da802-kube-api-access-bkx7h" (OuterVolumeSpecName: "kube-api-access-bkx7h") pod "20ba6f88-e554-4610-b20e-cd1c238da802" (UID: "20ba6f88-e554-4610-b20e-cd1c238da802"). InnerVolumeSpecName "kube-api-access-bkx7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:07.189817 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.189724    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20ba6f88-e554-4610-b20e-cd1c238da802-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:07.189817 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.189756    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkx7h\" (UniqueName: \"kubernetes.io/projected/20ba6f88-e554-4610-b20e-cd1c238da802-kube-api-access-bkx7h\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:07.668214 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.668183    2558 generic.go:356] "Generic (PLEG): container finished" podID="20ba6f88-e554-4610-b20e-cd1c238da802" containerID="893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32" exitCode=0
Sep 10 21:05:07.668768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.668228    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"
Sep 10 21:05:07.668768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.668250    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9" event={"ID":"20ba6f88-e554-4610-b20e-cd1c238da802","Type":"ContainerDied","Data":"893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32"}
Sep 10 21:05:07.668768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.668289    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9" event={"ID":"20ba6f88-e554-4610-b20e-cd1c238da802","Type":"ContainerDied","Data":"761840cb65b1c0731dd8c3826030df17e77d0f58d258a106bf459f48eb44565b"}
Sep 10 21:05:07.668768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.668309    2558 scope.go:117] "RemoveContainer" containerID="893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32"
Sep 10 21:05:07.676923 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.676896    2558 scope.go:117] "RemoveContainer" containerID="893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32"
Sep 10 21:05:07.677210 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:05:07.677190    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32\": container with ID starting with 893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32 not found: ID does not exist" containerID="893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32"
Sep 10 21:05:07.677273 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.677220    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32"} err="failed to get container status \"893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32\": rpc error: code = NotFound desc = could not find container \"893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32\": container with ID starting with 893744351abff2c1b88bcfe35771344d352c20cc30b6f9f7cd29146ffee46a32 not found: ID does not exist"
Sep 10 21:05:07.690441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.690416    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"]
Sep 10 21:05:07.695799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:07.695762    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-sf2j9"]
Sep 10 21:05:08.505257 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:08.505228    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:08.641638 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:08.641604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:08.798124 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:08.798087    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:08.933029 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:08.932994    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:09.052621 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:09.052531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:09.615005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:09.614975    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ba6f88-e554-4610-b20e-cd1c238da802" path="/var/lib/kubelet/pods/20ba6f88-e554-4610-b20e-cd1c238da802/volumes"
Sep 10 21:05:15.452849 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:15.452764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:15.590302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:15.590272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:17.948481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:17.948444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:18.069000 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:18.068955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:23.107331 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.107296    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"]
Sep 10 21:05:23.107682 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.107659    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ba6f88-e554-4610-b20e-cd1c238da802" containerName="manager"
Sep 10 21:05:23.107682 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.107672    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ba6f88-e554-4610-b20e-cd1c238da802" containerName="manager"
Sep 10 21:05:23.107754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.107722    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ba6f88-e554-4610-b20e-cd1c238da802" containerName="manager"
Sep 10 21:05:23.112177 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112148    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.112721 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18f009-8376-4cff-9382-d06e4e6c47ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.112816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.112859 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.112896 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.112896 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.112965 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjqkz\" (UniqueName: \"kubernetes.io/projected/ea18f009-8376-4cff-9382-d06e4e6c47ca-kube-api-access-qjqkz\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.112965 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.113029 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.112994    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.113029 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.113011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.114492 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.114467    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:05:23.114603 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.114469    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-br6pl\""
Sep 10 21:05:23.125756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.125471    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"]
Sep 10 21:05:23.156650 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.156609    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:23.214161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18f009-8376-4cff-9382-d06e4e6c47ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214238    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjqkz\" (UniqueName: \"kubernetes.io/projected/ea18f009-8376-4cff-9382-d06e4e6c47ca-kube-api-access-qjqkz\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.214949 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214756    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.215007 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.214965    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.215096 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.215014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18f009-8376-4cff-9382-d06e4e6c47ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.216693 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.216662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.217030 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.217009    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.222467 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.222446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjqkz\" (UniqueName: \"kubernetes.io/projected/ea18f009-8376-4cff-9382-d06e4e6c47ca-kube-api-access-qjqkz\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.222725 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.222707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18f009-8376-4cff-9382-d06e4e6c47ca-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-s6fhp\" (UID: \"ea18f009-8376-4cff-9382-d06e4e6c47ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.312111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.312076    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:23.430009 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.429924    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:23.711959 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.711933    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"]
Sep 10 21:05:23.713674 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:05:23.713646    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea18f009_8376_4cff_9382_d06e4e6c47ca.slice/crio-d7674f7932a2348f1be071721b685ddba771cc5a4cfe687e8c71701a03b90d68 WatchSource:0}: Error finding container d7674f7932a2348f1be071721b685ddba771cc5a4cfe687e8c71701a03b90d68: Status 404 returned error can't find the container with id d7674f7932a2348f1be071721b685ddba771cc5a4cfe687e8c71701a03b90d68
Sep 10 21:05:23.753379 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:23.753346    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" event={"ID":"ea18f009-8376-4cff-9382-d06e4e6c47ca","Type":"ContainerStarted","Data":"d7674f7932a2348f1be071721b685ddba771cc5a4cfe687e8c71701a03b90d68"}
Sep 10 21:05:24.472061 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:24.472009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:24.639035 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:24.638989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:26.269730 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:26.269696    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:05:26.269995 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:26.269767    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:05:26.269995 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:26.269794    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:05:26.773583 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:26.773547    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" event={"ID":"ea18f009-8376-4cff-9382-d06e4e6c47ca","Type":"ContainerStarted","Data":"8af5a0500062113a0137b4ef40522fe4b14741153edc45424c858e811886a44f"}
Sep 10 21:05:26.820273 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:26.820218    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" podStartSLOduration=1.266444769 podStartE2EDuration="3.820198461s" totalImagesPullingTime="2.553753692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:26.819468824 +0000 UTC m=+455.730748619" watchObservedRunningTime="2026-09-10 21:05:26.820198461 +0000 UTC m=+455.731478243"
Sep 10 21:05:27.431078 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:27.431028    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:27.435602 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:27.435580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:27.779019 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:27.778922    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:27.779771 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:27.779753    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:05:28.039483 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.039385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:28.267704 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.267667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:28.321398 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.321361    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:05:28.326175 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.326151    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.333597 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.333577    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4zp26\""
Sep 10 21:05:28.333682 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.333579    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 21:05:28.344412 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.344390    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:05:28.348084 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.348057    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb2bg\" (UniqueName: \"kubernetes.io/projected/66489f94-0c51-4e5d-82e2-2851f98629c2-kube-api-access-vb2bg\") pod \"limitador-limitador-84994f7ffc-jmsdn\" (UID: \"66489f94-0c51-4e5d-82e2-2851f98629c2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.348176 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.348104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66489f94-0c51-4e5d-82e2-2851f98629c2-config-file\") pod \"limitador-limitador-84994f7ffc-jmsdn\" (UID: \"66489f94-0c51-4e5d-82e2-2851f98629c2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.381726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.381694    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:05:28.449142 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.449108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb2bg\" (UniqueName: \"kubernetes.io/projected/66489f94-0c51-4e5d-82e2-2851f98629c2-kube-api-access-vb2bg\") pod \"limitador-limitador-84994f7ffc-jmsdn\" (UID: \"66489f94-0c51-4e5d-82e2-2851f98629c2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.449497 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.449156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66489f94-0c51-4e5d-82e2-2851f98629c2-config-file\") pod \"limitador-limitador-84994f7ffc-jmsdn\" (UID: \"66489f94-0c51-4e5d-82e2-2851f98629c2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.449770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.449751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66489f94-0c51-4e5d-82e2-2851f98629c2-config-file\") pod \"limitador-limitador-84994f7ffc-jmsdn\" (UID: \"66489f94-0c51-4e5d-82e2-2851f98629c2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.458455 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.458428    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb2bg\" (UniqueName: \"kubernetes.io/projected/66489f94-0c51-4e5d-82e2-2851f98629c2-kube-api-access-vb2bg\") pod \"limitador-limitador-84994f7ffc-jmsdn\" (UID: \"66489f94-0c51-4e5d-82e2-2851f98629c2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.636075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.635975    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:28.822787 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.822751    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j94h8"]
Sep 10 21:05:28.827408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.827387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8"
Sep 10 21:05:28.829903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.829882    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t4rfj\""
Sep 10 21:05:28.834613 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.834596    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j94h8"]
Sep 10 21:05:28.852705 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.852667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d56qq\" (UniqueName: \"kubernetes.io/projected/99934082-d103-42e2-941a-766bd081efa6-kube-api-access-d56qq\") pod \"authorino-7bcfd8f9cd-j94h8\" (UID: \"99934082-d103-42e2-941a-766bd081efa6\") " pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8"
Sep 10 21:05:28.925633 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.925605    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:05:28.926876 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:05:28.926847    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66489f94_0c51_4e5d_82e2_2851f98629c2.slice/crio-75f99bad28f3515cad5a39545cb747d2678c4836e23412dde56b070e0f8fd6f6 WatchSource:0}: Error finding container 75f99bad28f3515cad5a39545cb747d2678c4836e23412dde56b070e0f8fd6f6: Status 404 returned error can't find the container with id 75f99bad28f3515cad5a39545cb747d2678c4836e23412dde56b070e0f8fd6f6
Sep 10 21:05:28.936031 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.935999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:28.954095 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.954035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d56qq\" (UniqueName: \"kubernetes.io/projected/99934082-d103-42e2-941a-766bd081efa6-kube-api-access-d56qq\") pod \"authorino-7bcfd8f9cd-j94h8\" (UID: \"99934082-d103-42e2-941a-766bd081efa6\") " pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8"
Sep 10 21:05:28.963221 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:28.963191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d56qq\" (UniqueName: \"kubernetes.io/projected/99934082-d103-42e2-941a-766bd081efa6-kube-api-access-d56qq\") pod \"authorino-7bcfd8f9cd-j94h8\" (UID: \"99934082-d103-42e2-941a-766bd081efa6\") " pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8"
Sep 10 21:05:29.123080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:29.123035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:29.137845 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:29.137807    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8"
Sep 10 21:05:29.410847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:29.410813    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j94h8"]
Sep 10 21:05:29.412037 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:05:29.412009    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99934082_d103_42e2_941a_766bd081efa6.slice/crio-0bbbc5ce10d9a2402a1b8569245bfc4a65f09dff0ae59a2f32462d3fa77affb8 WatchSource:0}: Error finding container 0bbbc5ce10d9a2402a1b8569245bfc4a65f09dff0ae59a2f32462d3fa77affb8: Status 404 returned error can't find the container with id 0bbbc5ce10d9a2402a1b8569245bfc4a65f09dff0ae59a2f32462d3fa77affb8
Sep 10 21:05:29.791490 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:29.791439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8" event={"ID":"99934082-d103-42e2-941a-766bd081efa6","Type":"ContainerStarted","Data":"0bbbc5ce10d9a2402a1b8569245bfc4a65f09dff0ae59a2f32462d3fa77affb8"}
Sep 10 21:05:29.792764 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:29.792742    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn" event={"ID":"66489f94-0c51-4e5d-82e2-2851f98629c2","Type":"ContainerStarted","Data":"75f99bad28f3515cad5a39545cb747d2678c4836e23412dde56b070e0f8fd6f6"}
Sep 10 21:05:30.800390 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:30.800362    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn" event={"ID":"66489f94-0c51-4e5d-82e2-2851f98629c2","Type":"ContainerStarted","Data":"01f2a25491573d6ac5d3dd02fcc3d58e5dadfde6d889383ed66cccaf9f1b89d2"}
Sep 10 21:05:30.800684 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:30.800480    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:30.819857 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:30.819803    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn" podStartSLOduration=1.97313883 podStartE2EDuration="2.819781137s" totalImagesPullingTime="846.642307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:30.819090905 +0000 UTC m=+459.730370703" watchObservedRunningTime="2026-09-10 21:05:30.819781137 +0000 UTC m=+459.731060920"
Sep 10 21:05:31.807539 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:31.807481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8" event={"ID":"99934082-d103-42e2-941a-766bd081efa6","Type":"ContainerStarted","Data":"b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e"}
Sep 10 21:05:31.812560 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:31.812527    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j94h8"]
Sep 10 21:05:31.826757 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:31.826704    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8" podStartSLOduration=2.465072007 podStartE2EDuration="3.826687226s" totalImagesPullingTime="1.361615219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:31.825521766 +0000 UTC m=+460.736801548" watchObservedRunningTime="2026-09-10 21:05:31.826687226 +0000 UTC m=+460.737967008"
Sep 10 21:05:33.817679 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:33.817629    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8" podUID="99934082-d103-42e2-941a-766bd081efa6" containerName="authorino" containerID="cri-o://b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e" gracePeriod=30
Sep 10 21:05:34.067818 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.067762    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8"
Sep 10 21:05:34.089744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.089715    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d56qq\" (UniqueName: \"kubernetes.io/projected/99934082-d103-42e2-941a-766bd081efa6-kube-api-access-d56qq\") pod \"99934082-d103-42e2-941a-766bd081efa6\" (UID: \"99934082-d103-42e2-941a-766bd081efa6\") "
Sep 10 21:05:34.091877 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.091845    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99934082-d103-42e2-941a-766bd081efa6-kube-api-access-d56qq" (OuterVolumeSpecName: "kube-api-access-d56qq") pod "99934082-d103-42e2-941a-766bd081efa6" (UID: "99934082-d103-42e2-941a-766bd081efa6"). InnerVolumeSpecName "kube-api-access-d56qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:34.190636 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.190592    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d56qq\" (UniqueName: \"kubernetes.io/projected/99934082-d103-42e2-941a-766bd081efa6-kube-api-access-d56qq\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:34.824576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.824545    2558 generic.go:356] "Generic (PLEG): container finished" podID="99934082-d103-42e2-941a-766bd081efa6" containerID="b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e" exitCode=0
Sep 10 21:05:34.825026 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.824584    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8"
Sep 10 21:05:34.825026 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.824642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8" event={"ID":"99934082-d103-42e2-941a-766bd081efa6","Type":"ContainerDied","Data":"b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e"}
Sep 10 21:05:34.825026 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.824696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j94h8" event={"ID":"99934082-d103-42e2-941a-766bd081efa6","Type":"ContainerDied","Data":"0bbbc5ce10d9a2402a1b8569245bfc4a65f09dff0ae59a2f32462d3fa77affb8"}
Sep 10 21:05:34.825026 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.824717    2558 scope.go:117] "RemoveContainer" containerID="b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e"
Sep 10 21:05:34.834037 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.834018    2558 scope.go:117] "RemoveContainer" containerID="b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e"
Sep 10 21:05:34.834328 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:05:34.834307    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e\": container with ID starting with b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e not found: ID does not exist" containerID="b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e"
Sep 10 21:05:34.834388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.834336    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e"} err="failed to get container status \"b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e\": rpc error: code = NotFound desc = could not find container \"b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e\": container with ID starting with b890ba4e031b462d7fecc1e981cae482afa679c232a9a947af0d772e973a661e not found: ID does not exist"
Sep 10 21:05:34.844719 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.844697    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j94h8"]
Sep 10 21:05:34.849851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:34.849829    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j94h8"]
Sep 10 21:05:35.614576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:35.614542    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99934082-d103-42e2-941a-766bd081efa6" path="/var/lib/kubelet/pods/99934082-d103-42e2-941a-766bd081efa6/volumes"
Sep 10 21:05:41.808427 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:41.808397    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"
Sep 10 21:05:44.122065 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:44.122012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:44.229189 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:44.229142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:44.636421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:44.636375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:54.241637 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.241598    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:54.390036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.390000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:54.440683 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.440649    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-qc89v"]
Sep 10 21:05:54.441005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.440993    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99934082-d103-42e2-941a-766bd081efa6" containerName="authorino"
Sep 10 21:05:54.441065 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.441007    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="99934082-d103-42e2-941a-766bd081efa6" containerName="authorino"
Sep 10 21:05:54.441106 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.441072    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="99934082-d103-42e2-941a-766bd081efa6" containerName="authorino"
Sep 10 21:05:54.445491 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.445469    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qc89v"
Sep 10 21:05:54.447811 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.447790    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t4rfj\""
Sep 10 21:05:54.463619 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.463582    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-qc89v"]
Sep 10 21:05:54.495843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.495763    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-qc89v"]
Sep 10 21:05:54.496025 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:05:54.496005    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d8tbx], unattached volumes=[], failed to process volumes=[kube-api-access-d8tbx]: context canceled" pod="kuadrant-system/authorino-557f876f69-qc89v" podUID="ffeda68f-3be9-468b-aa51-ed18b3380ecf"
Sep 10 21:05:54.539934 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.539894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8tbx\" (UniqueName: \"kubernetes.io/projected/ffeda68f-3be9-468b-aa51-ed18b3380ecf-kube-api-access-d8tbx\") pod \"authorino-557f876f69-qc89v\" (UID: \"ffeda68f-3be9-468b-aa51-ed18b3380ecf\") " pod="kuadrant-system/authorino-557f876f69-qc89v"
Sep 10 21:05:54.640598 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.640564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8tbx\" (UniqueName: \"kubernetes.io/projected/ffeda68f-3be9-468b-aa51-ed18b3380ecf-kube-api-access-d8tbx\") pod \"authorino-557f876f69-qc89v\" (UID: \"ffeda68f-3be9-468b-aa51-ed18b3380ecf\") " pod="kuadrant-system/authorino-557f876f69-qc89v"
Sep 10 21:05:54.649773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.649741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8tbx\" (UniqueName: \"kubernetes.io/projected/ffeda68f-3be9-468b-aa51-ed18b3380ecf-kube-api-access-d8tbx\") pod \"authorino-557f876f69-qc89v\" (UID: \"ffeda68f-3be9-468b-aa51-ed18b3380ecf\") " pod="kuadrant-system/authorino-557f876f69-qc89v"
Sep 10 21:05:54.746386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.746280    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687cf597d9-rhq2s"]
Sep 10 21:05:54.749795 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.749774    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:54.752292 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.752273    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 21:05:54.759648 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.759620    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687cf597d9-rhq2s"]
Sep 10 21:05:54.842435 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.842401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64w6d\" (UniqueName: \"kubernetes.io/projected/2027e996-d23f-4d3f-b50e-2afd7055c856-kube-api-access-64w6d\") pod \"authorino-687cf597d9-rhq2s\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") " pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:54.842612 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.842452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2027e996-d23f-4d3f-b50e-2afd7055c856-tls-cert\") pod \"authorino-687cf597d9-rhq2s\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") " pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:54.933980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.933949    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qc89v"
Sep 10 21:05:54.940535 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.940510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qc89v"
Sep 10 21:05:54.943293 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.943273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64w6d\" (UniqueName: \"kubernetes.io/projected/2027e996-d23f-4d3f-b50e-2afd7055c856-kube-api-access-64w6d\") pod \"authorino-687cf597d9-rhq2s\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") " pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:54.943365 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.943313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2027e996-d23f-4d3f-b50e-2afd7055c856-tls-cert\") pod \"authorino-687cf597d9-rhq2s\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") " pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:54.945674 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.945654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2027e996-d23f-4d3f-b50e-2afd7055c856-tls-cert\") pod \"authorino-687cf597d9-rhq2s\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") " pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:54.955369 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:54.955345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64w6d\" (UniqueName: \"kubernetes.io/projected/2027e996-d23f-4d3f-b50e-2afd7055c856-kube-api-access-64w6d\") pod \"authorino-687cf597d9-rhq2s\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") " pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:55.044458 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.044371    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8tbx\" (UniqueName: \"kubernetes.io/projected/ffeda68f-3be9-468b-aa51-ed18b3380ecf-kube-api-access-d8tbx\") pod \"ffeda68f-3be9-468b-aa51-ed18b3380ecf\" (UID: \"ffeda68f-3be9-468b-aa51-ed18b3380ecf\") "
Sep 10 21:05:55.046444 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.046410    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffeda68f-3be9-468b-aa51-ed18b3380ecf-kube-api-access-d8tbx" (OuterVolumeSpecName: "kube-api-access-d8tbx") pod "ffeda68f-3be9-468b-aa51-ed18b3380ecf" (UID: "ffeda68f-3be9-468b-aa51-ed18b3380ecf"). InnerVolumeSpecName "kube-api-access-d8tbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:55.059607 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.059579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:05:55.144900 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.144868    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8tbx\" (UniqueName: \"kubernetes.io/projected/ffeda68f-3be9-468b-aa51-ed18b3380ecf-kube-api-access-d8tbx\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:55.329529 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.329500    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687cf597d9-rhq2s"]
Sep 10 21:05:55.330956 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:05:55.330930    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2027e996_d23f_4d3f_b50e_2afd7055c856.slice/crio-4aaee8104de8c89ede64cc44053fdf0e4e85d1659c42012f8a23d57d7fff0c28 WatchSource:0}: Error finding container 4aaee8104de8c89ede64cc44053fdf0e4e85d1659c42012f8a23d57d7fff0c28: Status 404 returned error can't find the container with id 4aaee8104de8c89ede64cc44053fdf0e4e85d1659c42012f8a23d57d7fff0c28
Sep 10 21:05:55.940475 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.940380    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687cf597d9-rhq2s" event={"ID":"2027e996-d23f-4d3f-b50e-2afd7055c856","Type":"ContainerStarted","Data":"3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98"}
Sep 10 21:05:55.940475 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.940426    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687cf597d9-rhq2s" event={"ID":"2027e996-d23f-4d3f-b50e-2afd7055c856","Type":"ContainerStarted","Data":"4aaee8104de8c89ede64cc44053fdf0e4e85d1659c42012f8a23d57d7fff0c28"}
Sep 10 21:05:55.940475 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.940454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-qc89v"
Sep 10 21:05:55.960332 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.960110    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-687cf597d9-rhq2s" podStartSLOduration=1.5413699969999999 podStartE2EDuration="1.960089194s" totalImagesPullingTime="418.719197ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:55.959840294 +0000 UTC m=+484.871120076" watchObservedRunningTime="2026-09-10 21:05:55.960089194 +0000 UTC m=+484.871368977"
Sep 10 21:05:55.991488 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.991449    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-qc89v"]
Sep 10 21:05:55.995137 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:55.995109    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-qc89v"]
Sep 10 21:05:57.615079 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:05:57.615029    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffeda68f-3be9-468b-aa51-ed18b3380ecf" path="/var/lib/kubelet/pods/ffeda68f-3be9-468b-aa51-ed18b3380ecf/volumes"
Sep 10 21:06:00.958214 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:00.958181    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:01.125071 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:01.125015    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:01.305755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:01.305723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:01.547495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:01.547465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:05.431940 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:05.431905    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:05.544033 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:05.544002    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:34.158684 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:34.158644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:34.257374 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:34.257344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:38.051819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:38.051777    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:38.153483 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:38.153412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:39.457457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:39.457418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:39.558732 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:39.558697    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:39.660164 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:39.660120    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:39.842249 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:39.842208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:40.149253 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:40.149166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:40.241214 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:40.241170    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:40.954300 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:40.954236    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:06:49.219168 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:49.219139    2558 generic.go:356] "Generic (PLEG): container finished" podID="ea18f009-8376-4cff-9382-d06e4e6c47ca" containerID="8af5a0500062113a0137b4ef40522fe4b14741153edc45424c858e811886a44f" exitCode=0
Sep 10 21:06:49.219610 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:49.219214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" event={"ID":"ea18f009-8376-4cff-9382-d06e4e6c47ca","Type":"ContainerDied","Data":"8af5a0500062113a0137b4ef40522fe4b14741153edc45424c858e811886a44f"}
Sep 10 21:06:49.219738 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:49.219720    2558 scope.go:117] "RemoveContainer" containerID="8af5a0500062113a0137b4ef40522fe4b14741153edc45424c858e811886a44f"
Sep 10 21:06:49.220699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:49.220673    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:06:49.220759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:49.220741    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:06:49.220795 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:49.220774    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:06:50.226633 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:50.226596    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" event={"ID":"ea18f009-8376-4cff-9382-d06e4e6c47ca","Type":"ContainerStarted","Data":"b4bfd340253faf5fb6407c387cb6b99ac744742073532e1d2656a3d79da7c243"}
Sep 10 21:06:50.430118 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:50.430079    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:06:50.430345 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:50.430323    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s6fhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 21:06:50.430393 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:50.430370    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" podUID="ea18f009-8376-4cff-9382-d06e4e6c47ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 21:06:51.158068 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:51.158016    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:51.258404 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:51.258329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:51.430969 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:51.430870    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s6fhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 21:06:51.430969 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:51.430935    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" podUID="ea18f009-8376-4cff-9382-d06e4e6c47ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 21:06:52.431329 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:52.431287    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s6fhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 21:06:52.431750 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:52.431354    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" podUID="ea18f009-8376-4cff-9382-d06e4e6c47ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 21:06:53.431207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:53.431170    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s6fhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 21:06:53.431395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:53.431238    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" podUID="ea18f009-8376-4cff-9382-d06e4e6c47ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 21:06:54.431197 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:54.431155    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s6fhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 21:06:54.431405 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:54.431218    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" podUID="ea18f009-8376-4cff-9382-d06e4e6c47ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 21:06:55.430323 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:55.430284    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-s6fhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 21:06:55.430514 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:55.430341    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp" podUID="ea18f009-8376-4cff-9382-d06e4e6c47ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 21:06:56.434006 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:56.433971    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:06:56.434395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:56.434341    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:06:56.435150 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:06:56.435133    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-s6fhp"
Sep 10 21:07:16.550404 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:16.550368    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:17.178127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:17.178087    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:07:29.438929 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:29.438894    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:30.014156 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:30.014120    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:07:43.546425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:43.546383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:44.827303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:44.827272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:45.910116 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:45.910071    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:07:48.749028 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:48.748998    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:49.696271 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:49.696233    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:07:56.708898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:56.708859    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:57.070767 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:57.070728    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:58.109110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:58.109066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:07:59.393514 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:59.393458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:59.453728 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:07:59.453693    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:06.677549 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:08:06.677503    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:14.127375 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:08:14.127292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:16.111339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:08:16.111302    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:08:25.511960 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:08:25.511923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:27.605683 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:08:27.605623    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:09:22.781647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:22.781609    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66988d5cd8-84vsc"]
Sep 10 21:09:22.785023 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:22.784996    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:22.795330 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:22.795305    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66988d5cd8-84vsc"]
Sep 10 21:09:22.908740 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:22.908703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgg7g\" (UniqueName: \"kubernetes.io/projected/b5bf47d1-266e-468a-ab53-c8a52555d07d-kube-api-access-rgg7g\") pod \"authorino-66988d5cd8-84vsc\" (UID: \"b5bf47d1-266e-468a-ab53-c8a52555d07d\") " pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:22.908918 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:22.908754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5bf47d1-266e-468a-ab53-c8a52555d07d-tls-cert\") pod \"authorino-66988d5cd8-84vsc\" (UID: \"b5bf47d1-266e-468a-ab53-c8a52555d07d\") " pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:23.009667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:23.009621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgg7g\" (UniqueName: \"kubernetes.io/projected/b5bf47d1-266e-468a-ab53-c8a52555d07d-kube-api-access-rgg7g\") pod \"authorino-66988d5cd8-84vsc\" (UID: \"b5bf47d1-266e-468a-ab53-c8a52555d07d\") " pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:23.009844 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:23.009684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5bf47d1-266e-468a-ab53-c8a52555d07d-tls-cert\") pod \"authorino-66988d5cd8-84vsc\" (UID: \"b5bf47d1-266e-468a-ab53-c8a52555d07d\") " pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:23.012134 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:23.012110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5bf47d1-266e-468a-ab53-c8a52555d07d-tls-cert\") pod \"authorino-66988d5cd8-84vsc\" (UID: \"b5bf47d1-266e-468a-ab53-c8a52555d07d\") " pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:23.017355 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:23.017330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgg7g\" (UniqueName: \"kubernetes.io/projected/b5bf47d1-266e-468a-ab53-c8a52555d07d-kube-api-access-rgg7g\") pod \"authorino-66988d5cd8-84vsc\" (UID: \"b5bf47d1-266e-468a-ab53-c8a52555d07d\") " pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:23.094264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:23.094231    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66988d5cd8-84vsc"
Sep 10 21:09:23.370521 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:23.370492    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66988d5cd8-84vsc"]
Sep 10 21:09:23.372608 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:09:23.372584    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5bf47d1_266e_468a_ab53_c8a52555d07d.slice/crio-b3b40438244b31ef6acdde1bb96f99be0863872d175ce3986e432dedb6aa0a87 WatchSource:0}: Error finding container b3b40438244b31ef6acdde1bb96f99be0863872d175ce3986e432dedb6aa0a87: Status 404 returned error can't find the container with id b3b40438244b31ef6acdde1bb96f99be0863872d175ce3986e432dedb6aa0a87
Sep 10 21:09:23.373906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:23.373879    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:09:24.044882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:24.044855    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66988d5cd8-84vsc" event={"ID":"b5bf47d1-266e-468a-ab53-c8a52555d07d","Type":"ContainerStarted","Data":"b3b40438244b31ef6acdde1bb96f99be0863872d175ce3986e432dedb6aa0a87"}
Sep 10 21:09:25.054887 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.054848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66988d5cd8-84vsc" event={"ID":"b5bf47d1-266e-468a-ab53-c8a52555d07d","Type":"ContainerStarted","Data":"412432f318e952a19061e576d5ea0f1bd973470116646214c5820b910fbdf520"}
Sep 10 21:09:25.076468 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.076398    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66988d5cd8-84vsc" podStartSLOduration=2.427432218 podStartE2EDuration="3.076372589s" totalImagesPullingTime="648.940371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:25.072682248 +0000 UTC m=+693.983962057" watchObservedRunningTime="2026-09-10 21:09:25.076372589 +0000 UTC m=+693.987652391"
Sep 10 21:09:25.109589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.109549    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687cf597d9-rhq2s"]
Sep 10 21:09:25.109818 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.109786    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-687cf597d9-rhq2s" podUID="2027e996-d23f-4d3f-b50e-2afd7055c856" containerName="authorino" containerID="cri-o://3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98" gracePeriod=30
Sep 10 21:09:25.367012 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.366988    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:09:25.533604 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.533564    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64w6d\" (UniqueName: \"kubernetes.io/projected/2027e996-d23f-4d3f-b50e-2afd7055c856-kube-api-access-64w6d\") pod \"2027e996-d23f-4d3f-b50e-2afd7055c856\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") "
Sep 10 21:09:25.533793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.533626    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2027e996-d23f-4d3f-b50e-2afd7055c856-tls-cert\") pod \"2027e996-d23f-4d3f-b50e-2afd7055c856\" (UID: \"2027e996-d23f-4d3f-b50e-2afd7055c856\") "
Sep 10 21:09:25.535830 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.535801    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2027e996-d23f-4d3f-b50e-2afd7055c856-kube-api-access-64w6d" (OuterVolumeSpecName: "kube-api-access-64w6d") pod "2027e996-d23f-4d3f-b50e-2afd7055c856" (UID: "2027e996-d23f-4d3f-b50e-2afd7055c856"). InnerVolumeSpecName "kube-api-access-64w6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:25.543969 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.543937    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2027e996-d23f-4d3f-b50e-2afd7055c856-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2027e996-d23f-4d3f-b50e-2afd7055c856" (UID: "2027e996-d23f-4d3f-b50e-2afd7055c856"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:09:25.634474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.634441    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64w6d\" (UniqueName: \"kubernetes.io/projected/2027e996-d23f-4d3f-b50e-2afd7055c856-kube-api-access-64w6d\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:09:25.634474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.634473    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2027e996-d23f-4d3f-b50e-2afd7055c856-tls-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:09:25.665498 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.665459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:25.759649 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:25.759612    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:26.061645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.061609    2558 generic.go:356] "Generic (PLEG): container finished" podID="2027e996-d23f-4d3f-b50e-2afd7055c856" containerID="3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98" exitCode=0
Sep 10 21:09:26.062173 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.061663    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687cf597d9-rhq2s"
Sep 10 21:09:26.062173 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.061688    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687cf597d9-rhq2s" event={"ID":"2027e996-d23f-4d3f-b50e-2afd7055c856","Type":"ContainerDied","Data":"3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98"}
Sep 10 21:09:26.062173 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.061740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687cf597d9-rhq2s" event={"ID":"2027e996-d23f-4d3f-b50e-2afd7055c856","Type":"ContainerDied","Data":"4aaee8104de8c89ede64cc44053fdf0e4e85d1659c42012f8a23d57d7fff0c28"}
Sep 10 21:09:26.062173 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.061769    2558 scope.go:117] "RemoveContainer" containerID="3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98"
Sep 10 21:09:26.072205 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.072177    2558 scope.go:117] "RemoveContainer" containerID="3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98"
Sep 10 21:09:26.072529 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:26.072509    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98\": container with ID starting with 3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98 not found: ID does not exist" containerID="3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98"
Sep 10 21:09:26.072599 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.072538    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98"} err="failed to get container status \"3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98\": rpc error: code = NotFound desc = could not find container \"3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98\": container with ID starting with 3ffb96cf6d4b0697b43ff3c6625dd660a02ba62d64eb3997a37ac5b72e7e5c98 not found: ID does not exist"
Sep 10 21:09:26.077394 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.077370    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687cf597d9-rhq2s"]
Sep 10 21:09:26.081675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.081648    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687cf597d9-rhq2s"]
Sep 10 21:09:26.804228 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.804191    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:26.902894 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:26.902862    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:27.614889 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:27.614854    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2027e996-d23f-4d3f-b50e-2afd7055c856" path="/var/lib/kubelet/pods/2027e996-d23f-4d3f-b50e-2afd7055c856/volumes"
Sep 10 21:09:42.686106 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:42.686060    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:42.786264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:42.786223    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:43.019083 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.018977    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"]
Sep 10 21:09:43.019553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.019530    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2027e996-d23f-4d3f-b50e-2afd7055c856" containerName="authorino"
Sep 10 21:09:43.019655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.019555    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2027e996-d23f-4d3f-b50e-2afd7055c856" containerName="authorino"
Sep 10 21:09:43.019655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.019643    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2027e996-d23f-4d3f-b50e-2afd7055c856" containerName="authorino"
Sep 10 21:09:43.024325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.024301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.027492 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.027470    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-47f62f-openshift-default-dockercfg-6kbvc\""
Sep 10 21:09:43.033519 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.033496    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"]
Sep 10 21:09:43.040408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.040383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:43.091980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.091944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-certs\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.091980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.091982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-token\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.092181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.092015    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-credential-socket\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.092181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.092088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-podinfo\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.092181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.092120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istiod-ca-cert\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.092181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.092151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-socket\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.092339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.092233    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhw8r\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-kube-api-access-xhw8r\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.092339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.092283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-envoy\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.092339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.092328    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-data\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.192819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.192785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-envoy\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.192990 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.192829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-data\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.192990 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.192865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-certs\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193125 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-token\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193188 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-credential-socket\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193188 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-podinfo\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istiod-ca-cert\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-certs\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-data\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-socket\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193503 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhw8r\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-kube-api-access-xhw8r\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193503 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193407    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-credential-socket\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.193621 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.193555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-socket\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.194143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.194117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istiod-ca-cert\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.195363 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.195343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-envoy\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.195808 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.195781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:43.196136 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.196116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-podinfo\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.202525 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.202502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhw8r\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-kube-api-access-xhw8r\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.203537 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.203503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-token\") pod \"e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") " pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.335891 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.335856    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:43.621927 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.621897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"]
Sep 10 21:09:43.623209 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:09:43.623188    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1df40f_d935_487f_aaf9_0b4db34f3aa8.slice/crio-051b6989b9247de2120fb1e6a96de82aca2e8bb6553d8a4b4e15bc2361e80bdc WatchSource:0}: Error finding container 051b6989b9247de2120fb1e6a96de82aca2e8bb6553d8a4b4e15bc2361e80bdc: Status 404 returned error can't find the container with id 051b6989b9247de2120fb1e6a96de82aca2e8bb6553d8a4b4e15bc2361e80bdc
Sep 10 21:09:43.625351 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.625313    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:43.625448 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.625385    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:43.625448 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:43.625418    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:44.159591 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.159552    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:44.161377 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.161350    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" event={"ID":"0d1df40f-d935-487f-aaf9-0b4db34f3aa8","Type":"ContainerStarted","Data":"7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580"}
Sep 10 21:09:44.161510 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.161402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" event={"ID":"0d1df40f-d935-487f-aaf9-0b4db34f3aa8","Type":"ContainerStarted","Data":"051b6989b9247de2120fb1e6a96de82aca2e8bb6553d8a4b4e15bc2361e80bdc"}
Sep 10 21:09:44.183591 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.183543    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podStartSLOduration=2.183529025 podStartE2EDuration="2.183529025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:44.182360438 +0000 UTC m=+713.093640240" watchObservedRunningTime="2026-09-10 21:09:44.183529025 +0000 UTC m=+713.094808801"
Sep 10 21:09:44.261527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.261483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:44.336215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.336183    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:44.341272 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.341238    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:44.638200 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.638165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:44.784679 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.784645    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7670-a469d9"]
Sep 10 21:09:44.788006 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.787989    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:44.790549 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.790527    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-858x8\""
Sep 10 21:09:44.801033 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.800997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7670-a469d9"]
Sep 10 21:09:44.807143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.807114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dvwh\" (UniqueName: \"kubernetes.io/projected/63a735e9-c22c-4796-b793-a79319e0dfff-kube-api-access-6dvwh\") pod \"test-curl-7670-a469d9\" (UID: \"63a735e9-c22c-4796-b793-a79319e0dfff\") " pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:44.908331 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.908243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dvwh\" (UniqueName: \"kubernetes.io/projected/63a735e9-c22c-4796-b793-a79319e0dfff-kube-api-access-6dvwh\") pod \"test-curl-7670-a469d9\" (UID: \"63a735e9-c22c-4796-b793-a79319e0dfff\") " pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:44.917588 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:44.917558    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dvwh\" (UniqueName: \"kubernetes.io/projected/63a735e9-c22c-4796-b793-a79319e0dfff-kube-api-access-6dvwh\") pod \"test-curl-7670-a469d9\" (UID: \"63a735e9-c22c-4796-b793-a79319e0dfff\") " pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:45.103906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:45.103872    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:45.171686 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:45.171482    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:45.172689 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:45.172654    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:09:45.377289 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:45.377222    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7670-a469d9"]
Sep 10 21:09:45.379536 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:09:45.379506    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63a735e9_c22c_4796_b793_a79319e0dfff.slice/crio-6c18eeb18b1c8c5b42668b8732b74d4dfac406eebcf4d0b501bb648377d63057 WatchSource:0}: Error finding container 6c18eeb18b1c8c5b42668b8732b74d4dfac406eebcf4d0b501bb648377d63057: Status 404 returned error can't find the container with id 6c18eeb18b1c8c5b42668b8732b74d4dfac406eebcf4d0b501bb648377d63057
Sep 10 21:09:46.180078 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:46.180018    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7670-a469d9" event={"ID":"63a735e9-c22c-4796-b793-a79319e0dfff","Type":"ContainerStarted","Data":"6c18eeb18b1c8c5b42668b8732b74d4dfac406eebcf4d0b501bb648377d63057"}
Sep 10 21:09:46.231159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:46.231096    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:46.343437 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:46.343401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:46.724699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:46.724658    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:09:47.379572 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:47.379532    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:47.493814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:47.493708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:47.837014 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:47.836973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:48.195206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:48.195089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7670-a469d9" event={"ID":"63a735e9-c22c-4796-b793-a79319e0dfff","Type":"ContainerStarted","Data":"f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528"}
Sep 10 21:09:48.195626 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:48.195601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:48.226086 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:48.226007    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7670-a469d9" podStartSLOduration=2.374367787 podStartE2EDuration="4.225986875s" totalImagesPullingTime="1.851619088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:48.223962031 +0000 UTC m=+717.135241813" watchObservedRunningTime="2026-09-10 21:09:48.225986875 +0000 UTC m=+717.137266704"
Sep 10 21:09:48.292632 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:48.292598    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:48.891595 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:48.891555    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7670-a469d9"]
Sep 10 21:09:48.895671 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:48.895638    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7670-a469d9"]
Sep 10 21:09:49.030599 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.030509    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7670-728326"]
Sep 10 21:09:49.030885 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.030872    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a735e9-c22c-4796-b793-a79319e0dfff" containerName="test-curl-7670-a469d9"
Sep 10 21:09:49.030939 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.030886    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a735e9-c22c-4796-b793-a79319e0dfff" containerName="test-curl-7670-a469d9"
Sep 10 21:09:49.030975 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.030967    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a735e9-c22c-4796-b793-a79319e0dfff" containerName="test-curl-7670-a469d9"
Sep 10 21:09:49.034293 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.034276    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:49.054890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.054851    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7670-728326"]
Sep 10 21:09:49.145882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.145842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdss\" (UniqueName: \"kubernetes.io/projected/68153798-1028-4f7f-b289-a4d4a6bb631b-kube-api-access-rfdss\") pod \"test-curl-7670-728326\" (UID: \"68153798-1028-4f7f-b289-a4d4a6bb631b\") " pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:49.200377 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:49.200345    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7670-a469d9" container="test-curl-7670-a469d9"
Sep 10 21:09:49.246875 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.246836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdss\" (UniqueName: \"kubernetes.io/projected/68153798-1028-4f7f-b289-a4d4a6bb631b-kube-api-access-rfdss\") pod \"test-curl-7670-728326\" (UID: \"68153798-1028-4f7f-b289-a4d4a6bb631b\") " pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:49.259747 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.259710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdss\" (UniqueName: \"kubernetes.io/projected/68153798-1028-4f7f-b289-a4d4a6bb631b-kube-api-access-rfdss\") pod \"test-curl-7670-728326\" (UID: \"68153798-1028-4f7f-b289-a4d4a6bb631b\") " pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:49.342972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.342921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:49.617293 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:49.617268    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7670-728326"]
Sep 10 21:09:49.620415 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:09:49.620387    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68153798_1028_4f7f_b289_a4d4a6bb631b.slice/crio-a18f3915fa0d5b1491f3018ead2984ef67a6318a009b68c8de71e804c54e3005 WatchSource:0}: Error finding container a18f3915fa0d5b1491f3018ead2984ef67a6318a009b68c8de71e804c54e3005: Status 404 returned error can't find the container with id a18f3915fa0d5b1491f3018ead2984ef67a6318a009b68c8de71e804c54e3005
Sep 10 21:09:50.206719 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:50.206687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7670-728326" event={"ID":"68153798-1028-4f7f-b289-a4d4a6bb631b","Type":"ContainerStarted","Data":"ae426894bc5e4925ca774ab2501ea76d959b22af6c1e051ca0d5c6cb5240c657"}
Sep 10 21:09:50.207135 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:50.206727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7670-728326" event={"ID":"68153798-1028-4f7f-b289-a4d4a6bb631b","Type":"ContainerStarted","Data":"a18f3915fa0d5b1491f3018ead2984ef67a6318a009b68c8de71e804c54e3005"}
Sep 10 21:09:50.207533 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:50.207495    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7670-a469d9" podUID="63a735e9-c22c-4796-b793-a79319e0dfff" containerName="test-curl-7670-a469d9" containerID="cri-o://f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528" gracePeriod=2
Sep 10 21:09:50.229814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:50.229761    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7670-728326" podStartSLOduration=1.22974595 podStartE2EDuration="1.22974595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:50.228164889 +0000 UTC m=+719.139444664" watchObservedRunningTime="2026-09-10 21:09:50.22974595 +0000 UTC m=+719.141025766"
Sep 10 21:09:50.860079 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:50.860028    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7670-728326"]
Sep 10 21:09:50.866354 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:50.866327    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7670-728326"]
Sep 10 21:09:51.211658 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:51.211626    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7670-728326" container="test-curl-7670-728326"
Sep 10 21:09:51.313303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.313267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.414239 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.414200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.479508 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.479418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.548605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.548571    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.727696 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.727661    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"]
Sep 10 21:09:51.728080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.728066    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68153798-1028-4f7f-b289-a4d4a6bb631b" containerName="test-curl-7670-728326"
Sep 10 21:09:51.728125 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.728082    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="68153798-1028-4f7f-b289-a4d4a6bb631b" containerName="test-curl-7670-728326"
Sep 10 21:09:51.728164 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.728155    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="68153798-1028-4f7f-b289-a4d4a6bb631b" containerName="test-curl-7670-728326"
Sep 10 21:09:51.731406 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.731361    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.733878 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.733857    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-63f3d7-openshift-default-dockercfg-hdv29\""
Sep 10 21:09:51.744009 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.743980    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"]
Sep 10 21:09:51.769850 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.769820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-socket\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770000 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.769857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-data\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770000 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.769882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-certs\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770000 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.769902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-credential-socket\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770000 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.769972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-envoy\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770224 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.770076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-podinfo\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770224 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.770132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2cms\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-kube-api-access-v2cms\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770224 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.770156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-token\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.770224 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.770171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45b3a771-5f81-4cb0-afa0-de722de4a875-istiod-ca-cert\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.775708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.775684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.870787 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870753    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-data\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.870787 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-certs\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-credential-socket\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-envoy\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-podinfo\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2cms\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-kube-api-access-v2cms\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-token\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.870986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45b3a771-5f81-4cb0-afa0-de722de4a875-istiod-ca-cert\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.871017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-socket\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.871249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-data\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.871296    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-credential-socket\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.871358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-certs\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871569 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.871471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-socket\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.871776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.871754    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45b3a771-5f81-4cb0-afa0-de722de4a875-istiod-ca-cert\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.873243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.873225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-envoy\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.873393 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.873375    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-podinfo\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.891820 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.891795    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-token\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.892692 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.892665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2cms\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-kube-api-access-v2cms\") pod \"e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") " pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:51.913200 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.913174    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"]
Sep 10 21:09:51.918019 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.917999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.920960 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.920936    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1a398fc7-openshift-default-dockercfg-7kv88\""
Sep 10 21:09:51.933670 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.933643    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"]
Sep 10 21:09:51.954161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.954128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.972219 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-podinfo\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-socket\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nrhn\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-kube-api-access-9nrhn\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-data\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-token\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-certs\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-credential-socket\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972564 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istiod-ca-cert\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:51.972564 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:51.972515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-envoy\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.042174 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.042033    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:52.073403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-podinfo\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.073579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073413    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-socket\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.073579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nrhn\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-kube-api-access-9nrhn\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.073579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-data\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.073757 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-token\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.073757 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-certs\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.073757 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073703    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-credential-socket\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.073757 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istiod-ca-cert\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.074025 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-socket\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.074025 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-envoy\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.074025 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.073958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-data\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.074345 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.074314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-certs\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.074432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.074412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istiod-ca-cert\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.074482 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.074416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-credential-socket\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.076016 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.075993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-podinfo\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.076145 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.076107    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-envoy\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.096823 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.096793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-token\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.098850 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.098823    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nrhn\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-kube-api-access-9nrhn\") pod \"e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") " pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.100362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.100328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:52.200448 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.200413    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:52.216914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.216879    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7670-728326" podUID="68153798-1028-4f7f-b289-a4d4a6bb631b" containerName="test-curl-7670-728326" containerID="cri-o://ae426894bc5e4925ca774ab2501ea76d959b22af6c1e051ca0d5c6cb5240c657" gracePeriod=2
Sep 10 21:09:52.228169 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.228144    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:52.329150 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.329121    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"]
Sep 10 21:09:52.329844 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:09:52.329823    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b3a771_5f81_4cb0_afa0_de722de4a875.slice/crio-91301056fea77fdd8a95e9754c35616fe762cb319ddc463210ab729c66b990e7 WatchSource:0}: Error finding container 91301056fea77fdd8a95e9754c35616fe762cb319ddc463210ab729c66b990e7: Status 404 returned error can't find the container with id 91301056fea77fdd8a95e9754c35616fe762cb319ddc463210ab729c66b990e7
Sep 10 21:09:52.332492 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.332442    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:52.332600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.332532    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:52.332600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.332575    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:52.399278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.399249    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:52.477785 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.477508    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dvwh\" (UniqueName: \"kubernetes.io/projected/63a735e9-c22c-4796-b793-a79319e0dfff-kube-api-access-6dvwh\") pod \"63a735e9-c22c-4796-b793-a79319e0dfff\" (UID: \"63a735e9-c22c-4796-b793-a79319e0dfff\") "
Sep 10 21:09:52.480062 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.480016    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a735e9-c22c-4796-b793-a79319e0dfff-kube-api-access-6dvwh" (OuterVolumeSpecName: "kube-api-access-6dvwh") pod "63a735e9-c22c-4796-b793-a79319e0dfff" (UID: "63a735e9-c22c-4796-b793-a79319e0dfff"). InnerVolumeSpecName "kube-api-access-6dvwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:52.510339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.510311    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"]
Sep 10 21:09:52.513415 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:09:52.513365    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76658d9f_ccd8_46a2_9a9b_09291c4fdcd4.slice/crio-f380b47e7cdbbf8349d24ec1b51d46ad5ff0a0f2e8aa772e763ad368f0fa7b94 WatchSource:0}: Error finding container f380b47e7cdbbf8349d24ec1b51d46ad5ff0a0f2e8aa772e763ad368f0fa7b94: Status 404 returned error can't find the container with id f380b47e7cdbbf8349d24ec1b51d46ad5ff0a0f2e8aa772e763ad368f0fa7b94
Sep 10 21:09:52.516309 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.516271    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:52.516393 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.516358    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:52.516440 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.516399    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:09:52.578589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:52.578503    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dvwh\" (UniqueName: \"kubernetes.io/projected/63a735e9-c22c-4796-b793-a79319e0dfff-kube-api-access-6dvwh\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:09:53.223589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.223493    2558 generic.go:356] "Generic (PLEG): container finished" podID="63a735e9-c22c-4796-b793-a79319e0dfff" containerID="f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528" exitCode=137
Sep 10 21:09:53.223589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.223557    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:53.224079 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.223605    2558 scope.go:117] "RemoveContainer" containerID="f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528"
Sep 10 21:09:53.226062 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.226014    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" event={"ID":"45b3a771-5f81-4cb0-afa0-de722de4a875","Type":"ContainerStarted","Data":"43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c"}
Sep 10 21:09:53.226186 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.226126    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" event={"ID":"45b3a771-5f81-4cb0-afa0-de722de4a875","Type":"ContainerStarted","Data":"91301056fea77fdd8a95e9754c35616fe762cb319ddc463210ab729c66b990e7"}
Sep 10 21:09:53.227971 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.227943    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" event={"ID":"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4","Type":"ContainerStarted","Data":"ff091c6efe6a354cc933b40db31b781c847919e11a025e2e13a5d4b84406e186"}
Sep 10 21:09:53.228100 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.227997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" event={"ID":"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4","Type":"ContainerStarted","Data":"f380b47e7cdbbf8349d24ec1b51d46ad5ff0a0f2e8aa772e763ad368f0fa7b94"}
Sep 10 21:09:53.228454 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.228433    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:53.234237 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.234219    2558 scope.go:117] "RemoveContainer" containerID="f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528"
Sep 10 21:09:53.234531 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:53.234510    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528\": container with ID starting with f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528 not found: ID does not exist" containerID="f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528"
Sep 10 21:09:53.234628 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.234536    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528"} err="failed to get container status \"f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528\": rpc error: code = NotFound desc = could not find container \"f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528\": container with ID starting with f3cf602a94888baa97d7b8a1c8531c0bc60cac64c373642bf1db9dbb367ad528 not found: ID does not exist"
Sep 10 21:09:53.234769 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.234756    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:53.248660 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.248601    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podStartSLOduration=2.248581785 podStartE2EDuration="2.248581785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:53.247715938 +0000 UTC m=+722.158995739" watchObservedRunningTime="2026-09-10 21:09:53.248581785 +0000 UTC m=+722.159861570"
Sep 10 21:09:53.249831 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:53.249786    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7670-a469d9\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="63a735e9-c22c-4796-b793-a79319e0dfff" pod="opendatahub/test-curl-7670-a469d9"
Sep 10 21:09:53.270897 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.270848    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podStartSLOduration=2.270831749 podStartE2EDuration="2.270831749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:53.270201802 +0000 UTC m=+722.181481595" watchObservedRunningTime="2026-09-10 21:09:53.270831749 +0000 UTC m=+722.182111532"
Sep 10 21:09:53.615209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:53.615174    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a735e9-c22c-4796-b793-a79319e0dfff" path="/var/lib/kubelet/pods/63a735e9-c22c-4796-b793-a79319e0dfff/volumes"
Sep 10 21:09:54.044914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.044811    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:54.056809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.056774    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:54.237198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.237165    2558 generic.go:356] "Generic (PLEG): container finished" podID="68153798-1028-4f7f-b289-a4d4a6bb631b" containerID="ae426894bc5e4925ca774ab2501ea76d959b22af6c1e051ca0d5c6cb5240c657" exitCode=137
Sep 10 21:09:54.239495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.239244    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:54.239495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.239297    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:54.240254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.240235    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:09:54.240349 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.240332    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:09:54.491435 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.491410    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:54.604141 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.604110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfdss\" (UniqueName: \"kubernetes.io/projected/68153798-1028-4f7f-b289-a4d4a6bb631b-kube-api-access-rfdss\") pod \"68153798-1028-4f7f-b289-a4d4a6bb631b\" (UID: \"68153798-1028-4f7f-b289-a4d4a6bb631b\") "
Sep 10 21:09:54.606572 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.606541    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68153798-1028-4f7f-b289-a4d4a6bb631b-kube-api-access-rfdss" (OuterVolumeSpecName: "kube-api-access-rfdss") pod "68153798-1028-4f7f-b289-a4d4a6bb631b" (UID: "68153798-1028-4f7f-b289-a4d4a6bb631b"). InnerVolumeSpecName "kube-api-access-rfdss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:54.649911 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.649749    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:54.705704 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.705358    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfdss\" (UniqueName: \"kubernetes.io/projected/68153798-1028-4f7f-b289-a4d4a6bb631b-kube-api-access-rfdss\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:09:54.743252 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:54.743213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:55.249084 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:55.249033    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:55.257745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:55.257717    2558 scope.go:117] "RemoveContainer" containerID="ae426894bc5e4925ca774ab2501ea76d959b22af6c1e051ca0d5c6cb5240c657"
Sep 10 21:09:55.270160 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:55.270074    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7670-728326\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="68153798-1028-4f7f-b289-a4d4a6bb631b" pod="opendatahub/test-curl-7670-728326"
Sep 10 21:09:55.285566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:55.285535    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:55.379433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:55.379400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:55.615366 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:55.615329    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68153798-1028-4f7f-b289-a4d4a6bb631b" path="/var/lib/kubelet/pods/68153798-1028-4f7f-b289-a4d4a6bb631b/volumes"
Sep 10 21:09:55.866246 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:55.862746    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:55.955079 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:55.955029    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:56.166714 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:56.166601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:56.558074 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:56.558022    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:56.656847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:56.656815    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:57.078918 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.078598    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"]
Sep 10 21:09:57.083738 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.083717    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.088215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.088193    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-63f3d7-serving-cert\""
Sep 10 21:09:57.088749 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.088728    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rf2kh\""
Sep 10 21:09:57.088956 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.088939    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 21:09:57.089010 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.088977    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:09:57.089273 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.089259    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 21:09:57.099002 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.098978    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"]
Sep 10 21:09:57.107194 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.107162    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:57.126170 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.126135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-metrics-certs\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.126308 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.126211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bls8h\" (UniqueName: \"kubernetes.io/projected/58dd7130-e675-4849-9b2e-8637aa1d1c3a-kube-api-access-bls8h\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.126416 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.126320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.126416 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.126353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58dd7130-e675-4849-9b2e-8637aa1d1c3a-openshift-service-ca\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.209535 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.209498    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:57.227316 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.227285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.227443 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.227324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58dd7130-e675-4849-9b2e-8637aa1d1c3a-openshift-service-ca\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.227443 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.227395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-metrics-certs\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.227526 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:57.227442    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-serving-cert: secret "maas-api-e2e-autores-63f3d7-serving-cert" not found
Sep 10 21:09:57.227526 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.227443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bls8h\" (UniqueName: \"kubernetes.io/projected/58dd7130-e675-4849-9b2e-8637aa1d1c3a-kube-api-access-bls8h\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.227526 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:09:57.227507    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls podName:58dd7130-e675-4849-9b2e-8637aa1d1c3a nodeName:}" failed. No retries permitted until 2026-09-10 21:09:57.727485006 +0000 UTC m=+726.638764780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls") pod "maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz" (UID: "58dd7130-e675-4849-9b2e-8637aa1d1c3a") : secret "maas-api-e2e-autores-63f3d7-serving-cert" not found
Sep 10 21:09:57.228171 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.228152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58dd7130-e675-4849-9b2e-8637aa1d1c3a-openshift-service-ca\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.229914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.229891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-metrics-certs\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.237640 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.237619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bls8h\" (UniqueName: \"kubernetes.io/projected/58dd7130-e675-4849-9b2e-8637aa1d1c3a-kube-api-access-bls8h\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.320748 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.320716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:57.731336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.731301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.733777 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.733755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls\") pod \"maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:57.794865 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.794825    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:57.961796 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.961755    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:57.994434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:57.994348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:09:58.299056 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:58.299015    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"]
Sep 10 21:09:58.301189 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:09:58.301161    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dd7130_e675_4849_9b2e_8637aa1d1c3a.slice/crio-a9c4ab9f3810bfa8cba498df61386b07049625e6c96b9545ae27cc3b3b9f8d5e WatchSource:0}: Error finding container a9c4ab9f3810bfa8cba498df61386b07049625e6c96b9545ae27cc3b3b9f8d5e: Status 404 returned error can't find the container with id a9c4ab9f3810bfa8cba498df61386b07049625e6c96b9545ae27cc3b3b9f8d5e
Sep 10 21:09:58.697326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:58.697239    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:59.291878 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:59.291815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz" event={"ID":"58dd7130-e675-4849-9b2e-8637aa1d1c3a","Type":"ContainerStarted","Data":"a9c4ab9f3810bfa8cba498df61386b07049625e6c96b9545ae27cc3b3b9f8d5e"}
Sep 10 21:09:59.727111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:09:59.727071    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:00.870584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:00.870541    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:10:01.213455 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:01.213239    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:10:01.213455 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:01.213315    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:10:01.306688 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:01.306648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz" event={"ID":"58dd7130-e675-4849-9b2e-8637aa1d1c3a","Type":"ContainerStarted","Data":"0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554"}
Sep 10 21:10:01.306875 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:01.306825    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:10:01.872193 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:01.872158    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:02.007883 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:02.007826    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:02.099371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:02.099317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:02.200610 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:02.200513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:03.334785 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:03.334743    2558 generic.go:356] "Generic (PLEG): container finished" podID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerID="7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580" exitCode=0
Sep 10 21:10:03.335229 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:03.334954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" event={"ID":"0d1df40f-d935-487f-aaf9-0b4db34f3aa8","Type":"ContainerDied","Data":"7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580"}
Sep 10 21:10:03.335520 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:03.335503    2558 scope.go:117] "RemoveContainer" containerID="7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580"
Sep 10 21:10:03.336728 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:03.336697    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:03.336926 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:03.336902    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:03.337018 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:03.336949    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:03.366578 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:03.366504    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz" podStartSLOduration=3.815361321 podStartE2EDuration="6.366480855s" totalImagesPullingTime="2.551119534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:01.332546511 +0000 UTC m=+730.243826316" watchObservedRunningTime="2026-09-10 21:10:03.366480855 +0000 UTC m=+732.277760639"
Sep 10 21:10:04.343714 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:04.343662    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" event={"ID":"0d1df40f-d935-487f-aaf9-0b4db34f3aa8","Type":"ContainerStarted","Data":"0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231"}
Sep 10 21:10:04.960326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:04.960292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:05.336537 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:05.336503    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:10:05.336715 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:05.336622    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 21:10:05.336715 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:05.336670    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 21:10:06.336772 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:06.336728    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 21:10:06.337275 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:06.336793    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 21:10:06.402770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:06.402732    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:06.501352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:06.501319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:06.628964 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:06.628869    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:06.936921 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:06.936820    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:07.323506 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:07.323472    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:10:07.336298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:07.336253    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 21:10:07.336460 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:07.336322    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 21:10:08.336899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:08.336848    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 21:10:08.337503 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:08.336905    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 21:10:08.702508 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:08.702334    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:09.337172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:09.337101    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 21:10:09.337650 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:09.337174    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 21:10:10.281225 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:10.281183    2558 patch_prober.go:28] interesting pod/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:10:10.281394 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:10.281183    2558 patch_prober.go:28] interesting pod/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:10:10.281394 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:10.281281    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:10:10.281394 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:10.281286    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:10:10.336819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:10.336783    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 21:10:10.336989 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:10.336847    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 21:10:11.163254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.163205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:11.340997 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.340968    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:10:11.341307 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.341280    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:10:11.342163 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.342136    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:10:11.511897 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.511812    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:11.807816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.807777    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"]
Sep 10 21:10:11.817300 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.817269    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:11.820251 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.820227    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-000295-openshift-default-dockercfg-8ltzw\""
Sep 10 21:10:11.826064 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.826020    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"]
Sep 10 21:10:11.847690 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:11.847596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:12.002404 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-credential-socket\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istiod-ca-cert\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-certs\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-socket\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-podinfo\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002766 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-data\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002766 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002642    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-token\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002766 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phwpn\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-kube-api-access-phwpn\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.002875 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.002753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-envoy\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.040816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.040782    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:12.104194 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-socket\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104194 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104153    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-podinfo\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-data\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-token\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phwpn\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-kube-api-access-phwpn\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-envoy\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-credential-socket\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istiod-ca-cert\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-certs\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-socket\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.104861 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.104791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-certs\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.105368 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.105345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istiod-ca-cert\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.105531 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.105513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-data\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.105638 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.105622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-credential-socket\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.107290 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.107265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-podinfo\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.107688 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.107666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-envoy\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.113503 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.113477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-token\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.114353 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.114327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phwpn\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-kube-api-access-phwpn\") pod \"e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") " pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.132068 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.132027    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:12.417823 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.417794    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"]
Sep 10 21:10:12.419071 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:10:12.419030    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a3b314_115b_4afc_b597_1015dc3f5f1d.slice/crio-eef43e0cba8cfba90181b97aeafbdebd48ba157d4b0544af50c521c237c07691 WatchSource:0}: Error finding container eef43e0cba8cfba90181b97aeafbdebd48ba157d4b0544af50c521c237c07691: Status 404 returned error can't find the container with id eef43e0cba8cfba90181b97aeafbdebd48ba157d4b0544af50c521c237c07691
Sep 10 21:10:12.421514 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.421476    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:12.421610 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.421552    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:12.421610 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.421585    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:12.425354 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.425332    2558 generic.go:356] "Generic (PLEG): container finished" podID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerID="ff091c6efe6a354cc933b40db31b781c847919e11a025e2e13a5d4b84406e186" exitCode=0
Sep 10 21:10:12.425456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.425407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" event={"ID":"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4","Type":"ContainerDied","Data":"ff091c6efe6a354cc933b40db31b781c847919e11a025e2e13a5d4b84406e186"}
Sep 10 21:10:12.425763 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.425748    2558 scope.go:117] "RemoveContainer" containerID="ff091c6efe6a354cc933b40db31b781c847919e11a025e2e13a5d4b84406e186"
Sep 10 21:10:12.426727 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.426701    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:12.426806 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.426762    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:12.426806 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:12.426791    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:13.318327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.318294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:13.433727 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.433642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" event={"ID":"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4","Type":"ContainerStarted","Data":"f9637935a4fb914c94f82f92411cf819df7982aea9f42065afb7e28698dd5437"}
Sep 10 21:10:13.435271 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.435243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" event={"ID":"e2a3b314-115b-4afc-b597-1015dc3f5f1d","Type":"ContainerStarted","Data":"e2a228b50f0c3792d8a70c7ec7d71cbec2836598932a9fc4fe12311bb0b19abe"}
Sep 10 21:10:13.435384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.435293    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" event={"ID":"e2a3b314-115b-4afc-b597-1015dc3f5f1d","Type":"ContainerStarted","Data":"eef43e0cba8cfba90181b97aeafbdebd48ba157d4b0544af50c521c237c07691"}
Sep 10 21:10:13.436748 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.436727    2558 generic.go:356] "Generic (PLEG): container finished" podID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerID="43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c" exitCode=0
Sep 10 21:10:13.436826 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.436776    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" event={"ID":"45b3a771-5f81-4cb0-afa0-de722de4a875","Type":"ContainerDied","Data":"43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c"}
Sep 10 21:10:13.437120 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.437106    2558 scope.go:117] "RemoveContainer" containerID="43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c"
Sep 10 21:10:13.438038 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.438013    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:13.438112 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.438097    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:13.438151 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.438142    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:13.564896 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:13.564752    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podStartSLOduration=2.5640330049999998 podStartE2EDuration="2.564033005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:13.562073899 +0000 UTC m=+742.473353698" watchObservedRunningTime="2026-09-10 21:10:13.564033005 +0000 UTC m=+742.475312787"
Sep 10 21:10:14.133155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.133120    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:14.138652 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.138628    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:14.229029 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.228996    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:10:14.229521 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.229493    2558 patch_prober.go:28] interesting pod/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 21:10:14.229625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.229546    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 21:10:14.255200 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.255159    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.410642 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.410549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.446534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.446485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" event={"ID":"45b3a771-5f81-4cb0-afa0-de722de4a875","Type":"ContainerStarted","Data":"1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8"}
Sep 10 21:10:14.448062 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.448022    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:14.451791 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.451764    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:14.478385 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.478347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.564070 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.564023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.669342 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.669240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.770116 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:14.770079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:15.043217 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:15.043113    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:10:15.043400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:15.043250    2558 patch_prober.go:28] interesting pod/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:15.043400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:15.043293    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 21:10:15.229424 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:15.229385    2558 patch_prober.go:28] interesting pod/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 21:10:15.229606 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:15.229444    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 21:10:15.515759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:15.515722    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:15.616241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:15.616203    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:16.043432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:16.043396    2558 patch_prober.go:28] interesting pod/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:16.043724 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:16.043686    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 21:10:16.228558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:16.228505    2558 patch_prober.go:28] interesting pod/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 21:10:16.228776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:16.228625    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 21:10:16.709108 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:16.709071    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:16.798206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:16.798032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:16.907110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:16.907070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:17.042551 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:17.042450    2558 patch_prober.go:28] interesting pod/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:17.042551 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:17.042521    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 21:10:17.229404 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:17.229362    2558 patch_prober.go:28] interesting pod/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 21:10:17.229600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:17.229423    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 21:10:17.424144 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:17.424097    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:17.527293 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:17.527252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:17.981404 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:17.981343    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:18.042899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:18.042862    2558 patch_prober.go:28] interesting pod/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:18.043220 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:18.043167    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 21:10:18.229520 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:18.229488    2558 patch_prober.go:28] interesting pod/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 21:10:18.229734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:18.229713    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 21:10:18.891927 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:18.891890    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:19.042869 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:19.042830    2558 patch_prober.go:28] interesting pod/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:19.043495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:19.043459    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 21:10:19.232723 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:19.232633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:10:19.232940 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:19.232921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:10:19.233727 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:19.233709    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:10:19.834207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:19.834171    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:20.047575 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:20.047539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:10:20.048037 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:20.047926    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:10:20.048872 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:20.048853    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:10:20.909327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:20.909291    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:21.177455 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:21.177360    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:10:22.285180 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:22.285145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:23.322972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:23.322940    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:23.469893 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:23.469860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:25.441099 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:25.441066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:30.489287 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:30.489196    2558 patch_prober.go:28] interesting pod/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:10:30.489658 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:30.489280    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:10:32.590751 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:32.590717    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerID="e2a228b50f0c3792d8a70c7ec7d71cbec2836598932a9fc4fe12311bb0b19abe" exitCode=0
Sep 10 21:10:32.590751 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:32.590755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" event={"ID":"e2a3b314-115b-4afc-b597-1015dc3f5f1d","Type":"ContainerDied","Data":"e2a228b50f0c3792d8a70c7ec7d71cbec2836598932a9fc4fe12311bb0b19abe"}
Sep 10 21:10:32.591245 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:32.591225    2558 scope.go:117] "RemoveContainer" containerID="e2a228b50f0c3792d8a70c7ec7d71cbec2836598932a9fc4fe12311bb0b19abe"
Sep 10 21:10:32.592296 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:32.592266    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:32.592362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:32.592337    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:32.592403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:32.592372    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:33.600874 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:33.600840    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" event={"ID":"e2a3b314-115b-4afc-b597-1015dc3f5f1d","Type":"ContainerStarted","Data":"1362a3f15fa103ad638f6fd03a3c0cad18ff3b3cca317551243e1b447a25db5d"}
Sep 10 21:10:33.611408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:33.611376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:33.712550 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:33.712509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:34.132538 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:34.132505    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:34.132708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:34.132627    2558 patch_prober.go:28] interesting pod/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 21:10:34.132708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:34.132687    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 21:10:35.133377 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:35.133335    2558 patch_prober.go:28] interesting pod/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 21:10:35.133760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:35.133410    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 21:10:36.133276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:36.133240    2558 patch_prober.go:28] interesting pod/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 21:10:36.133461 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:36.133296    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 21:10:36.367110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:36.367074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:37.004074 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.004012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:37.084481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.084439    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:37.132778 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.132742    2558 patch_prober.go:28] interesting pod/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 21:10:37.132955 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.132804    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 21:10:37.184413 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.184372    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:37.287326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.287236    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:37.401906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.401864    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"]
Sep 10 21:10:37.402120 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.402094    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy" containerID="cri-o://f9637935a4fb914c94f82f92411cf819df7982aea9f42065afb7e28698dd5437" gracePeriod=30
Sep 10 21:10:37.427316 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.427285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:37.889474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.889434    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:37.978735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:37.978703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:38.078806 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.078761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:38.133146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.133106    2558 patch_prober.go:28] interesting pod/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 10 21:10:38.133313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.133167    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 10 21:10:38.513460 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.513420    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"]
Sep 10 21:10:38.516209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.516186    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.518675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.518657    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a7bbcc15-gw-openshift-default-dockercfg-cl9t5\""
Sep 10 21:10:38.541318 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.541288    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"]
Sep 10 21:10:38.576543 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.576510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:38.588397 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istiod-ca-cert\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588573 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-podinfo\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588573 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq2r4\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-kube-api-access-qq2r4\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588573 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-credential-socket\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588573 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-socket\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-envoy\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-certs\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-data\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.588770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.588749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-token\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.670966 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.670928    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:38.690060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-certs\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690257 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-data\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690257 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-token\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690382 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690306    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istiod-ca-cert\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690382 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-podinfo\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq2r4\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-kube-api-access-qq2r4\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690454    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-credential-socket\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690593 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690484    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-socket\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690593 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690505    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-certs\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690593 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-envoy\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-data\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.690773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-credential-socket\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.691007 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.690976    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-socket\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.691199 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.691177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istiod-ca-cert\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.693653 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.693619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-envoy\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.693802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.693782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-podinfo\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.702020 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.701975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-token\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.702698 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.702679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq2r4\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-kube-api-access-qq2r4\") pod \"e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") " pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:38.825780 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:38.825740    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:39.107238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.107208    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"]
Sep 10 21:10:39.108617 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:10:39.108593    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d097fc_47e9_4161_bd5c_f7e85fef1fb8.slice/crio-22f1139213613cc9b8d7d166a0422f2cee6eaa553e6515d4c563e378d29afa07 WatchSource:0}: Error finding container 22f1139213613cc9b8d7d166a0422f2cee6eaa553e6515d4c563e378d29afa07: Status 404 returned error can't find the container with id 22f1139213613cc9b8d7d166a0422f2cee6eaa553e6515d4c563e378d29afa07
Sep 10 21:10:39.110922 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.110887    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:39.111028 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.110975    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:39.111028 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.111007    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:10:39.136667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.136634    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:39.136943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.136919    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:39.137643 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.137626    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:10:39.633888 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.633848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" event={"ID":"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8","Type":"ContainerStarted","Data":"3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac"}
Sep 10 21:10:39.634338 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.633919    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" event={"ID":"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8","Type":"ContainerStarted","Data":"22f1139213613cc9b8d7d166a0422f2cee6eaa553e6515d4c563e378d29afa07"}
Sep 10 21:10:39.660911 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.660856    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podStartSLOduration=1.660836904 podStartE2EDuration="1.660836904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:39.656695859 +0000 UTC m=+768.567975658" watchObservedRunningTime="2026-09-10 21:10:39.660836904 +0000 UTC m=+768.572116686"
Sep 10 21:10:39.826538 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:39.826503    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:40.540161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:40.540123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:40.831712 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:40.831679    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:41.178912 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.178819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:41.275432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.275397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:41.352863 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.352829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:41.407396 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.407366    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:10:41.417882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.417853    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:41.529160 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.529065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:41.646237 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.646198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:41.647241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.647211    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:10:41.915943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:41.915911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:42.028465 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.028423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:42.654523 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.654494    2558 generic.go:356] "Generic (PLEG): container finished" podID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerID="f9637935a4fb914c94f82f92411cf819df7982aea9f42065afb7e28698dd5437" exitCode=0
Sep 10 21:10:42.654651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.654566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" event={"ID":"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4","Type":"ContainerDied","Data":"f9637935a4fb914c94f82f92411cf819df7982aea9f42065afb7e28698dd5437"}
Sep 10 21:10:42.654651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.654619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9" event={"ID":"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4","Type":"ContainerDied","Data":"f380b47e7cdbbf8349d24ec1b51d46ad5ff0a0f2e8aa772e763ad368f0fa7b94"}
Sep 10 21:10:42.654651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.654636    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f380b47e7cdbbf8349d24ec1b51d46ad5ff0a0f2e8aa772e763ad368f0fa7b94"
Sep 10 21:10:42.654651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.654650    2558 scope.go:117] "RemoveContainer" containerID="ff091c6efe6a354cc933b40db31b781c847919e11a025e2e13a5d4b84406e186"
Sep 10 21:10:42.662223 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.662197    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:10:42.841534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841499    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nrhn\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-kube-api-access-9nrhn\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841540    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-credential-socket\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841619    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-token\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841691    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-certs\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841736    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-socket\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841762    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istiod-ca-cert\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841797    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-podinfo\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841805    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:42.841987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841825    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-envoy\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.841987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.841854    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-data\") pod \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\" (UID: \"76658d9f-ccd8-46a2-9a9b-09291c4fdcd4\") "
Sep 10 21:10:42.842876 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.842259    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:42.842876 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.842288    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:42.842876 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.842446    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.842876 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.842469    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.842876 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.842483    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.843225 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.843123    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:42.844556 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.844521    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:42.845019 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.844989    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:10:42.846524 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.846496    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:10:42.846754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.846731    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-kube-api-access-9nrhn" (OuterVolumeSpecName: "kube-api-access-9nrhn") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "kube-api-access-9nrhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:42.846875 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.846849    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" (UID: "76658d9f-ccd8-46a2-9a9b-09291c4fdcd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:42.943726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.943615    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nrhn\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-kube-api-access-9nrhn\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.943726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.943660    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.943726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.943678    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.943726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.943692    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.943726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.943705    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:42.943726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:42.943721    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:10:43.661972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:43.661938    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"
Sep 10 21:10:43.695663 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:43.695631    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"]
Sep 10 21:10:43.701037 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:43.701013    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1a398fc7-openshift-default-7fd7ff976d-tqxh9"]
Sep 10 21:10:45.614703 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:10:45.614659    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" path="/var/lib/kubelet/pods/76658d9f-ccd8-46a2-9a9b-09291c4fdcd4/volumes"
Sep 10 21:11:00.718850 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:00.718814    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:11:01.770167 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:01.770135    2558 generic.go:356] "Generic (PLEG): container finished" podID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerID="3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac" exitCode=0
Sep 10 21:11:01.770602 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:01.770209    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" event={"ID":"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8","Type":"ContainerDied","Data":"3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac"}
Sep 10 21:11:01.770650 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:01.770614    2558 scope.go:117] "RemoveContainer" containerID="3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac"
Sep 10 21:11:01.771740 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:01.771709    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:01.771848 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:01.771796    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:01.771848 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:01.771843    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:02.778605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:02.778574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" event={"ID":"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8","Type":"ContainerStarted","Data":"dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f"}
Sep 10 21:11:02.826268 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:02.826239    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:11:02.826457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:02.826435    2558 patch_prober.go:28] interesting pod/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:02.826560 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:02.826542    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 21:11:03.826488 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:03.826451    2558 patch_prober.go:28] interesting pod/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:03.826864 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:03.826538    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 21:11:04.826373 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:04.826337    2558 patch_prober.go:28] interesting pod/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:04.826543 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:04.826393    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 21:11:05.826728 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:05.826695    2558 patch_prober.go:28] interesting pod/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:05.827120 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:05.826751    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 21:11:06.827029 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:06.826992    2558 patch_prober.go:28] interesting pod/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:06.827454 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:06.827061    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 21:11:07.826973 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:07.826936    2558 patch_prober.go:28] interesting pod/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:07.827177 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:07.827004    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 21:11:08.830361 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:08.830330    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:11:08.830786 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:08.830732    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:11:08.831487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:08.831467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:11:12.707814 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:12.707781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:12.777103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:12.777039    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:12.832725 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:12.832687    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:12.926181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:12.926153    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:13.012554 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.012469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:13.126183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.126149    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"]
Sep 10 21:11:13.126389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.126364    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy" containerID="cri-o://dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f" gracePeriod=30
Sep 10 21:11:13.144812 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.144781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:13.559331 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.559295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:13.840604 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.840497    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"]
Sep 10 21:11:13.841153 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.841094    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy"
Sep 10 21:11:13.841153 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.841115    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy"
Sep 10 21:11:13.841153 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.841145    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy"
Sep 10 21:11:13.841153 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.841154    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy"
Sep 10 21:11:13.841389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.841258    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy"
Sep 10 21:11:13.841389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.841270    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="76658d9f-ccd8-46a2-9a9b-09291c4fdcd4" containerName="istio-proxy"
Sep 10 21:11:13.843765 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.843738    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.847492 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.847139    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b1749e9a-openshift-default-dockercfg-zkrkb\""
Sep 10 21:11:13.859542 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.859516    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"]
Sep 10 21:11:13.865110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.865082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.948616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-data\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.948676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-podinfo\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.948730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-token\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.948816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-envoy\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.948862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-socket\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.948886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkr6n\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-kube-api-access-nkr6n\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.948969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf0a9504-af76-48d1-af51-eb1d63ccba85-istiod-ca-cert\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.949028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-credential-socket\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:13.949066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:13.949070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-certs\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-data\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-podinfo\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050282 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050090    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-token\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050282 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-envoy\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050282 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-socket\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050439 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr6n\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-kube-api-access-nkr6n\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050439 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf0a9504-af76-48d1-af51-eb1d63ccba85-istiod-ca-cert\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-credential-socket\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-certs\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-data\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050698 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050577    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-socket\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.050891 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-credential-socket\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.051009 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.050916    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-certs\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.051192 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.051172    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf0a9504-af76-48d1-af51-eb1d63ccba85-istiod-ca-cert\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.052575 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.052550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-envoy\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.052792 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.052773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-podinfo\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.062830 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.062809    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-token\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.063180 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.063161    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkr6n\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-kube-api-access-nkr6n\") pod \"e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") " pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.117362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.117263    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:14.157653 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.157625    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:14.438793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.438680    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"]
Sep 10 21:11:14.439364 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:11:14.439326    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0a9504_af76_48d1_af51_eb1d63ccba85.slice/crio-d6a621131276ed65609b732f678d0054b2bc9313cf0590130aaf1b5fee23f43e WatchSource:0}: Error finding container d6a621131276ed65609b732f678d0054b2bc9313cf0590130aaf1b5fee23f43e: Status 404 returned error can't find the container with id d6a621131276ed65609b732f678d0054b2bc9313cf0590130aaf1b5fee23f43e
Sep 10 21:11:14.441851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.441808    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:14.441969 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.441942    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:14.444471 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.442024    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:14.850478 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.850433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" event={"ID":"bf0a9504-af76-48d1-af51-eb1d63ccba85","Type":"ContainerStarted","Data":"3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3"}
Sep 10 21:11:14.850901 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.850500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" event={"ID":"bf0a9504-af76-48d1-af51-eb1d63ccba85","Type":"ContainerStarted","Data":"d6a621131276ed65609b732f678d0054b2bc9313cf0590130aaf1b5fee23f43e"}
Sep 10 21:11:14.874114 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:14.874061    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" podStartSLOduration=1.874026091 podStartE2EDuration="1.874026091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:14.871633107 +0000 UTC m=+803.782912889" watchObservedRunningTime="2026-09-10 21:11:14.874026091 +0000 UTC m=+803.785305872"
Sep 10 21:11:15.158773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:15.158674    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:15.163581 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:15.163553    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:15.809683 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:15.809639    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:11:15.856988 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:15.856945    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:15.857952 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:15.857929    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:16.299760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:16.299730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:16.407988 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:16.407958    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:16.502671 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:16.502642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:17.452682 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.452641    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"]
Sep 10 21:11:17.455389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.455367    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.457849 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.457828    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b1749e9a-serving-cert\""
Sep 10 21:11:17.468818 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.468791    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"]
Sep 10 21:11:17.485797 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.485765    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:17.545120 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.545084    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:17.581902 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.581867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-maas-api-tls\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.582098 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.581912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ljst\" (UniqueName: \"kubernetes.io/projected/a2369846-4f25-4207-99b1-0ade921b851e-kube-api-access-7ljst\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.582098 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.581942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-metrics-certs\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.582098 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.582060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2369846-4f25-4207-99b1-0ade921b851e-openshift-service-ca\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.646413 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.646377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:17.682810 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.682774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ljst\" (UniqueName: \"kubernetes.io/projected/a2369846-4f25-4207-99b1-0ade921b851e-kube-api-access-7ljst\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.683001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.682830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-metrics-certs\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.683001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.682909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2369846-4f25-4207-99b1-0ade921b851e-openshift-service-ca\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.683001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.682982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-maas-api-tls\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.683565 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.683541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2369846-4f25-4207-99b1-0ade921b851e-openshift-service-ca\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.685362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.685339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-metrics-certs\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.685667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.685646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-maas-api-tls\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.691332 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.691306    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ljst\" (UniqueName: \"kubernetes.io/projected/a2369846-4f25-4207-99b1-0ade921b851e-kube-api-access-7ljst\") pod \"maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:17.766992 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:17.766894    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:18.047983 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.047960    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"]
Sep 10 21:11:18.051413 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:11:18.051387    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2369846_4f25_4207_99b1_0ade921b851e.slice/crio-4f62c2a8013b31a09683dbb5261b720b709600defd0c743d8736a0a4b9b69953 WatchSource:0}: Error finding container 4f62c2a8013b31a09683dbb5261b720b709600defd0c743d8736a0a4b9b69953: Status 404 returned error can't find the container with id 4f62c2a8013b31a09683dbb5261b720b709600defd0c743d8736a0a4b9b69953
Sep 10 21:11:18.146382 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.146230    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:18.249361 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.249321    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:18.370503 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.370477    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:11:18.494258 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494225    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-envoy\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494286    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-data\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494365    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-credential-socket\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494392    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-socket\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-certs\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494469    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-podinfo\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494507    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq2r4\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-kube-api-access-qq2r4\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494511    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494545    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-token\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494580    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istiod-ca-cert\") pod \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\" (UID: \"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8\") "
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494676    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:18.494699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494686    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:18.495209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494898    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.495209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494917    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.495209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494933    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.495209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494951    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:18.495209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.494995    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:18.496656 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.496626    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:11:18.496793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.496658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:18.496863 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.496847    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:18.496961 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.496940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-kube-api-access-qq2r4" (OuterVolumeSpecName: "kube-api-access-qq2r4") pod "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" (UID: "c1d097fc-47e9-4161-bd5c-f7e85fef1fb8"). InnerVolumeSpecName "kube-api-access-qq2r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:18.596408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.596357    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.596408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.596400    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.596408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.596411    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.596408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.596420    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq2r4\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-kube-api-access-qq2r4\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.596702 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.596430    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.596702 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.596440    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:18.876870 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.876833    2558 generic.go:356] "Generic (PLEG): container finished" podID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerID="dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f" exitCode=0
Sep 10 21:11:18.877080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.876900    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"
Sep 10 21:11:18.877080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.876922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" event={"ID":"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8","Type":"ContainerDied","Data":"dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f"}
Sep 10 21:11:18.877080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.876989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz" event={"ID":"c1d097fc-47e9-4161-bd5c-f7e85fef1fb8","Type":"ContainerDied","Data":"22f1139213613cc9b8d7d166a0422f2cee6eaa553e6515d4c563e378d29afa07"}
Sep 10 21:11:18.877080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.877015    2558 scope.go:117] "RemoveContainer" containerID="dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f"
Sep 10 21:11:18.878798 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.878774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg" event={"ID":"a2369846-4f25-4207-99b1-0ade921b851e","Type":"ContainerStarted","Data":"02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94"}
Sep 10 21:11:18.878910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.878819    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg" event={"ID":"a2369846-4f25-4207-99b1-0ade921b851e","Type":"ContainerStarted","Data":"4f62c2a8013b31a09683dbb5261b720b709600defd0c743d8736a0a4b9b69953"}
Sep 10 21:11:18.878910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.878844    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:18.887564 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.887546    2558 scope.go:117] "RemoveContainer" containerID="3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac"
Sep 10 21:11:18.895609 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.895592    2558 scope.go:117] "RemoveContainer" containerID="dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f"
Sep 10 21:11:18.895868 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:11:18.895849    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f\": container with ID starting with dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f not found: ID does not exist" containerID="dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f"
Sep 10 21:11:18.895910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.895876    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f"} err="failed to get container status \"dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f\": rpc error: code = NotFound desc = could not find container \"dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f\": container with ID starting with dd3b077cefe500f4b075f573b4bb14528e39ca3dbc9c0d269a6361c6fa19b33f not found: ID does not exist"
Sep 10 21:11:18.895910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.895895    2558 scope.go:117] "RemoveContainer" containerID="3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac"
Sep 10 21:11:18.896174 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:11:18.896157    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac\": container with ID starting with 3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac not found: ID does not exist" containerID="3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac"
Sep 10 21:11:18.896229 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.896180    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac"} err="failed to get container status \"3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac\": rpc error: code = NotFound desc = could not find container \"3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac\": container with ID starting with 3b5959d07b43c0e60ff2299a70cbe6fa4c0f19dec68bb81141564b2a91ebc9ac not found: ID does not exist"
Sep 10 21:11:18.902617 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.902576    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg" podStartSLOduration=1.580227128 podStartE2EDuration="1.902562917s" totalImagesPullingTime="322.335789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:18.901160882 +0000 UTC m=+807.812440689" watchObservedRunningTime="2026-09-10 21:11:18.902562917 +0000 UTC m=+807.813842699"
Sep 10 21:11:18.922384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.922353    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"]
Sep 10 21:11:18.927608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:18.927584    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a7bbcc15-gw-openshift-default-6b5596868d-d6cjz"]
Sep 10 21:11:19.614892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:19.614856    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" path="/var/lib/kubelet/pods/c1d097fc-47e9-4161-bd5c-f7e85fef1fb8/volumes"
Sep 10 21:11:24.892416 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:24.892388    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:32.403216 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:32.403179    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:11:34.979036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:34.979003    2558 generic.go:356] "Generic (PLEG): container finished" podID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerID="3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3" exitCode=0
Sep 10 21:11:34.979485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:34.979078    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" event={"ID":"bf0a9504-af76-48d1-af51-eb1d63ccba85","Type":"ContainerDied","Data":"3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3"}
Sep 10 21:11:34.979485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:34.979428    2558 scope.go:117] "RemoveContainer" containerID="3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3"
Sep 10 21:11:34.980669 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:34.980634    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:34.980752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:34.980709    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:34.980752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:34.980742    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:35.986625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:35.986587    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" event={"ID":"bf0a9504-af76-48d1-af51-eb1d63ccba85","Type":"ContainerStarted","Data":"8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02"}
Sep 10 21:11:36.159399 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:36.158909    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:36.159399 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:36.159064    2558 patch_prober.go:28] interesting pod/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 21:11:36.159399 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:36.159127    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 21:11:37.158636 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:37.158587    2558 patch_prober.go:28] interesting pod/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 21:11:37.159163 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:37.158667    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 21:11:38.158898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:38.158853    2558 patch_prober.go:28] interesting pod/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 21:11:38.159411 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:38.158924    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 21:11:39.159151 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:39.159106    2558 patch_prober.go:28] interesting pod/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 21:11:39.159719 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:39.159677    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 21:11:40.158449 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:40.158400    2558 patch_prober.go:28] interesting pod/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 21:11:40.158671 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:40.158482    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 21:11:41.332776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:41.332738    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:41.333440 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:41.333413    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:41.334141 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:41.334125    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:41.943127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:41.943079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:47.838746 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:47.838710    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:48.169730 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.169646    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"]
Sep 10 21:11:48.169881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.169841    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg" podUID="a2369846-4f25-4207-99b1-0ade921b851e" containerName="maas-api" containerID="cri-o://02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94" gracePeriod=30
Sep 10 21:11:48.201977 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.201946    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:48.264760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.264723    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:48.327948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.327908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:48.400310 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.400275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:48.426483 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.426424    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:48.463905 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.463858    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:48.493073 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.493011    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-maas-api-tls\") pod \"a2369846-4f25-4207-99b1-0ade921b851e\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") "
Sep 10 21:11:48.493265 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.493122    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2369846-4f25-4207-99b1-0ade921b851e-openshift-service-ca\") pod \"a2369846-4f25-4207-99b1-0ade921b851e\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") "
Sep 10 21:11:48.493265 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.493183    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ljst\" (UniqueName: \"kubernetes.io/projected/a2369846-4f25-4207-99b1-0ade921b851e-kube-api-access-7ljst\") pod \"a2369846-4f25-4207-99b1-0ade921b851e\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") "
Sep 10 21:11:48.493265 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.493237    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-metrics-certs\") pod \"a2369846-4f25-4207-99b1-0ade921b851e\" (UID: \"a2369846-4f25-4207-99b1-0ade921b851e\") "
Sep 10 21:11:48.493543 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.493515    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2369846-4f25-4207-99b1-0ade921b851e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2369846-4f25-4207-99b1-0ade921b851e" (UID: "a2369846-4f25-4207-99b1-0ade921b851e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:48.495345 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.495318    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2369846-4f25-4207-99b1-0ade921b851e" (UID: "a2369846-4f25-4207-99b1-0ade921b851e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:48.495454 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.495412    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a2369846-4f25-4207-99b1-0ade921b851e" (UID: "a2369846-4f25-4207-99b1-0ade921b851e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:48.495454 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.495425    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2369846-4f25-4207-99b1-0ade921b851e-kube-api-access-7ljst" (OuterVolumeSpecName: "kube-api-access-7ljst") pod "a2369846-4f25-4207-99b1-0ade921b851e" (UID: "a2369846-4f25-4207-99b1-0ade921b851e"). InnerVolumeSpecName "kube-api-access-7ljst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:48.594812 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.594770    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2369846-4f25-4207-99b1-0ade921b851e-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:48.594812 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.594811    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ljst\" (UniqueName: \"kubernetes.io/projected/a2369846-4f25-4207-99b1-0ade921b851e-kube-api-access-7ljst\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:48.595018 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.594827    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:48.595018 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:48.594843    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2369846-4f25-4207-99b1-0ade921b851e-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:49.063654 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.063623    2558 generic.go:356] "Generic (PLEG): container finished" podID="a2369846-4f25-4207-99b1-0ade921b851e" containerID="02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94" exitCode=0
Sep 10 21:11:49.064031 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.063670    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"
Sep 10 21:11:49.064031 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.063705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg" event={"ID":"a2369846-4f25-4207-99b1-0ade921b851e","Type":"ContainerDied","Data":"02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94"}
Sep 10 21:11:49.064031 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.063760    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg" event={"ID":"a2369846-4f25-4207-99b1-0ade921b851e","Type":"ContainerDied","Data":"4f62c2a8013b31a09683dbb5261b720b709600defd0c743d8736a0a4b9b69953"}
Sep 10 21:11:49.064031 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.063785    2558 scope.go:117] "RemoveContainer" containerID="02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94"
Sep 10 21:11:49.073782 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.073764    2558 scope.go:117] "RemoveContainer" containerID="02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94"
Sep 10 21:11:49.074115 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:11:49.074090    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94\": container with ID starting with 02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94 not found: ID does not exist" containerID="02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94"
Sep 10 21:11:49.074172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.074131    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94"} err="failed to get container status \"02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94\": rpc error: code = NotFound desc = could not find container \"02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94\": container with ID starting with 02a00be2724d5b67d5bbcfd92b354e01271112df3596fd2903513c1401c29a94 not found: ID does not exist"
Sep 10 21:11:49.093415 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.093382    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"]
Sep 10 21:11:49.097507 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.097482    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b1749e9a-5bffb97bb6-82wmg"]
Sep 10 21:11:49.615946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.615912    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2369846-4f25-4207-99b1-0ade921b851e" path="/var/lib/kubelet/pods/a2369846-4f25-4207-99b1-0ade921b851e/volumes"
Sep 10 21:11:49.801007 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.800974    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"]
Sep 10 21:11:49.801222 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.801201    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy" containerID="cri-o://8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02" gracePeriod=30
Sep 10 21:11:49.811198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:49.811174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:50.325474 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.325439    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:50.619847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.619771    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"]
Sep 10 21:11:50.620183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620168    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy"
Sep 10 21:11:50.620235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620185    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy"
Sep 10 21:11:50.620235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620204    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy"
Sep 10 21:11:50.620235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620213    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy"
Sep 10 21:11:50.620235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620227    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2369846-4f25-4207-99b1-0ade921b851e" containerName="maas-api"
Sep 10 21:11:50.620235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620232    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2369846-4f25-4207-99b1-0ade921b851e" containerName="maas-api"
Sep 10 21:11:50.620384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620303    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy"
Sep 10 21:11:50.620384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620311    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d097fc-47e9-4161-bd5c-f7e85fef1fb8" containerName="istio-proxy"
Sep 10 21:11:50.620384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.620318    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2369846-4f25-4207-99b1-0ade921b851e" containerName="maas-api"
Sep 10 21:11:50.624789 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.624771    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.627716 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.627697    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7b642ff4-openshift-default-dockercfg-8xnfw\""
Sep 10 21:11:50.641352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.641326    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"]
Sep 10 21:11:50.648906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.648875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:50.714103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-credential-socket\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714113    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-certs\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-socket\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istiod-ca-cert\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-token\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6wlc\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-kube-api-access-c6wlc\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714614 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-data\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714614 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714429    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-podinfo\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.714614 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.714464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-envoy\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.815917 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.815880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-data\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.815917 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.815920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-podinfo\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.815945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-envoy\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.815998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-credential-socket\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-certs\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-socket\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istiod-ca-cert\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-token\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816545 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6wlc\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-kube-api-access-c6wlc\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816545 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-data\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816545 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-certs\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-socket\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816822 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-credential-socket\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.816870 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.816817    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istiod-ca-cert\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.818326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.818305    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-envoy\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.818423 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.818394    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-podinfo\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.825117 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.825093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-token\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.825262 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.825243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6wlc\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-kube-api-access-c6wlc\") pod \"e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") " pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:50.849192 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.849143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:50.934331 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:50.934243    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:51.218750 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:51.218725    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"]
Sep 10 21:11:51.219611 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:11:51.219585    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1a15a1_2586_4ce2_848d_e1fc57c642ec.slice/crio-cc16798a27d79767475fb5090514a4538477febb78f9eb127fed0eea2008592d WatchSource:0}: Error finding container cc16798a27d79767475fb5090514a4538477febb78f9eb127fed0eea2008592d: Status 404 returned error can't find the container with id cc16798a27d79767475fb5090514a4538477febb78f9eb127fed0eea2008592d
Sep 10 21:11:51.222288 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:51.222256    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:51.222388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:51.222325    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:51.222388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:51.222352    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:11:51.823540 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:51.823500    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:11:52.087848 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:52.087743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" event={"ID":"ad1a15a1-2586-4ce2-848d-e1fc57c642ec","Type":"ContainerStarted","Data":"6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1"}
Sep 10 21:11:52.087848 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:52.087843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" event={"ID":"ad1a15a1-2586-4ce2-848d-e1fc57c642ec","Type":"ContainerStarted","Data":"cc16798a27d79767475fb5090514a4538477febb78f9eb127fed0eea2008592d"}
Sep 10 21:11:52.112301 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:52.112239    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" podStartSLOduration=2.112215497 podStartE2EDuration="2.112215497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:52.109850508 +0000 UTC m=+841.021130315" watchObservedRunningTime="2026-09-10 21:11:52.112215497 +0000 UTC m=+841.023495280"
Sep 10 21:11:52.935522 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:52.935482    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:52.941684 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:52.941648    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:53.094623 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:53.094589    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:53.095662 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:53.095638    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:11:53.549569 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:53.549533    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:53.644520 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:53.644475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:54.825107 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.825037    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"]
Sep 10 21:11:54.828877 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.828857    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:54.831598 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.831575    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-7b642ff4-serving-cert\""
Sep 10 21:11:54.851506 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.851481    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"]
Sep 10 21:11:54.904860 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.904822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:54.955425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.955393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:54.955595 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.955545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-openshift-service-ca\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:54.955647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.955593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frwn8\" (UniqueName: \"kubernetes.io/projected/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-kube-api-access-frwn8\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:54.955684 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:54.955655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-metrics-certs\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.001478 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.001444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:55.055546 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.055518    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:55.056146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.056123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-openshift-service-ca\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.056282 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.056173    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frwn8\" (UniqueName: \"kubernetes.io/projected/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-kube-api-access-frwn8\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.056282 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.056209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-metrics-certs\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.056282 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.056248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.056423 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:11:55.056402    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-serving-cert: secret "maas-api-e2e-derive-7b642ff4-serving-cert" not found
Sep 10 21:11:55.056494 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:11:55.056482    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls podName:26190b6c-ea7d-4b23-95e5-48bbaebd72a2 nodeName:}" failed. No retries permitted until 2026-09-10 21:11:55.556457438 +0000 UTC m=+844.467737198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls") pod "maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k" (UID: "26190b6c-ea7d-4b23-95e5-48bbaebd72a2") : secret "maas-api-e2e-derive-7b642ff4-serving-cert" not found
Sep 10 21:11:55.056788 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.056768    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-openshift-service-ca\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.058675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.058653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-metrics-certs\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.066700 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.066644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frwn8\" (UniqueName: \"kubernetes.io/projected/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-kube-api-access-frwn8\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.109154 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.109115    2558 generic.go:356] "Generic (PLEG): container finished" podID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerID="8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02" exitCode=0
Sep 10 21:11:55.109336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.109167    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"
Sep 10 21:11:55.109336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.109196    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" event={"ID":"bf0a9504-af76-48d1-af51-eb1d63ccba85","Type":"ContainerDied","Data":"8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02"}
Sep 10 21:11:55.109336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.109257    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp" event={"ID":"bf0a9504-af76-48d1-af51-eb1d63ccba85","Type":"ContainerDied","Data":"d6a621131276ed65609b732f678d0054b2bc9313cf0590130aaf1b5fee23f43e"}
Sep 10 21:11:55.109336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.109287    2558 scope.go:117] "RemoveContainer" containerID="8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02"
Sep 10 21:11:55.118225 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.118189    2558 scope.go:117] "RemoveContainer" containerID="3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3"
Sep 10 21:11:55.126606 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.126584    2558 scope.go:117] "RemoveContainer" containerID="8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02"
Sep 10 21:11:55.126914 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:11:55.126893    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02\": container with ID starting with 8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02 not found: ID does not exist" containerID="8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02"
Sep 10 21:11:55.126962 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.126925    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02"} err="failed to get container status \"8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02\": rpc error: code = NotFound desc = could not find container \"8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02\": container with ID starting with 8d4678dfe99e85f1468c3d4a242ea7d9153a3218574692bdd229f15db0f29d02 not found: ID does not exist"
Sep 10 21:11:55.126962 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.126943    2558 scope.go:117] "RemoveContainer" containerID="3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3"
Sep 10 21:11:55.127213 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:11:55.127192    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3\": container with ID starting with 3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3 not found: ID does not exist" containerID="3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3"
Sep 10 21:11:55.127263 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.127220    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3"} err="failed to get container status \"3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3\": rpc error: code = NotFound desc = could not find container \"3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3\": container with ID starting with 3f1f51bf65f4c96162f7274d22b8b776b66a15c84ff7dabce3eeacc62d8360f3 not found: ID does not exist"
Sep 10 21:11:55.157281 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157246    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-data\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157314    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-podinfo\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157343    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-envoy\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157358    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf0a9504-af76-48d1-af51-eb1d63ccba85-istiod-ca-cert\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157401    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-socket\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157432 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157425    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-certs\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157513    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:55.157761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157529    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-credential-socket\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157687    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:55.157761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157718    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkr6n\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-kube-api-access-nkr6n\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157745    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:55.157978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157752    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-token\") pod \"bf0a9504-af76-48d1-af51-eb1d63ccba85\" (UID: \"bf0a9504-af76-48d1-af51-eb1d63ccba85\") "
Sep 10 21:11:55.157978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157795    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:55.157978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.157860    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf0a9504-af76-48d1-af51-eb1d63ccba85-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:55.158215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.158105    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.158215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.158120    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.158215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.158129    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.158215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.158138    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.158215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.158147    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf0a9504-af76-48d1-af51-eb1d63ccba85-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.159718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.159692    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:11:55.159811 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.159717    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:55.159914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.159895    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-kube-api-access-nkr6n" (OuterVolumeSpecName: "kube-api-access-nkr6n") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "kube-api-access-nkr6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:55.159914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.159905    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf0a9504-af76-48d1-af51-eb1d63ccba85" (UID: "bf0a9504-af76-48d1-af51-eb1d63ccba85"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:11:55.222568 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.222536    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:55.263160 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.259224    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.263160 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.259259    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.263160 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.259282    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkr6n\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-kube-api-access-nkr6n\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.263160 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.259317    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf0a9504-af76-48d1-af51-eb1d63ccba85-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:55.383543 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.383460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:55.436371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.436336    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"]
Sep 10 21:11:55.438693 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.438673    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b1749e9a-openshift-default-59d9f7cf6d-2n2dp"]
Sep 10 21:11:55.444076 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.444020    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:55.562329 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.562293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.564935 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.564901    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls\") pod \"maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:55.619951 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.619908    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" path="/var/lib/kubelet/pods/bf0a9504-af76-48d1-af51-eb1d63ccba85/volumes"
Sep 10 21:11:55.782905 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:55.782816    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:56.060909 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:56.060882    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"]
Sep 10 21:11:56.061946 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:11:56.061921    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26190b6c_ea7d_4b23_95e5_48bbaebd72a2.slice/crio-1e361fec65803de6b898ed45d83a4ef5b8d72253060e8c8429b527b1540118ff WatchSource:0}: Error finding container 1e361fec65803de6b898ed45d83a4ef5b8d72253060e8c8429b527b1540118ff: Status 404 returned error can't find the container with id 1e361fec65803de6b898ed45d83a4ef5b8d72253060e8c8429b527b1540118ff
Sep 10 21:11:56.117869 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:56.117837    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k" event={"ID":"26190b6c-ea7d-4b23-95e5-48bbaebd72a2","Type":"ContainerStarted","Data":"1e361fec65803de6b898ed45d83a4ef5b8d72253060e8c8429b527b1540118ff"}
Sep 10 21:11:57.125860 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:57.125822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k" event={"ID":"26190b6c-ea7d-4b23-95e5-48bbaebd72a2","Type":"ContainerStarted","Data":"ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941"}
Sep 10 21:11:57.126270 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:57.126015    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:11:57.146606 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:11:57.146557    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k" podStartSLOduration=2.749174301 podStartE2EDuration="3.146541007s" totalImagesPullingTime="397.366706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:57.144070777 +0000 UTC m=+846.055350560" watchObservedRunningTime="2026-09-10 21:11:57.146541007 +0000 UTC m=+846.057820789"
Sep 10 21:12:02.687458 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:02.687424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:03.137907 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:03.137872    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:12:05.422483 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:05.422454    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:09.727418 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:09.727373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:10.622276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:10.622238    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:10.963137 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:10.963040    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:13.726151 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:13.726033    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:12:14.232806 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:14.232772    2558 generic.go:356] "Generic (PLEG): container finished" podID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerID="6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1" exitCode=0
Sep 10 21:12:14.232975 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:14.232829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" event={"ID":"ad1a15a1-2586-4ce2-848d-e1fc57c642ec","Type":"ContainerDied","Data":"6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1"}
Sep 10 21:12:14.233314 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:14.233297    2558 scope.go:117] "RemoveContainer" containerID="6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1"
Sep 10 21:12:14.234444 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:14.234415    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:14.234504 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:14.234479    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:14.234541 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:14.234510    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:15.242218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:15.242181    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" event={"ID":"ad1a15a1-2586-4ce2-848d-e1fc57c642ec","Type":"ContainerStarted","Data":"b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f"}
Sep 10 21:12:15.305471 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:15.305440    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:15.834698 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:15.834666    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:15.934685 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:15.934654    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:12:15.934861 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:15.934843    2558 patch_prober.go:28] interesting pod/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 21:12:15.934914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:15.934893    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 21:12:16.935646 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:16.935611    2558 patch_prober.go:28] interesting pod/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 21:12:16.936145 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:16.936110    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 21:12:17.935641 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:17.935603    2558 patch_prober.go:28] interesting pod/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 21:12:17.935823 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:17.935662    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 21:12:18.935350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:18.935308    2558 patch_prober.go:28] interesting pod/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 21:12:18.935537 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:18.935368    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 21:12:19.935346 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:19.935307    2558 patch_prober.go:28] interesting pod/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 21:12:19.935708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:19.935358    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 21:12:20.093742 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:20.093694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:20.938893 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:20.938859    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:12:20.939709 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:20.939140    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:12:20.939777 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:20.939723    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:12:20.970175 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:20.970136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:21.538166 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.538127    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"]
Sep 10 21:12:21.538445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.538383    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz" podUID="58dd7130-e675-4849-9b2e-8637aa1d1c3a" containerName="maas-api" containerID="cri-o://0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554" gracePeriod=30
Sep 10 21:12:21.566107 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.566078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:21.649398 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.649352    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:21.728619 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.728577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:21.794841 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.794765    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:12:21.803974 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.803950    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:21.831389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.831362    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58dd7130-e675-4849-9b2e-8637aa1d1c3a-openshift-service-ca\") pod \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") "
Sep 10 21:12:21.831555 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.831457    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bls8h\" (UniqueName: \"kubernetes.io/projected/58dd7130-e675-4849-9b2e-8637aa1d1c3a-kube-api-access-bls8h\") pod \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") "
Sep 10 21:12:21.831555 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.831544    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls\") pod \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") "
Sep 10 21:12:21.831676 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.831577    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-metrics-certs\") pod \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\" (UID: \"58dd7130-e675-4849-9b2e-8637aa1d1c3a\") "
Sep 10 21:12:21.831676 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.831578    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58dd7130-e675-4849-9b2e-8637aa1d1c3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58dd7130-e675-4849-9b2e-8637aa1d1c3a" (UID: "58dd7130-e675-4849-9b2e-8637aa1d1c3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:21.831883 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.831866    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58dd7130-e675-4849-9b2e-8637aa1d1c3a-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:21.833500 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.833465    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58dd7130-e675-4849-9b2e-8637aa1d1c3a-kube-api-access-bls8h" (OuterVolumeSpecName: "kube-api-access-bls8h") pod "58dd7130-e675-4849-9b2e-8637aa1d1c3a" (UID: "58dd7130-e675-4849-9b2e-8637aa1d1c3a"). InnerVolumeSpecName "kube-api-access-bls8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:21.833942 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.833915    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58dd7130-e675-4849-9b2e-8637aa1d1c3a" (UID: "58dd7130-e675-4849-9b2e-8637aa1d1c3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:12:21.834037 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.833936    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "58dd7130-e675-4849-9b2e-8637aa1d1c3a" (UID: "58dd7130-e675-4849-9b2e-8637aa1d1c3a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:12:21.932592 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.932558    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:21.932592 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.932586    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58dd7130-e675-4849-9b2e-8637aa1d1c3a-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:21.932592 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:21.932598    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bls8h\" (UniqueName: \"kubernetes.io/projected/58dd7130-e675-4849-9b2e-8637aa1d1c3a-kube-api-access-bls8h\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:22.146556 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.146516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:22.295145 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.295106    2558 generic.go:356] "Generic (PLEG): container finished" podID="58dd7130-e675-4849-9b2e-8637aa1d1c3a" containerID="0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554" exitCode=0
Sep 10 21:12:22.295350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.295157    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"
Sep 10 21:12:22.295350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.295199    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz" event={"ID":"58dd7130-e675-4849-9b2e-8637aa1d1c3a","Type":"ContainerDied","Data":"0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554"}
Sep 10 21:12:22.295350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.295258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz" event={"ID":"58dd7130-e675-4849-9b2e-8637aa1d1c3a","Type":"ContainerDied","Data":"a9c4ab9f3810bfa8cba498df61386b07049625e6c96b9545ae27cc3b3b9f8d5e"}
Sep 10 21:12:22.295350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.295291    2558 scope.go:117] "RemoveContainer" containerID="0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554"
Sep 10 21:12:22.305342 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.305323    2558 scope.go:117] "RemoveContainer" containerID="0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554"
Sep 10 21:12:22.305662 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:12:22.305643    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554\": container with ID starting with 0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554 not found: ID does not exist" containerID="0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554"
Sep 10 21:12:22.305724 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.305674    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554"} err="failed to get container status \"0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554\": rpc error: code = NotFound desc = could not find container \"0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554\": container with ID starting with 0dfedefdaf32dbcab5e1344b70056cf8f52b7579ac9ed35d892a7af10439a554 not found: ID does not exist"
Sep 10 21:12:22.320766 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.320738    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"]
Sep 10 21:12:22.323410 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:22.323387    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-63f3d7-7c87dfb974-m57rz"]
Sep 10 21:12:23.615392 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:23.615360    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58dd7130-e675-4849-9b2e-8637aa1d1c3a" path="/var/lib/kubelet/pods/58dd7130-e675-4849-9b2e-8637aa1d1c3a/volumes"
Sep 10 21:12:25.075180 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.075132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:25.605426 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.605391    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"]
Sep 10 21:12:25.605758 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.605733    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k" podUID="26190b6c-ea7d-4b23-95e5-48bbaebd72a2" containerName="maas-api" containerID="cri-o://ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941" gracePeriod=30
Sep 10 21:12:25.634116 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.634085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:25.694354 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.694320    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:25.763095 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.763040    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:25.836795 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.836766    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:25.856538 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.856478    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:12:25.972401 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.972372    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls\") pod \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") "
Sep 10 21:12:25.972401 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.972408    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-openshift-service-ca\") pod \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") "
Sep 10 21:12:25.972669 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.972479    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frwn8\" (UniqueName: \"kubernetes.io/projected/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-kube-api-access-frwn8\") pod \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") "
Sep 10 21:12:25.972669 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.972555    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-metrics-certs\") pod \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\" (UID: \"26190b6c-ea7d-4b23-95e5-48bbaebd72a2\") "
Sep 10 21:12:25.972925 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.972895    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26190b6c-ea7d-4b23-95e5-48bbaebd72a2" (UID: "26190b6c-ea7d-4b23-95e5-48bbaebd72a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:25.974584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.974549    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26190b6c-ea7d-4b23-95e5-48bbaebd72a2" (UID: "26190b6c-ea7d-4b23-95e5-48bbaebd72a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:12:25.974701 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.974633    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-kube-api-access-frwn8" (OuterVolumeSpecName: "kube-api-access-frwn8") pod "26190b6c-ea7d-4b23-95e5-48bbaebd72a2" (UID: "26190b6c-ea7d-4b23-95e5-48bbaebd72a2"). InnerVolumeSpecName "kube-api-access-frwn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:25.974701 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.974658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "26190b6c-ea7d-4b23-95e5-48bbaebd72a2" (UID: "26190b6c-ea7d-4b23-95e5-48bbaebd72a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:12:25.980134 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.980107    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"]
Sep 10 21:12:25.980323 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.980301    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy" containerID="cri-o://b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f" gracePeriod=30
Sep 10 21:12:25.987154 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:25.987132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:26.074689 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.074500    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.074689 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.074540    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.074689 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.074556    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frwn8\" (UniqueName: \"kubernetes.io/projected/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-kube-api-access-frwn8\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.074689 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.074584    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26190b6c-ea7d-4b23-95e5-48bbaebd72a2-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.327561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.327525    2558 generic.go:356] "Generic (PLEG): container finished" podID="26190b6c-ea7d-4b23-95e5-48bbaebd72a2" containerID="ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941" exitCode=0
Sep 10 21:12:26.327954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.327572    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"
Sep 10 21:12:26.327954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.327614    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k" event={"ID":"26190b6c-ea7d-4b23-95e5-48bbaebd72a2","Type":"ContainerDied","Data":"ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941"}
Sep 10 21:12:26.327954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.327669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k" event={"ID":"26190b6c-ea7d-4b23-95e5-48bbaebd72a2","Type":"ContainerDied","Data":"1e361fec65803de6b898ed45d83a4ef5b8d72253060e8c8429b527b1540118ff"}
Sep 10 21:12:26.327954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.327694    2558 scope.go:117] "RemoveContainer" containerID="ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941"
Sep 10 21:12:26.337221 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.337200    2558 scope.go:117] "RemoveContainer" containerID="ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941"
Sep 10 21:12:26.337501 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:12:26.337481    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941\": container with ID starting with ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941 not found: ID does not exist" containerID="ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941"
Sep 10 21:12:26.337558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.337510    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941"} err="failed to get container status \"ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941\": rpc error: code = NotFound desc = could not find container \"ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941\": container with ID starting with ce55f59ca2f036e1bb303c7c96f7ff75ea9820810f4ca1bec7328eafe04fb941 not found: ID does not exist"
Sep 10 21:12:26.352793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.352759    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"]
Sep 10 21:12:26.356715 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.356690    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b642ff4-5c7765dbd4-czt4k"]
Sep 10 21:12:26.755302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.755210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:26.822700 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.822658    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:26.893356 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:26.893317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:27.322144 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322110    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"]
Sep 10 21:12:27.322527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322513    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy"
Sep 10 21:12:27.322585 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322530    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy"
Sep 10 21:12:27.322585 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322539    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy"
Sep 10 21:12:27.322585 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322544    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy"
Sep 10 21:12:27.322585 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322555    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58dd7130-e675-4849-9b2e-8637aa1d1c3a" containerName="maas-api"
Sep 10 21:12:27.322585 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322563    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="58dd7130-e675-4849-9b2e-8637aa1d1c3a" containerName="maas-api"
Sep 10 21:12:27.322585 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322574    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26190b6c-ea7d-4b23-95e5-48bbaebd72a2" containerName="maas-api"
Sep 10 21:12:27.322585 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322579    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26190b6c-ea7d-4b23-95e5-48bbaebd72a2" containerName="maas-api"
Sep 10 21:12:27.322799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322633    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="58dd7130-e675-4849-9b2e-8637aa1d1c3a" containerName="maas-api"
Sep 10 21:12:27.322799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322643    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="26190b6c-ea7d-4b23-95e5-48bbaebd72a2" containerName="maas-api"
Sep 10 21:12:27.322799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322650    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy"
Sep 10 21:12:27.322799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.322657    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0a9504-af76-48d1-af51-eb1d63ccba85" containerName="istio-proxy"
Sep 10 21:12:27.327219 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.327201    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.330820 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.330789    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-000295\"/\"kube-root-ca.crt\""
Sep 10 21:12:27.330820 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.330810    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-000295\"/\"openshift-service-ca.crt\""
Sep 10 21:12:27.331302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.330817    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-000295\"/\"default-dockercfg-dg92s\""
Sep 10 21:12:27.331302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.330789    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-000295\"/\"test-model-000295-kserve-self-signed-certs\""
Sep 10 21:12:27.341542 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.341514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"]
Sep 10 21:12:27.387816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.387760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tls-certs\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.388024 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.387829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-home\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.388024 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.387871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-model-cache\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.388024 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.387982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljn7n\" (UniqueName: \"kubernetes.io/projected/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-kube-api-access-ljn7n\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.388242 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.388127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-dshm\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.388242 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.388159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tmp-dir\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.489659 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.489627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljn7n\" (UniqueName: \"kubernetes.io/projected/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-kube-api-access-ljn7n\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.489840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.489684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-dshm\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.489840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.489714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tmp-dir\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.489840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.489760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tls-certs\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.489840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.489792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-home\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.489840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.489824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-model-cache\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.490211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.490182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tmp-dir\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.490319 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.490195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-home\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.490319 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.490256    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-model-cache\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.491953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.491933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-dshm\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.492311 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.492293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tls-certs\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.495664 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.495631    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:27.497955 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.497929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljn7n\" (UniqueName: \"kubernetes.io/projected/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-kube-api-access-ljn7n\") pod \"test-model-000295-kserve-76c66b849-swc4s\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") " pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.615652 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.615566    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26190b6c-ea7d-4b23-95e5-48bbaebd72a2" path="/var/lib/kubelet/pods/26190b6c-ea7d-4b23-95e5-48bbaebd72a2/volumes"
Sep 10 21:12:27.637500 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.637467    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:27.934776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:27.934751    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"]
Sep 10 21:12:27.936370 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:12:27.936339    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cad8b0b_1258_4cef_883f_2dd7476fcc0f.slice/crio-50d453342cc6c3c1fd23422b321304cc92d44ef0d4b9c057e504eafb1703aa12 WatchSource:0}: Error finding container 50d453342cc6c3c1fd23422b321304cc92d44ef0d4b9c057e504eafb1703aa12: Status 404 returned error can't find the container with id 50d453342cc6c3c1fd23422b321304cc92d44ef0d4b9c057e504eafb1703aa12
Sep 10 21:12:28.344280 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:28.344154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s" event={"ID":"4cad8b0b-1258-4cef-883f-2dd7476fcc0f","Type":"ContainerStarted","Data":"50d453342cc6c3c1fd23422b321304cc92d44ef0d4b9c057e504eafb1703aa12"}
Sep 10 21:12:28.348677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:28.348635    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:29.354007 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:29.353963    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s" event={"ID":"4cad8b0b-1258-4cef-883f-2dd7476fcc0f","Type":"ContainerStarted","Data":"dfd62b11fbf7bfe963c8f09e713756339a41f8920c30cea1444888e5e3e8a8cf"}
Sep 10 21:12:29.382606 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:29.382558    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s" podStartSLOduration=1.307325536 podStartE2EDuration="2.382542482s" totalImagesPullingTime="1.075216946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:29.379997694 +0000 UTC m=+878.291277493" watchObservedRunningTime="2026-09-10 21:12:29.382542482 +0000 UTC m=+878.293822263"
Sep 10 21:12:30.201008 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:30.200979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:30.312110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:30.312072    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:30.511861 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:30.511757    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"]
Sep 10 21:12:30.512350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:30.512032    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" containerID="cri-o://1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8" gracePeriod=30
Sep 10 21:12:30.527900 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:30.527871    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:30.993362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:30.993329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:31.236576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.236550    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:12:31.326913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.326880    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-envoy\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.327218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.327200    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6wlc\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-kube-api-access-c6wlc\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.327823 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.327799    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istiod-ca-cert\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.327941 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.327838    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-credential-socket\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.327941 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.327876    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-podinfo\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.327941 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.327903    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-certs\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.328207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.327960    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-data\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.328207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.328152    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:31.328325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.328242    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:31.328325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.328254    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:31.328442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.328329    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-token\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.328442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.328382    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-socket\") pod \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\" (UID: \"ad1a15a1-2586-4ce2-848d-e1fc57c642ec\") "
Sep 10 21:12:31.328691 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.328654    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:31.329028 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.329009    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.329210 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.329165    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.329306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.329293    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.330001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.329924    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.330001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.329007    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:31.330001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.329824    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-kube-api-access-c6wlc" (OuterVolumeSpecName: "kube-api-access-c6wlc") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "kube-api-access-c6wlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:31.330241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.330015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:31.330788 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.330767    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:12:31.330867 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.330832    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"]
Sep 10 21:12:31.330922 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.330904    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad1a15a1-2586-4ce2-848d-e1fc57c642ec" (UID: "ad1a15a1-2586-4ce2-848d-e1fc57c642ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:31.331425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.331408    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy"
Sep 10 21:12:31.331472 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.331429    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy"
Sep 10 21:12:31.331551 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.331541    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy"
Sep 10 21:12:31.331592 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.331554    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy"
Sep 10 21:12:31.335201 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.335182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.341816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.341796    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-cb845d-openshift-default-dockercfg-4nt8c\""
Sep 10 21:12:31.356147 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.356121    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"]
Sep 10 21:12:31.368499 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.368460    2558 generic.go:356] "Generic (PLEG): container finished" podID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerID="b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f" exitCode=0
Sep 10 21:12:31.368654 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.368501    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"
Sep 10 21:12:31.368654 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.368525    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" event={"ID":"ad1a15a1-2586-4ce2-848d-e1fc57c642ec","Type":"ContainerDied","Data":"b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f"}
Sep 10 21:12:31.368654 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.368573    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr" event={"ID":"ad1a15a1-2586-4ce2-848d-e1fc57c642ec","Type":"ContainerDied","Data":"cc16798a27d79767475fb5090514a4538477febb78f9eb127fed0eea2008592d"}
Sep 10 21:12:31.368654 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.368598    2558 scope.go:117] "RemoveContainer" containerID="b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f"
Sep 10 21:12:31.370495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.370471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:31.378915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.378898    2558 scope.go:117] "RemoveContainer" containerID="6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1"
Sep 10 21:12:31.389988 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.389966    2558 scope.go:117] "RemoveContainer" containerID="b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f"
Sep 10 21:12:31.390424 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:12:31.390398    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f\": container with ID starting with b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f not found: ID does not exist" containerID="b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f"
Sep 10 21:12:31.390507 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.390439    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f"} err="failed to get container status \"b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f\": rpc error: code = NotFound desc = could not find container \"b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f\": container with ID starting with b6f6bf1209b3b52f4b18c46b47811a9e276af85eb075383af0884c66b059ae2f not found: ID does not exist"
Sep 10 21:12:31.390507 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.390463    2558 scope.go:117] "RemoveContainer" containerID="6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1"
Sep 10 21:12:31.390749 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:12:31.390727    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1\": container with ID starting with 6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1 not found: ID does not exist" containerID="6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1"
Sep 10 21:12:31.390802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.390758    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1"} err="failed to get container status \"6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1\": rpc error: code = NotFound desc = could not find container \"6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1\": container with ID starting with 6252fc78d8e59cf6ba3b9e937efbfc021032a84e89d2d15a8a182766b167b8c1 not found: ID does not exist"
Sep 10 21:12:31.402572 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.402546    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"]
Sep 10 21:12:31.404890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.404868    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7b642ff4-openshift-default-69d6bcdfd8-tjtmr"]
Sep 10 21:12:31.430760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.430737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-envoy\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.430865 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.430771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-podinfo\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.430865 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.430829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-credential-socket\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.430865 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.430853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istiod-ca-cert\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.431006 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.430922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-certs\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.431089 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-data\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.431154 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-socket\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.431154 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmm5v\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-kube-api-access-qmm5v\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.431260 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-token\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.431313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431295    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.431369 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431312    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.431369 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431327    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.431369 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431341    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.431369 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.431355    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6wlc\" (UniqueName: \"kubernetes.io/projected/ad1a15a1-2586-4ce2-848d-e1fc57c642ec-kube-api-access-c6wlc\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:31.442849 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.442822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:31.532340 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-certs\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532340 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-data\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-socket\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmm5v\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-kube-api-access-qmm5v\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-token\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-envoy\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-podinfo\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532662    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-credential-socket\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istiod-ca-cert\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-data\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.532881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532763    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-certs\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.533403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.532895    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-socket\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.533403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.533003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-credential-socket\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.533515 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.533487    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istiod-ca-cert\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.534945 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.534923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-envoy\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.535166 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.535146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-podinfo\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.542834 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.542801    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmm5v\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-kube-api-access-qmm5v\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.542959 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.542937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-token\") pod \"e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") " pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.615548 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.615471    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" path="/var/lib/kubelet/pods/ad1a15a1-2586-4ce2-848d-e1fc57c642ec/volumes"
Sep 10 21:12:31.659378 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.659343    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:31.956251 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.956225    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"]
Sep 10 21:12:31.958241 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:12:31.958218    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5196500_0ee9_458a_b125_1cd6b4fdba7b.slice/crio-b01149938afaefa78b6bd54d9700c2e5925569d9654320d6460bfc7c7b4a7760 WatchSource:0}: Error finding container b01149938afaefa78b6bd54d9700c2e5925569d9654320d6460bfc7c7b4a7760: Status 404 returned error can't find the container with id b01149938afaefa78b6bd54d9700c2e5925569d9654320d6460bfc7c7b4a7760
Sep 10 21:12:31.960495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.960465    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:31.960584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.960528    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:31.960584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:31.960557    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:32.376249 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:32.376210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" event={"ID":"d5196500-0ee9-458a-b125-1cd6b4fdba7b","Type":"ContainerStarted","Data":"452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff"}
Sep 10 21:12:32.376450 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:32.376272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" event={"ID":"d5196500-0ee9-458a-b125-1cd6b4fdba7b","Type":"ContainerStarted","Data":"b01149938afaefa78b6bd54d9700c2e5925569d9654320d6460bfc7c7b4a7760"}
Sep 10 21:12:32.402089 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:32.402021    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podStartSLOduration=1.402003141 podStartE2EDuration="1.402003141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:32.399223937 +0000 UTC m=+881.310503737" watchObservedRunningTime="2026-09-10 21:12:32.402003141 +0000 UTC m=+881.313282922"
Sep 10 21:12:32.660235 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:32.660153    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:33.665450 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:33.665418    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:34.372710 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:34.372677    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:34.390141 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:34.390114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:34.391166 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:34.391145    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:34.461847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:34.461816    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.050102 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.050066    2558 patch_prober.go:28] interesting pod/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:12:35.050540 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.050131    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:12:35.062926 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.062900    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.169228 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.169176    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.264446 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.264411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.363408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.363313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.626075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.625978    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"]
Sep 10 21:12:35.626443 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.626425    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy"
Sep 10 21:12:35.626498 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.626445    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1a15a1-2586-4ce2-848d-e1fc57c642ec" containerName="istio-proxy"
Sep 10 21:12:35.634068 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.634033    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.636964 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.636781    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 21:12:35.637113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.637003    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:12:35.637385 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.637215    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rf2kh\""
Sep 10 21:12:35.637870 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.637559    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 21:12:35.637870 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.637607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-cb845d-serving-cert\""
Sep 10 21:12:35.639241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.639217    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"]
Sep 10 21:12:35.650417 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.650315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.752284 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.752250    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.769986 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.769958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-metrics-certs\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.770127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.770019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/454a745b-4aee-4a20-8325-03ed7563a143-openshift-service-ca\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.770127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.770084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7845\" (UniqueName: \"kubernetes.io/projected/454a745b-4aee-4a20-8325-03ed7563a143-kube-api-access-t7845\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.770127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.770117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-maas-api-tls\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.780929 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.780906    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:12:35.814415 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.814285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:35.871135 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871096    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-socket\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871301 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871206    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-certs\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871301 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871240    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-podinfo\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871301 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871291    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-envoy\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871426 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871313    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-credential-socket\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871426 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871329    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-token\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871426 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871348    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45b3a771-5f81-4cb0-afa0-de722de4a875-istiod-ca-cert\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871426 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871375    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2cms\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-kube-api-access-v2cms\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871426 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871391    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-data\") pod \"45b3a771-5f81-4cb0-afa0-de722de4a875\" (UID: \"45b3a771-5f81-4cb0-afa0-de722de4a875\") "
Sep 10 21:12:35.871637 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-metrics-certs\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.871637 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/454a745b-4aee-4a20-8325-03ed7563a143-openshift-service-ca\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.871637 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7845\" (UniqueName: \"kubernetes.io/projected/454a745b-4aee-4a20-8325-03ed7563a143-kube-api-access-t7845\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.871794 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-maas-api-tls\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.871869 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871382    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:35.871934 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871491    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:35.871934 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871689    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:35.871934 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.871832    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-data" (OuterVolumeSpecName: "istio-data") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:35.872327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.872301    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b3a771-5f81-4cb0-afa0-de722de4a875-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:35.872789 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.872759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/454a745b-4aee-4a20-8325-03ed7563a143-openshift-service-ca\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.873875 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.873849    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-kube-api-access-v2cms" (OuterVolumeSpecName: "kube-api-access-v2cms") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "kube-api-access-v2cms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:35.874102 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.874075    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:35.874208 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.874108    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:12:35.874208 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.874122    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-token" (OuterVolumeSpecName: "istio-token") pod "45b3a771-5f81-4cb0-afa0-de722de4a875" (UID: "45b3a771-5f81-4cb0-afa0-de722de4a875"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:35.874477 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.874460    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-maas-api-tls\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.874533 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.874503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-metrics-certs\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.883975 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.883946    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7845\" (UniqueName: \"kubernetes.io/projected/454a745b-4aee-4a20-8325-03ed7563a143-kube-api-access-t7845\") pod \"maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.948874 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.948841    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:35.972486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972460    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972489    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972501    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972516    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972530    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972543    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45b3a771-5f81-4cb0-afa0-de722de4a875-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972555    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2cms\" (UniqueName: \"kubernetes.io/projected/45b3a771-5f81-4cb0-afa0-de722de4a875-kube-api-access-v2cms\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972567    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:35.972675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:35.972579    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45b3a771-5f81-4cb0-afa0-de722de4a875-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:36.122386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.122355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:36.223502 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.223388    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:36.229740 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.229651    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"]
Sep 10 21:12:36.232533 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:12:36.232450    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454a745b_4aee_4a20_8325_03ed7563a143.slice/crio-294f02fe078e64ed478f0bc9676206c0a594f21b23fbaceb99836f57ea8c74bc WatchSource:0}: Error finding container 294f02fe078e64ed478f0bc9676206c0a594f21b23fbaceb99836f57ea8c74bc: Status 404 returned error can't find the container with id 294f02fe078e64ed478f0bc9676206c0a594f21b23fbaceb99836f57ea8c74bc
Sep 10 21:12:36.238276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.237573    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:12:36.403646 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.403604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp" event={"ID":"454a745b-4aee-4a20-8325-03ed7563a143","Type":"ContainerStarted","Data":"294f02fe078e64ed478f0bc9676206c0a594f21b23fbaceb99836f57ea8c74bc"}
Sep 10 21:12:36.405633 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.405602    2558 generic.go:356] "Generic (PLEG): container finished" podID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerID="1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8" exitCode=0
Sep 10 21:12:36.405759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.405676    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"
Sep 10 21:12:36.405759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.405693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" event={"ID":"45b3a771-5f81-4cb0-afa0-de722de4a875","Type":"ContainerDied","Data":"1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8"}
Sep 10 21:12:36.405759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.405750    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq" event={"ID":"45b3a771-5f81-4cb0-afa0-de722de4a875","Type":"ContainerDied","Data":"91301056fea77fdd8a95e9754c35616fe762cb319ddc463210ab729c66b990e7"}
Sep 10 21:12:36.405884 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.405777    2558 scope.go:117] "RemoveContainer" containerID="1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8"
Sep 10 21:12:36.415651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.415626    2558 scope.go:117] "RemoveContainer" containerID="43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c"
Sep 10 21:12:36.424736 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.424714    2558 scope.go:117] "RemoveContainer" containerID="1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8"
Sep 10 21:12:36.425080 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:12:36.425032    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8\": container with ID starting with 1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8 not found: ID does not exist" containerID="1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8"
Sep 10 21:12:36.425146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.425096    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8"} err="failed to get container status \"1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8\": rpc error: code = NotFound desc = could not find container \"1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8\": container with ID starting with 1478ba397e6a840fc8ae65763ccb18ef98da6e7e38ca1351c4149b1d3ca842d8 not found: ID does not exist"
Sep 10 21:12:36.425146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.425119    2558 scope.go:117] "RemoveContainer" containerID="43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c"
Sep 10 21:12:36.425434 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:12:36.425415    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c\": container with ID starting with 43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c not found: ID does not exist" containerID="43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c"
Sep 10 21:12:36.425491 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.425439    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c"} err="failed to get container status \"43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c\": rpc error: code = NotFound desc = could not find container \"43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c\": container with ID starting with 43ac88f6d4a47e78cd424d09523f53557e14fd1ddfe48acf9b6658c77b08cb3c not found: ID does not exist"
Sep 10 21:12:36.437112 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.437086    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"]
Sep 10 21:12:36.443380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:36.443360    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-63f3d7-openshift-default-545cb578d4-btnfq"]
Sep 10 21:12:37.416864 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:37.416825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp" event={"ID":"454a745b-4aee-4a20-8325-03ed7563a143","Type":"ContainerStarted","Data":"736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1"}
Sep 10 21:12:37.417388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:37.417072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:37.435880 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:37.435825    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp" podStartSLOduration=2.062416307 podStartE2EDuration="2.435807177s" totalImagesPullingTime="373.39087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:37.433777171 +0000 UTC m=+886.345056953" watchObservedRunningTime="2026-09-10 21:12:37.435807177 +0000 UTC m=+886.347086959"
Sep 10 21:12:37.615708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:37.615674    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" path="/var/lib/kubelet/pods/45b3a771-5f81-4cb0-afa0-de722de4a875/volumes"
Sep 10 21:12:37.637581 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:37.637548    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:37.637761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:37.637624    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:37.650134 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:37.650100    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:38.435159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:38.435129    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:12:43.429824 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:43.429793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:12:56.533903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:56.533870    2558 generic.go:356] "Generic (PLEG): container finished" podID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerID="452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff" exitCode=0
Sep 10 21:12:56.534326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:56.533942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" event={"ID":"d5196500-0ee9-458a-b125-1cd6b4fdba7b","Type":"ContainerDied","Data":"452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff"}
Sep 10 21:12:56.534374 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:56.534330    2558 scope.go:117] "RemoveContainer" containerID="452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff"
Sep 10 21:12:56.535494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:56.535460    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:56.535567 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:56.535528    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:56.535567 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:56.535558    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:12:56.613406 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:56.613375    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:12:57.543387 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:57.543351    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" event={"ID":"d5196500-0ee9-458a-b125-1cd6b4fdba7b","Type":"ContainerStarted","Data":"41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb"}
Sep 10 21:12:57.660638 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:57.660576    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:12:57.661257 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:57.661228    2558 patch_prober.go:28] interesting pod/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:12:57.661496 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:57.661457    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 21:12:58.660550 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:58.660501    2558 patch_prober.go:28] interesting pod/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:12:58.661089 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:58.660574    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 21:12:59.426736 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:59.426694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:59.660723 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:59.660681    2558 patch_prober.go:28] interesting pod/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:12:59.661341 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:12:59.661302    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 21:13:00.660714 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:00.660671    2558 patch_prober.go:28] interesting pod/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:13:00.661024 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:00.660990    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 21:13:01.660815 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:01.660766    2558 patch_prober.go:28] interesting pod/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:13:01.661008 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:01.660856    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 21:13:01.796764 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:01.796703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:02.660271 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:02.660233    2558 patch_prober.go:28] interesting pod/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:13:02.660551 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:02.660526    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 21:13:03.664475 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:03.664444    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:13:03.664913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:03.664756    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:13:03.665566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:03.665548    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:13:06.039207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:06.039174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:08.094913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:08.094868    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:08.419160 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:08.419075    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:13:09.376824 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:09.376789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:13.396765 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:13.396732    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:19.271177 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:19.271133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:22.722631 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:22.722593    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:13:24.233699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:24.233666    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:29.878389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:29.878325    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"]
Sep 10 21:13:29.879705 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:29.879475    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp" podUID="454a745b-4aee-4a20-8325-03ed7563a143" containerName="maas-api" containerID="cri-o://736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1" gracePeriod=30
Sep 10 21:13:29.913528 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:29.913484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:29.980111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:29.980076    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:30.083165 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.083130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:30.138329 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.138256    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:13:30.164097 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.164036    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:30.227906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.227855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:30.288487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.288453    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-maas-api-tls\") pod \"454a745b-4aee-4a20-8325-03ed7563a143\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") "
Sep 10 21:13:30.288487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.288492    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/454a745b-4aee-4a20-8325-03ed7563a143-openshift-service-ca\") pod \"454a745b-4aee-4a20-8325-03ed7563a143\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") "
Sep 10 21:13:30.288708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.288547    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7845\" (UniqueName: \"kubernetes.io/projected/454a745b-4aee-4a20-8325-03ed7563a143-kube-api-access-t7845\") pod \"454a745b-4aee-4a20-8325-03ed7563a143\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") "
Sep 10 21:13:30.288708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.288598    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-metrics-certs\") pod \"454a745b-4aee-4a20-8325-03ed7563a143\" (UID: \"454a745b-4aee-4a20-8325-03ed7563a143\") "
Sep 10 21:13:30.289011 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.288978    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/454a745b-4aee-4a20-8325-03ed7563a143-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "454a745b-4aee-4a20-8325-03ed7563a143" (UID: "454a745b-4aee-4a20-8325-03ed7563a143"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:30.290760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.290731    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "454a745b-4aee-4a20-8325-03ed7563a143" (UID: "454a745b-4aee-4a20-8325-03ed7563a143"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:30.290760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.290743    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "454a745b-4aee-4a20-8325-03ed7563a143" (UID: "454a745b-4aee-4a20-8325-03ed7563a143"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:30.290931 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.290833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/454a745b-4aee-4a20-8325-03ed7563a143-kube-api-access-t7845" (OuterVolumeSpecName: "kube-api-access-t7845") pod "454a745b-4aee-4a20-8325-03ed7563a143" (UID: "454a745b-4aee-4a20-8325-03ed7563a143"). InnerVolumeSpecName "kube-api-access-t7845". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:30.390232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.390132    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7845\" (UniqueName: \"kubernetes.io/projected/454a745b-4aee-4a20-8325-03ed7563a143-kube-api-access-t7845\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:30.390232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.390166    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:30.390232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.390177    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/454a745b-4aee-4a20-8325-03ed7563a143-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:30.390232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.390185    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/454a745b-4aee-4a20-8325-03ed7563a143-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:30.609953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.609919    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:30.766576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.766493    2558 generic.go:356] "Generic (PLEG): container finished" podID="454a745b-4aee-4a20-8325-03ed7563a143" containerID="736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1" exitCode=0
Sep 10 21:13:30.766576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.766553    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"
Sep 10 21:13:30.766775 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.766552    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp" event={"ID":"454a745b-4aee-4a20-8325-03ed7563a143","Type":"ContainerDied","Data":"736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1"}
Sep 10 21:13:30.766775 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.766692    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp" event={"ID":"454a745b-4aee-4a20-8325-03ed7563a143","Type":"ContainerDied","Data":"294f02fe078e64ed478f0bc9676206c0a594f21b23fbaceb99836f57ea8c74bc"}
Sep 10 21:13:30.766775 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.766727    2558 scope.go:117] "RemoveContainer" containerID="736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1"
Sep 10 21:13:30.778403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.778358    2558 scope.go:117] "RemoveContainer" containerID="736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1"
Sep 10 21:13:30.778787 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:13:30.778760    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1\": container with ID starting with 736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1 not found: ID does not exist" containerID="736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1"
Sep 10 21:13:30.778871 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.778798    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1"} err="failed to get container status \"736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1\": rpc error: code = NotFound desc = could not find container \"736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1\": container with ID starting with 736067911ef257d23ee10a87bf752de80dd2469c038914c08bc913fa50db9ca1 not found: ID does not exist"
Sep 10 21:13:30.804661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.804624    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"]
Sep 10 21:13:30.807314 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:30.807292    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cb845d-b9b4b8464-kdmkp"]
Sep 10 21:13:31.614825 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:31.614788    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="454a745b-4aee-4a20-8325-03ed7563a143" path="/var/lib/kubelet/pods/454a745b-4aee-4a20-8325-03ed7563a143/volumes"
Sep 10 21:13:32.012708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:32.012606    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:32.126744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:32.126714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:32.247403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:32.247364    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:36.332211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:36.332173    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:13:37.176403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:37.176365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:37.250763 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:37.250729    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:37.442161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:37.442065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:37.480895 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:37.480860    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"]
Sep 10 21:13:37.481199 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:37.481169    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy" containerID="cri-o://41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb" gracePeriod=30
Sep 10 21:13:37.533332 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:37.533298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:37.954421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:37.954381    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:38.252946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.252870    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"]
Sep 10 21:13:38.253263 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.253250    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy"
Sep 10 21:13:38.253310 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.253265    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy"
Sep 10 21:13:38.253310 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.253286    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454a745b-4aee-4a20-8325-03ed7563a143" containerName="maas-api"
Sep 10 21:13:38.253310 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.253292    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="454a745b-4aee-4a20-8325-03ed7563a143" containerName="maas-api"
Sep 10 21:13:38.253430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.253354    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="454a745b-4aee-4a20-8325-03ed7563a143" containerName="maas-api"
Sep 10 21:13:38.253430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.253364    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy"
Sep 10 21:13:38.253430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.253371    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy"
Sep 10 21:13:38.257607 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.257590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.261389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.261370    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-7cc2bd-openshift-default-dockercfg-d77vq\""
Sep 10 21:13:38.272295 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.272267    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"]
Sep 10 21:13:38.279313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.279288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:38.355509 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-data\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-credential-socket\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-token\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istiod-ca-cert\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-socket\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-envoy\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhbr\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-kube-api-access-tzhbr\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-certs\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.355954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.355784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-podinfo\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.456808 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.456778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-data\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.456827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-credential-socket\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.456847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-token\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.456877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istiod-ca-cert\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.456899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-socket\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.456927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-envoy\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.456942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhbr\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-kube-api-access-tzhbr\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.457007    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-certs\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.457031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-podinfo\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.457345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-credential-socket\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.457475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-data\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.457520    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-socket\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.457564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-certs\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.457967 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.457852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istiod-ca-cert\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.459400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.459376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-envoy\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.459580 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.459564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-podinfo\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.466782 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.466758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhbr\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-kube-api-access-tzhbr\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.466866 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.466821    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-token\") pod \"e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") " pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.490769 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.490745    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:38.567256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.567215    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:38.858602 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.858576    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"]
Sep 10 21:13:38.860318 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:13:38.860288    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd0e88f_1833_4fd4_98d3_e3b559c914cc.slice/crio-92703be9b7ad1faa4abe931b6961d7a7942a816b776116bea757381215175586 WatchSource:0}: Error finding container 92703be9b7ad1faa4abe931b6961d7a7942a816b776116bea757381215175586: Status 404 returned error can't find the container with id 92703be9b7ad1faa4abe931b6961d7a7942a816b776116bea757381215175586
Sep 10 21:13:38.862236 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.862207    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:13:38.862302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.862266    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:13:38.862302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:38.862296    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:13:39.822423 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:39.822383    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6" event={"ID":"5dd0e88f-1833-4fd4-98d3-e3b559c914cc","Type":"ContainerStarted","Data":"539c4d8af5548109ce45c6053ff00f62d269997df5b9aeba1a02aeeb770b53bd"}
Sep 10 21:13:39.822813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:39.822449    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6" event={"ID":"5dd0e88f-1833-4fd4-98d3-e3b559c914cc","Type":"ContainerStarted","Data":"92703be9b7ad1faa4abe931b6961d7a7942a816b776116bea757381215175586"}
Sep 10 21:13:39.843770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:39.843703    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6" podStartSLOduration=1.84368165 podStartE2EDuration="1.84368165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:39.84215422 +0000 UTC m=+948.753434019" watchObservedRunningTime="2026-09-10 21:13:39.84368165 +0000 UTC m=+948.754961435"
Sep 10 21:13:40.160233 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:40.160142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:40.255875 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:40.255819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:40.367317 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:40.367280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:40.567535 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:40.567499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:40.572751 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:40.572722    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:40.834939 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:40.834855    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:40.835929 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:40.835909    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:42.754273 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.754213    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:13:42.765159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.765126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:42.789769 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789738    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-podinfo\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.789915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789787    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-certs\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.789915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789808    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-token\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.789915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789838    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-socket\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.789915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789865    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-credential-socket\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.789915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789897    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-data\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.790211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789929    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmm5v\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-kube-api-access-qmm5v\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.790211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.789963    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istiod-ca-cert\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.790211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.790028    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-envoy\") pod \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\" (UID: \"d5196500-0ee9-458a-b125-1cd6b4fdba7b\") "
Sep 10 21:13:42.790211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.790109    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:42.790425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.790368    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:42.790425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.790376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:42.790425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.790406    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.790566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.790499    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:42.790566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.790547    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:42.792141 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.792114    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:13:42.792301 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.792283    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:42.792571 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.792551    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:42.792629 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.792569    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-kube-api-access-qmm5v" (OuterVolumeSpecName: "kube-api-access-qmm5v") pod "d5196500-0ee9-458a-b125-1cd6b4fdba7b" (UID: "d5196500-0ee9-458a-b125-1cd6b4fdba7b"). InnerVolumeSpecName "kube-api-access-qmm5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:42.849940 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.849904    2558 generic.go:356] "Generic (PLEG): container finished" podID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerID="41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb" exitCode=0
Sep 10 21:13:42.850146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.849954    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"
Sep 10 21:13:42.850146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.849988    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" event={"ID":"d5196500-0ee9-458a-b125-1cd6b4fdba7b","Type":"ContainerDied","Data":"41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb"}
Sep 10 21:13:42.850146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.850038    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7" event={"ID":"d5196500-0ee9-458a-b125-1cd6b4fdba7b","Type":"ContainerDied","Data":"b01149938afaefa78b6bd54d9700c2e5925569d9654320d6460bfc7c7b4a7760"}
Sep 10 21:13:42.850146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.850081    2558 scope.go:117] "RemoveContainer" containerID="41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb"
Sep 10 21:13:42.859919 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.859902    2558 scope.go:117] "RemoveContainer" containerID="452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff"
Sep 10 21:13:42.868846 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.868823    2558 scope.go:117] "RemoveContainer" containerID="41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb"
Sep 10 21:13:42.869260 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:13:42.869241    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb\": container with ID starting with 41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb not found: ID does not exist" containerID="41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb"
Sep 10 21:13:42.869344 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.869273    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb"} err="failed to get container status \"41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb\": rpc error: code = NotFound desc = could not find container \"41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb\": container with ID starting with 41962189f1ad367e4c295bae4b034006eb7d7afdfb01c572471b71b2dac9a6cb not found: ID does not exist"
Sep 10 21:13:42.869344 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.869298    2558 scope.go:117] "RemoveContainer" containerID="452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff"
Sep 10 21:13:42.869584 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:13:42.869565    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff\": container with ID starting with 452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff not found: ID does not exist" containerID="452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff"
Sep 10 21:13:42.869625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.869590    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff"} err="failed to get container status \"452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff\": rpc error: code = NotFound desc = could not find container \"452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff\": container with ID starting with 452bf58d38948e3c67cf1ddfad7feafc9104711d7898e200a61b4b7bc0d6d6ff not found: ID does not exist"
Sep 10 21:13:42.890395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.890360    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"]
Sep 10 21:13:42.891391 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891368    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.891391 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891392    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.891553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891401    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.891553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891413    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.891553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891423    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmm5v\" (UniqueName: \"kubernetes.io/projected/d5196500-0ee9-458a-b125-1cd6b4fdba7b-kube-api-access-qmm5v\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.891553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891435    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.891553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891448    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.891553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.891460    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5196500-0ee9-458a-b125-1cd6b4fdba7b-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:42.904569 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:42.904540    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-cb845d-openshift-default-6b4c9f976-l5vl7"]
Sep 10 21:13:43.614453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:43.614417    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:43.617749 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:43.617721    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" path="/var/lib/kubelet/pods/d5196500-0ee9-458a-b125-1cd6b4fdba7b/volumes"
Sep 10 21:13:43.738825 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:43.738789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:50.147770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:50.147739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:50.235030 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:50.234989    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:13:50.237195 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:50.237164    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:50.306304 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:50.306271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:50.410925 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:50.410834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:50.556828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:50.556790    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:51.109413 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:51.109357    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:51.210440 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:51.210410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:51.309325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:51.309286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:51.660610 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:51.660578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:51.790158 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:51.790119    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"]
Sep 10 21:13:51.790389 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:51.790363    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6" podUID="5dd0e88f-1833-4fd4-98d3-e3b559c914cc" containerName="istio-proxy" containerID="cri-o://539c4d8af5548109ce45c6053ff00f62d269997df5b9aeba1a02aeeb770b53bd" gracePeriod=30
Sep 10 21:13:51.793760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:51.793730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:52.026830 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.026792    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:52.157471 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.157430    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:52.762323 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.762285    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"]
Sep 10 21:13:52.782401 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.782369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:52.850806 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.850769    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"]
Sep 10 21:13:52.851176 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851162    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy"
Sep 10 21:13:52.851226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851178    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy"
Sep 10 21:13:52.851226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851195    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy"
Sep 10 21:13:52.851226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851200    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy"
Sep 10 21:13:52.851226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851211    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy"
Sep 10 21:13:52.851226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851217    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b3a771-5f81-4cb0-afa0-de722de4a875" containerName="istio-proxy"
Sep 10 21:13:52.851376 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851281    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy"
Sep 10 21:13:52.851376 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.851289    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5196500-0ee9-458a-b125-1cd6b4fdba7b" containerName="istio-proxy"
Sep 10 21:13:52.855855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.855833    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"
Sep 10 21:13:52.858823 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.858792    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:13:52.858925 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.858884    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s4qqn\""
Sep 10 21:13:52.872100 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.872067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"]
Sep 10 21:13:52.882847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.882819    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4846f6fb-413b-4ebc-a926-80f5436a9934-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47f62f-knttk\" (UID: \"4846f6fb-413b-4ebc-a926-80f5436a9934\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"
Sep 10 21:13:52.984323 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.984282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4846f6fb-413b-4ebc-a926-80f5436a9934-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47f62f-knttk\" (UID: \"4846f6fb-413b-4ebc-a926-80f5436a9934\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"
Sep 10 21:13:52.984929 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.984908    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4846f6fb-413b-4ebc-a926-80f5436a9934-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-47f62f-knttk\" (UID: \"4846f6fb-413b-4ebc-a926-80f5436a9934\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"
Sep 10 21:13:52.987517 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:52.987494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:53.095717 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:53.095679    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:53.165916 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:53.165876    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"
Sep 10 21:13:53.444580 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:53.444553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"]
Sep 10 21:13:53.446955 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:13:53.446915    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4846f6fb_413b_4ebc_a926_80f5436a9934.slice/crio-d3436e3b5e61f494a3a79cd8a99f724c6f295f9cec0d022d288aa6ddce764df6 WatchSource:0}: Error finding container d3436e3b5e61f494a3a79cd8a99f724c6f295f9cec0d022d288aa6ddce764df6: Status 404 returned error can't find the container with id d3436e3b5e61f494a3a79cd8a99f724c6f295f9cec0d022d288aa6ddce764df6
Sep 10 21:13:53.922067 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:53.922010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk" event={"ID":"4846f6fb-413b-4ebc-a926-80f5436a9934","Type":"ContainerStarted","Data":"d3436e3b5e61f494a3a79cd8a99f724c6f295f9cec0d022d288aa6ddce764df6"}
Sep 10 21:13:55.836873 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:55.836834    2558 patch_prober.go:28] interesting pod/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:13:55.837269 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:55.836896    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6" podUID="5dd0e88f-1833-4fd4-98d3-e3b559c914cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:13:56.943281 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:56.943242    2558 generic.go:356] "Generic (PLEG): container finished" podID="5dd0e88f-1833-4fd4-98d3-e3b559c914cc" containerID="539c4d8af5548109ce45c6053ff00f62d269997df5b9aeba1a02aeeb770b53bd" exitCode=0
Sep 10 21:13:56.943761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:56.943329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6" event={"ID":"5dd0e88f-1833-4fd4-98d3-e3b559c914cc","Type":"ContainerDied","Data":"539c4d8af5548109ce45c6053ff00f62d269997df5b9aeba1a02aeeb770b53bd"}
Sep 10 21:13:56.945315 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:56.945285    2558 generic.go:356] "Generic (PLEG): container finished" podID="4846f6fb-413b-4ebc-a926-80f5436a9934" containerID="94c57b1bbe8b3d1494aecbec044de8fd8d13f181b580d58acc10365b4647246e" exitCode=0
Sep 10 21:13:56.945456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:56.945314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk" event={"ID":"4846f6fb-413b-4ebc-a926-80f5436a9934","Type":"ContainerDied","Data":"94c57b1bbe8b3d1494aecbec044de8fd8d13f181b580d58acc10365b4647246e"}
Sep 10 21:13:57.045973 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.045944    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:57.123965 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.123865    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-data\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.123965 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.123921    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istiod-ca-cert\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.123971    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-socket\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.123987    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-token\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124004    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzhbr\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-kube-api-access-tzhbr\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124026    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-podinfo\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-certs\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124249    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:57.124480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124309    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-credential-socket\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124326    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:57.124480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124337    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-envoy\") pod \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\" (UID: \"5dd0e88f-1833-4fd4-98d3-e3b559c914cc\") "
Sep 10 21:13:57.124686 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124497    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:57.124686 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124538    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:57.124790 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124752    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:57.124790 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124780    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.124888 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124806    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.124888 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124821    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.124888 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.124835    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.126480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.126447    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:57.126480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.126470    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-kube-api-access-tzhbr" (OuterVolumeSpecName: "kube-api-access-tzhbr") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "kube-api-access-tzhbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:57.126689 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.126666    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:13:57.126795 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.126701    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5dd0e88f-1833-4fd4-98d3-e3b559c914cc" (UID: "5dd0e88f-1833-4fd4-98d3-e3b559c914cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:57.225608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.225567    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.225608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.225601    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzhbr\" (UniqueName: \"kubernetes.io/projected/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-kube-api-access-tzhbr\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.225608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.225613    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.225855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.225624    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.225855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.225633    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd0e88f-1833-4fd4-98d3-e3b559c914cc-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:57.447978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.447896    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:57.952519 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.952480    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6" event={"ID":"5dd0e88f-1833-4fd4-98d3-e3b559c914cc","Type":"ContainerDied","Data":"92703be9b7ad1faa4abe931b6961d7a7942a816b776116bea757381215175586"}
Sep 10 21:13:57.952519 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.952508    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"
Sep 10 21:13:57.953102 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.952559    2558 scope.go:117] "RemoveContainer" containerID="539c4d8af5548109ce45c6053ff00f62d269997df5b9aeba1a02aeeb770b53bd"
Sep 10 21:13:57.972327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.972295    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"]
Sep 10 21:13:57.977256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:57.977220    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-7cc2bd-openshift-default-747c88748b-bb9n6"]
Sep 10 21:13:58.085933 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:58.085904    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"
Sep 10 21:13:58.134759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:58.134706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4846f6fb-413b-4ebc-a926-80f5436a9934-maas-api-service-ca\") pod \"4846f6fb-413b-4ebc-a926-80f5436a9934\" (UID: \"4846f6fb-413b-4ebc-a926-80f5436a9934\") "
Sep 10 21:13:58.135159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:58.135128    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4846f6fb-413b-4ebc-a926-80f5436a9934-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4846f6fb-413b-4ebc-a926-80f5436a9934" (UID: "4846f6fb-413b-4ebc-a926-80f5436a9934"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:58.236164 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:58.236038    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4846f6fb-413b-4ebc-a926-80f5436a9934-maas-api-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:58.964784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:58.964750    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"
Sep 10 21:13:58.965304 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:58.964785    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk" event={"ID":"4846f6fb-413b-4ebc-a926-80f5436a9934","Type":"ContainerDied","Data":"d3436e3b5e61f494a3a79cd8a99f724c6f295f9cec0d022d288aa6ddce764df6"}
Sep 10 21:13:58.965304 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:58.964843    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3436e3b5e61f494a3a79cd8a99f724c6f295f9cec0d022d288aa6ddce764df6"
Sep 10 21:13:59.328471 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:59.328442    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:59.427395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:59.427352    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:59.615060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:13:59.614965    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd0e88f-1833-4fd4-98d3-e3b559c914cc" path="/var/lib/kubelet/pods/5dd0e88f-1833-4fd4-98d3-e3b559c914cc/volumes"
Sep 10 21:14:00.155417 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:00.155385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:01.913854 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:01.913818    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:14:03.377060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.377010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:03.456402 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.456365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:03.521255 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.521210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:03.584166 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.584130    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"]
Sep 10 21:14:03.586547 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.586521    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47f62f-knttk"]
Sep 10 21:14:03.587204 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.587165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:03.615590 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.615541    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4846f6fb-413b-4ebc-a926-80f5436a9934" path="/var/lib/kubelet/pods/4846f6fb-413b-4ebc-a926-80f5436a9934/volumes"
Sep 10 21:14:03.658201 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.658117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:03.972085 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:03.971973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:06.398201 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:06.398169    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:06.477362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:06.477329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:06.659879 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:06.659790    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:07.000422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:07.000336    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:07.559602 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:07.559560    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:07.781355 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:07.781310    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s" podUID="4cad8b0b-1258-4cef-883f-2dd7476fcc0f" containerName="main" containerID="cri-o://dfd62b11fbf7bfe963c8f09e713756339a41f8920c30cea1444888e5e3e8a8cf" gracePeriod=45
Sep 10 21:14:08.022487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.022459    2558 generic.go:356] "Generic (PLEG): container finished" podID="4cad8b0b-1258-4cef-883f-2dd7476fcc0f" containerID="dfd62b11fbf7bfe963c8f09e713756339a41f8920c30cea1444888e5e3e8a8cf" exitCode=0
Sep 10 21:14:08.022605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.022524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s" event={"ID":"4cad8b0b-1258-4cef-883f-2dd7476fcc0f","Type":"ContainerDied","Data":"dfd62b11fbf7bfe963c8f09e713756339a41f8920c30cea1444888e5e3e8a8cf"}
Sep 10 21:14:08.038311 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.038290    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:14:08.130124 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130069    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tls-certs\") pod \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") "
Sep 10 21:14:08.130327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130163    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tmp-dir\") pod \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") "
Sep 10 21:14:08.130327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130235    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-home\") pod \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") "
Sep 10 21:14:08.130327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130263    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-dshm\") pod \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") "
Sep 10 21:14:08.130327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130290    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljn7n\" (UniqueName: \"kubernetes.io/projected/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-kube-api-access-ljn7n\") pod \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") "
Sep 10 21:14:08.130327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130322    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-model-cache\") pod \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\" (UID: \"4cad8b0b-1258-4cef-883f-2dd7476fcc0f\") "
Sep 10 21:14:08.130566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130435    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4cad8b0b-1258-4cef-883f-2dd7476fcc0f" (UID: "4cad8b0b-1258-4cef-883f-2dd7476fcc0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:08.130566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-home" (OuterVolumeSpecName: "home") pod "4cad8b0b-1258-4cef-883f-2dd7476fcc0f" (UID: "4cad8b0b-1258-4cef-883f-2dd7476fcc0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:08.130734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130708    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-home\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:08.130860 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130721    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "4cad8b0b-1258-4cef-883f-2dd7476fcc0f" (UID: "4cad8b0b-1258-4cef-883f-2dd7476fcc0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:08.130860 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.130739    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tmp-dir\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:08.132362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.132337    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4cad8b0b-1258-4cef-883f-2dd7476fcc0f" (UID: "4cad8b0b-1258-4cef-883f-2dd7476fcc0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:08.132451 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.132377    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-dshm" (OuterVolumeSpecName: "dshm") pod "4cad8b0b-1258-4cef-883f-2dd7476fcc0f" (UID: "4cad8b0b-1258-4cef-883f-2dd7476fcc0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:08.132451 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.132434    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-kube-api-access-ljn7n" (OuterVolumeSpecName: "kube-api-access-ljn7n") pod "4cad8b0b-1258-4cef-883f-2dd7476fcc0f" (UID: "4cad8b0b-1258-4cef-883f-2dd7476fcc0f"). InnerVolumeSpecName "kube-api-access-ljn7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:08.231744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.231663    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-dshm\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:08.231744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.231691    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljn7n\" (UniqueName: \"kubernetes.io/projected/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-kube-api-access-ljn7n\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:08.231744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.231702    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-model-cache\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:08.231744 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:08.231711    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cad8b0b-1258-4cef-883f-2dd7476fcc0f-tls-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:09.029400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:09.029366    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s" event={"ID":"4cad8b0b-1258-4cef-883f-2dd7476fcc0f","Type":"ContainerDied","Data":"50d453342cc6c3c1fd23422b321304cc92d44ef0d4b9c057e504eafb1703aa12"}
Sep 10 21:14:09.029828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:09.029421    2558 scope.go:117] "RemoveContainer" containerID="dfd62b11fbf7bfe963c8f09e713756339a41f8920c30cea1444888e5e3e8a8cf"
Sep 10 21:14:09.029828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:09.029376    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"
Sep 10 21:14:09.052025 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:09.051994    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"]
Sep 10 21:14:09.055337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:09.055316    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-000295/test-model-000295-kserve-76c66b849-swc4s"]
Sep 10 21:14:09.304251 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:09.304216    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:14:09.616231 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:09.616151    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cad8b0b-1258-4cef-883f-2dd7476fcc0f" path="/var/lib/kubelet/pods/4cad8b0b-1258-4cef-883f-2dd7476fcc0f/volumes"
Sep 10 21:14:10.186848 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.186785    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:10.277655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.277623    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:10.444229 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.444135    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:10.451014 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.450983    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"]
Sep 10 21:14:10.451229 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.451207    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" containerID="cri-o://0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231" gracePeriod=30
Sep 10 21:14:10.540710 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.540680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:10.802849 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.802815    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"]
Sep 10 21:14:10.803222 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803208    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd0e88f-1833-4fd4-98d3-e3b559c914cc" containerName="istio-proxy"
Sep 10 21:14:10.803276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803224    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd0e88f-1833-4fd4-98d3-e3b559c914cc" containerName="istio-proxy"
Sep 10 21:14:10.803276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803247    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4846f6fb-413b-4ebc-a926-80f5436a9934" containerName="revoke-keys"
Sep 10 21:14:10.803276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803255    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4846f6fb-413b-4ebc-a926-80f5436a9934" containerName="revoke-keys"
Sep 10 21:14:10.803276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803267    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cad8b0b-1258-4cef-883f-2dd7476fcc0f" containerName="main"
Sep 10 21:14:10.803276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803274    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cad8b0b-1258-4cef-883f-2dd7476fcc0f" containerName="main"
Sep 10 21:14:10.803422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803331    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cad8b0b-1258-4cef-883f-2dd7476fcc0f" containerName="main"
Sep 10 21:14:10.803422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803341    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4846f6fb-413b-4ebc-a926-80f5436a9934" containerName="revoke-keys"
Sep 10 21:14:10.803422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.803353    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd0e88f-1833-4fd4-98d3-e3b559c914cc" containerName="istio-proxy"
Sep 10 21:14:10.807783 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.807765    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"
Sep 10 21:14:10.810231 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.810213    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:14:10.810317 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.810217    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s4qqn\""
Sep 10 21:14:10.813884 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.813858    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"]
Sep 10 21:14:10.957550 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:10.957514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d9c206-db21-406c-b3cc-dc870956c5b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-000295-5hx5q\" (UID: \"06d9c206-db21-406c-b3cc-dc870956c5b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"
Sep 10 21:14:11.049882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.049849    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:11.058634 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.058565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d9c206-db21-406c-b3cc-dc870956c5b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-000295-5hx5q\" (UID: \"06d9c206-db21-406c-b3cc-dc870956c5b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"
Sep 10 21:14:11.059171 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.059154    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d9c206-db21-406c-b3cc-dc870956c5b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-000295-5hx5q\" (UID: \"06d9c206-db21-406c-b3cc-dc870956c5b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"
Sep 10 21:14:11.120188 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.120145    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"
Sep 10 21:14:11.344122 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.344017    2558 patch_prober.go:28] interesting pod/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:14:11.344122 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.344097    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:14:11.398467 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.398414    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"]
Sep 10 21:14:11.400784 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:14:11.400758    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d9c206_db21_406c_b3cc_dc870956c5b1.slice/crio-08b2d1fcc2ea69c11e7c5ec63b335f7bbee594976155f5ae0d164e3d92f8b001 WatchSource:0}: Error finding container 08b2d1fcc2ea69c11e7c5ec63b335f7bbee594976155f5ae0d164e3d92f8b001: Status 404 returned error can't find the container with id 08b2d1fcc2ea69c11e7c5ec63b335f7bbee594976155f5ae0d164e3d92f8b001
Sep 10 21:14:11.755349 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.755263    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"]
Sep 10 21:14:11.758662 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.758636    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.761359 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.761324    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 21:14:11.761495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.761385    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rf2kh\""
Sep 10 21:14:11.762147 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.762125    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 21:14:11.763238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.763216    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-db4a68ea-serving-cert\""
Sep 10 21:14:11.776980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.776836    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"]
Sep 10 21:14:11.798754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.798718    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:11.867182 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.867145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.867388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.867211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42wqq\" (UniqueName: \"kubernetes.io/projected/3bd84142-cee9-4f54-b376-8d3e2d54a36b-kube-api-access-42wqq\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.867388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.867320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd84142-cee9-4f54-b376-8d3e2d54a36b-openshift-service-ca\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.867388 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.867383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-metrics-certs\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.894730 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.894690    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:11.968433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.968401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd84142-cee9-4f54-b376-8d3e2d54a36b-openshift-service-ca\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.968582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.968446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-metrics-certs\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.968582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.968477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.968582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.968515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42wqq\" (UniqueName: \"kubernetes.io/projected/3bd84142-cee9-4f54-b376-8d3e2d54a36b-kube-api-access-42wqq\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.968763 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:14:11.968636    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-serving-cert: secret "maas-api-e2e-mt-db4a68ea-serving-cert" not found
Sep 10 21:14:11.968763 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:14:11.968730    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls podName:3bd84142-cee9-4f54-b376-8d3e2d54a36b nodeName:}" failed. No retries permitted until 2026-09-10 21:14:12.468706758 +0000 UTC m=+981.379986532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls") pod "maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l" (UID: "3bd84142-cee9-4f54-b376-8d3e2d54a36b") : secret "maas-api-e2e-mt-db4a68ea-serving-cert" not found
Sep 10 21:14:11.969169 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.969149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd84142-cee9-4f54-b376-8d3e2d54a36b-openshift-service-ca\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.970737 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.970718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-metrics-certs\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:11.979810 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:11.979789    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42wqq\" (UniqueName: \"kubernetes.io/projected/3bd84142-cee9-4f54-b376-8d3e2d54a36b-kube-api-access-42wqq\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:12.050071 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.050023    2558 generic.go:356] "Generic (PLEG): container finished" podID="06d9c206-db21-406c-b3cc-dc870956c5b1" containerID="f53086d31e55b3b891a57a5d7f7977ded051c712e574e8fba17cf1c48099c170" exitCode=0
Sep 10 21:14:12.050209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.050107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q" event={"ID":"06d9c206-db21-406c-b3cc-dc870956c5b1","Type":"ContainerDied","Data":"f53086d31e55b3b891a57a5d7f7977ded051c712e574e8fba17cf1c48099c170"}
Sep 10 21:14:12.050209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.050161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q" event={"ID":"06d9c206-db21-406c-b3cc-dc870956c5b1","Type":"ContainerStarted","Data":"08b2d1fcc2ea69c11e7c5ec63b335f7bbee594976155f5ae0d164e3d92f8b001"}
Sep 10 21:14:12.172449 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.172415    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:12.287116 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.287087    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:12.387437 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.387399    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:12.473328 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.473292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:12.475720 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.475700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls\") pod \"maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:12.677644 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.677561    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:12.746831 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.746785    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:12.957101 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:12.957006    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"]
Sep 10 21:14:12.959157 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:14:12.959129    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd84142_cee9_4f54_b376_8d3e2d54a36b.slice/crio-a131cd44eded2251f97c57784e6208a65a74b28f2cbce73f9779d290a6f9f417 WatchSource:0}: Error finding container a131cd44eded2251f97c57784e6208a65a74b28f2cbce73f9779d290a6f9f417: Status 404 returned error can't find the container with id a131cd44eded2251f97c57784e6208a65a74b28f2cbce73f9779d290a6f9f417
Sep 10 21:14:13.058842 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:13.058808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l" event={"ID":"3bd84142-cee9-4f54-b376-8d3e2d54a36b","Type":"ContainerStarted","Data":"a131cd44eded2251f97c57784e6208a65a74b28f2cbce73f9779d290a6f9f417"}
Sep 10 21:14:13.203665 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:13.203643    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"
Sep 10 21:14:13.282251 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:13.282157    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d9c206-db21-406c-b3cc-dc870956c5b1-maas-api-service-ca\") pod \"06d9c206-db21-406c-b3cc-dc870956c5b1\" (UID: \"06d9c206-db21-406c-b3cc-dc870956c5b1\") "
Sep 10 21:14:13.282506 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:13.282478    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d9c206-db21-406c-b3cc-dc870956c5b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06d9c206-db21-406c-b3cc-dc870956c5b1" (UID: "06d9c206-db21-406c-b3cc-dc870956c5b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:13.383427 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:13.383384    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d9c206-db21-406c-b3cc-dc870956c5b1-maas-api-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:14.065638 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:14.065563    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"
Sep 10 21:14:14.065638 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:14.065569    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q" event={"ID":"06d9c206-db21-406c-b3cc-dc870956c5b1","Type":"ContainerDied","Data":"08b2d1fcc2ea69c11e7c5ec63b335f7bbee594976155f5ae0d164e3d92f8b001"}
Sep 10 21:14:14.065638 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:14.065617    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08b2d1fcc2ea69c11e7c5ec63b335f7bbee594976155f5ae0d164e3d92f8b001"
Sep 10 21:14:14.067604 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:14.067575    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l" event={"ID":"3bd84142-cee9-4f54-b376-8d3e2d54a36b","Type":"ContainerStarted","Data":"65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e"}
Sep 10 21:14:14.067736 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:14.067716    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:14.084697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:14.084646    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l" podStartSLOduration=2.551633994 podStartE2EDuration="3.084614606s" totalImagesPullingTime="532.980612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:14.083715672 +0000 UTC m=+982.994995487" watchObservedRunningTime="2026-09-10 21:14:14.084614606 +0000 UTC m=+982.995894387"
Sep 10 21:14:14.138143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:14.138098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:15.700473 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.700442    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:14:15.805823 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.805788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhw8r\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-kube-api-access-xhw8r\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.805987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.805851    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-data\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.805987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.805896    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-token\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.805987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.805919    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istiod-ca-cert\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.805987 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.805963    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-credential-socket\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.806236 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806005    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-certs\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.806236 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806139    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:15.806236 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806148    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-podinfo\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.806236 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806228    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-socket\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.806441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806296    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-envoy\") pod \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\" (UID: \"0d1df40f-d935-487f-aaf9-0b4db34f3aa8\") "
Sep 10 21:14:15.806441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806315    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:15.806441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806338    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:15.806441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806417    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:15.806625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806524    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:15.806700 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806677    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.806700 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806699    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.806828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806708    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.806828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806717    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.806828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.806727    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.808327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.808298    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-kube-api-access-xhw8r" (OuterVolumeSpecName: "kube-api-access-xhw8r") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "kube-api-access-xhw8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:15.808453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.808328    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:14:15.808453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.808384    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:15.808453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.808408    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d1df40f-d935-487f-aaf9-0b4db34f3aa8" (UID: "0d1df40f-d935-487f-aaf9-0b4db34f3aa8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:15.907972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.907929    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhw8r\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-kube-api-access-xhw8r\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.907972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.907965    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.907972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.907974    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:15.907972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:15.907984    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1df40f-d935-487f-aaf9-0b4db34f3aa8-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:16.081844 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.081749    2558 generic.go:356] "Generic (PLEG): container finished" podID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerID="0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231" exitCode=0
Sep 10 21:14:16.081844 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.081802    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"
Sep 10 21:14:16.082130 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.081839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" event={"ID":"0d1df40f-d935-487f-aaf9-0b4db34f3aa8","Type":"ContainerDied","Data":"0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231"}
Sep 10 21:14:16.082130 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.081906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5" event={"ID":"0d1df40f-d935-487f-aaf9-0b4db34f3aa8","Type":"ContainerDied","Data":"051b6989b9247de2120fb1e6a96de82aca2e8bb6553d8a4b4e15bc2361e80bdc"}
Sep 10 21:14:16.082130 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.081940    2558 scope.go:117] "RemoveContainer" containerID="0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231"
Sep 10 21:14:16.091579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.091561    2558 scope.go:117] "RemoveContainer" containerID="7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580"
Sep 10 21:14:16.104487 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.104462    2558 scope.go:117] "RemoveContainer" containerID="0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231"
Sep 10 21:14:16.104770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.104745    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"]
Sep 10 21:14:16.104840 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:14:16.104794    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231\": container with ID starting with 0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231 not found: ID does not exist" containerID="0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231"
Sep 10 21:14:16.104840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.104819    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231"} err="failed to get container status \"0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231\": rpc error: code = NotFound desc = could not find container \"0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231\": container with ID starting with 0d13d5cb93f12099b68b8ebe6ff9de3312627eb0d995dd06021d438156001231 not found: ID does not exist"
Sep 10 21:14:16.104840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.104838    2558 scope.go:117] "RemoveContainer" containerID="7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580"
Sep 10 21:14:16.105134 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:14:16.105116    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580\": container with ID starting with 7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580 not found: ID does not exist" containerID="7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580"
Sep 10 21:14:16.105185 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.105139    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580"} err="failed to get container status \"7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580\": rpc error: code = NotFound desc = could not find container \"7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580\": container with ID starting with 7010705cd2c840bd6ae4131aa4fa35b2a45213815b8c41f48330a145a6ca0580 not found: ID does not exist"
Sep 10 21:14:16.109857 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.109832    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-47f62f-openshift-default-f4b9d45b4-m7kh5"]
Sep 10 21:14:16.510626 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:16.510541    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:14:17.615505 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:17.615461    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" path="/var/lib/kubelet/pods/0d1df40f-d935-487f-aaf9-0b4db34f3aa8/volumes"
Sep 10 21:14:20.078568 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:20.078536    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:20.989643 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:20.989615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:21.806890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:21.806857    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:21.883429 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:21.883392    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:21.983992 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:21.983957    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:22.032759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:22.032722    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"]
Sep 10 21:14:22.038145 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:22.038121    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-000295-5hx5q"]
Sep 10 21:14:22.085854 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:22.085763    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:22.416983 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:22.416898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:22.814403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:22.814369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:23.615056 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:23.615011    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d9c206-db21-406c-b3cc-dc870956c5b1" path="/var/lib/kubelet/pods/06d9c206-db21-406c-b3cc-dc870956c5b1/volumes"
Sep 10 21:14:24.413481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:24.413436    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:14:28.729221 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:28.729185    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:28.792678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:28.792634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:28.971062 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:28.971010    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"]
Sep 10 21:14:28.971315 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:28.971289    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy" containerID="cri-o://1362a3f15fa103ad638f6fd03a3c0cad18ff3b3cca317551243e1b447a25db5d" gracePeriod=30
Sep 10 21:14:28.983215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:28.983140    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:29.572684 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.572645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:29.854270 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854195    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"]
Sep 10 21:14:29.854630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854576    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy"
Sep 10 21:14:29.854630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854587    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy"
Sep 10 21:14:29.854630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854606    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d9c206-db21-406c-b3cc-dc870956c5b1" containerName="revoke-keys"
Sep 10 21:14:29.854630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854612    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d9c206-db21-406c-b3cc-dc870956c5b1" containerName="revoke-keys"
Sep 10 21:14:29.854774 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854669    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy"
Sep 10 21:14:29.854774 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854677    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy"
Sep 10 21:14:29.854774 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.854684    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d9c206-db21-406c-b3cc-dc870956c5b1" containerName="revoke-keys"
Sep 10 21:14:29.862996 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.862970    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.865400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.865381    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-828c7c-openshift-default-dockercfg-swtcp\""
Sep 10 21:14:29.874093 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.874064    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"]
Sep 10 21:14:29.877352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.877316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:29.931570 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-socket\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-envoy\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931603    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-token\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istiod-ca-cert\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-data\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnvbr\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-kube-api-access-fnvbr\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-credential-socket\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-podinfo\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.931943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.931869    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-certs\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:29.936873 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:29.936848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:30.032346 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032317    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-data\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032346 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvbr\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-kube-api-access-fnvbr\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-credential-socket\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-podinfo\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-certs\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-socket\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-envoy\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-token\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istiod-ca-cert\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.032997 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032829    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-socket\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.033073 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.032989    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-data\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.033138 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.033063    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-certs\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.033190 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.033136    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-credential-socket\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.033375 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.033354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istiod-ca-cert\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.035270 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.035253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-envoy\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.035590 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.035568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-podinfo\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.041608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.041578    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnvbr\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-kube-api-access-fnvbr\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.041608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.041603    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-token\") pod \"e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") " pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.175570 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.175481    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:30.452607 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.452578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"]
Sep 10 21:14:30.455086 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:14:30.455056    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8ed9b5_d9f9_4a63_98a8_d6cdb0c7c8da.slice/crio-c34c53e01e94247b59308ec334b56f94839992d4c5177e204d90353ef67aef1e WatchSource:0}: Error finding container c34c53e01e94247b59308ec334b56f94839992d4c5177e204d90353ef67aef1e: Status 404 returned error can't find the container with id c34c53e01e94247b59308ec334b56f94839992d4c5177e204d90353ef67aef1e
Sep 10 21:14:30.457776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.457743    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:30.457881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.457830    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:30.457946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:30.457877    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:31.175627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:31.175592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" event={"ID":"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da","Type":"ContainerStarted","Data":"5f7cff620bd4d5caeef3715b6d9b0c3132c87aa2382faa62b18253a6c9c02f1d"}
Sep 10 21:14:31.176012 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:31.175652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" event={"ID":"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da","Type":"ContainerStarted","Data":"c34c53e01e94247b59308ec334b56f94839992d4c5177e204d90353ef67aef1e"}
Sep 10 21:14:31.197162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:31.197110    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podStartSLOduration=2.197093076 podStartE2EDuration="2.197093076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:31.196511202 +0000 UTC m=+1000.107790999" watchObservedRunningTime="2026-09-10 21:14:31.197093076 +0000 UTC m=+1000.108372859"
Sep 10 21:14:32.175788 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:32.175750    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:32.181220 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:32.181194    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:32.708723 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:32.708682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:33.137314 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:33.137280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:33.187343 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:33.187302    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:33.188294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:33.188274    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:33.213696 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:33.213665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:34.203258 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.203223    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerID="1362a3f15fa103ad638f6fd03a3c0cad18ff3b3cca317551243e1b447a25db5d" exitCode=0
Sep 10 21:14:34.203712 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.203292    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" event={"ID":"e2a3b314-115b-4afc-b597-1015dc3f5f1d","Type":"ContainerDied","Data":"1362a3f15fa103ad638f6fd03a3c0cad18ff3b3cca317551243e1b447a25db5d"}
Sep 10 21:14:34.203712 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.203407    2558 scope.go:117] "RemoveContainer" containerID="e2a228b50f0c3792d8a70c7ec7d71cbec2836598932a9fc4fe12311bb0b19abe"
Sep 10 21:14:34.237021 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.236967    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:14:34.270548 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270515    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-token\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.270735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270558    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-envoy\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.270735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270599    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-credential-socket\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.270735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270631    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-socket\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.270735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270652    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-podinfo\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.270735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270673    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-data\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.270735 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270718    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-certs\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.271092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270741    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phwpn\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-kube-api-access-phwpn\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.271092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270794    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istiod-ca-cert\") pod \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\" (UID: \"e2a3b314-115b-4afc-b597-1015dc3f5f1d\") "
Sep 10 21:14:34.271092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.270946    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:34.271259 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.271106    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:34.271259 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.271211    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:34.271259 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.271217    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.271259 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.271253    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.271648 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.271545    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:34.271801 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.271627    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:34.273166 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.273125    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:34.273272 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.273237    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-kube-api-access-phwpn" (OuterVolumeSpecName: "kube-api-access-phwpn") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "kube-api-access-phwpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:34.273475 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.273454    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:34.273559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.273474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2a3b314-115b-4afc-b597-1015dc3f5f1d" (UID: "e2a3b314-115b-4afc-b597-1015dc3f5f1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:14:34.371675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.371634    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.371675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.371666    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.371675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.371674    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.371675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.371682    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.371953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.371691    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2a3b314-115b-4afc-b597-1015dc3f5f1d-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.371953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.371700    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2a3b314-115b-4afc-b597-1015dc3f5f1d-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.371953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.371711    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phwpn\" (UniqueName: \"kubernetes.io/projected/e2a3b314-115b-4afc-b597-1015dc3f5f1d-kube-api-access-phwpn\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:34.638113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638068    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"]
Sep 10 21:14:34.638438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638426    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy"
Sep 10 21:14:34.638486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638440    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d1df40f-d935-487f-aaf9-0b4db34f3aa8" containerName="istio-proxy"
Sep 10 21:14:34.638486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638457    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy"
Sep 10 21:14:34.638486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638463    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy"
Sep 10 21:14:34.638486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638473    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy"
Sep 10 21:14:34.638486 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638479    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy"
Sep 10 21:14:34.638635 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638548    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy"
Sep 10 21:14:34.638635 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.638559    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" containerName="istio-proxy"
Sep 10 21:14:34.642162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.642138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.644530 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.644512    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-828c7c-serving-cert\""
Sep 10 21:14:34.654637 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.654616    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"]
Sep 10 21:14:34.674759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.674727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.674889 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.674777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rgrv\" (UniqueName: \"kubernetes.io/projected/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-kube-api-access-4rgrv\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.674889 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.674812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.674889 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.674841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.720675 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.720633    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:34.775930 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.775889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.776172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.775950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rgrv\" (UniqueName: \"kubernetes.io/projected/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-kube-api-access-4rgrv\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.776172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.775989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.776172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.776034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.776172 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:14:34.776136    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-serving-cert: secret "maas-api-e2e-shared-a-w3-828c7c-serving-cert" not found
Sep 10 21:14:34.776342 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:14:34.776223    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls podName:fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6 nodeName:}" failed. No retries permitted until 2026-09-10 21:14:35.276205199 +0000 UTC m=+1004.187484980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls") pod "maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c" (UID: "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6") : secret "maas-api-e2e-shared-a-w3-828c7c-serving-cert" not found
Sep 10 21:14:34.776793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.776772    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.778428 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.778409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.786484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.786464    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rgrv\" (UniqueName: \"kubernetes.io/projected/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-kube-api-access-4rgrv\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:34.824112 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.824074    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:34.962884 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:34.962782    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:35.210737 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.210710    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"
Sep 10 21:14:35.211162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.210757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn" event={"ID":"e2a3b314-115b-4afc-b597-1015dc3f5f1d","Type":"ContainerDied","Data":"eef43e0cba8cfba90181b97aeafbdebd48ba157d4b0544af50c521c237c07691"}
Sep 10 21:14:35.211162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.210813    2558 scope.go:117] "RemoveContainer" containerID="1362a3f15fa103ad638f6fd03a3c0cad18ff3b3cca317551243e1b447a25db5d"
Sep 10 21:14:35.233647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.233618    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"]
Sep 10 21:14:35.241381 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.241354    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-000295-openshift-default-6d9bcfb4dd-grpbn"]
Sep 10 21:14:35.280323 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.280248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:35.282608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.282581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:35.289033 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.289003    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:35.388978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.388946    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:35.486648 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.486556    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:35.556828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.556795    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:35.621075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.617819    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2a3b314-115b-4afc-b597-1015dc3f5f1d" path="/var/lib/kubelet/pods/e2a3b314-115b-4afc-b597-1015dc3f5f1d/volumes"
Sep 10 21:14:35.851946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.851860    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"]
Sep 10 21:14:35.854380 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:14:35.854353    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4adeee_eccd_4ea8_bd5a_b076f0d0fcb6.slice/crio-6cc4058719b1bf967d48990f619553c40203f31c6e249aaf9507846cbb8dbc22 WatchSource:0}: Error finding container 6cc4058719b1bf967d48990f619553c40203f31c6e249aaf9507846cbb8dbc22: Status 404 returned error can't find the container with id 6cc4058719b1bf967d48990f619553c40203f31c6e249aaf9507846cbb8dbc22
Sep 10 21:14:35.855747 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:35.855727    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:14:36.085425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:36.085386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:36.184993 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:36.184957    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:36.219258 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:36.219231    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c" event={"ID":"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6","Type":"ContainerStarted","Data":"6cc4058719b1bf967d48990f619553c40203f31c6e249aaf9507846cbb8dbc22"}
Sep 10 21:14:36.383803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:36.383767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:36.522378 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:36.522294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:37.226678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:37.226643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c" event={"ID":"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6","Type":"ContainerStarted","Data":"d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d"}
Sep 10 21:14:37.227098 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:37.226701    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:37.261995 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:37.261941    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c" podStartSLOduration=2.94420854 podStartE2EDuration="3.26192435s" totalImagesPullingTime="317.71581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:37.260381232 +0000 UTC m=+1006.171661034" watchObservedRunningTime="2026-09-10 21:14:37.26192435 +0000 UTC m=+1006.173204132"
Sep 10 21:14:38.711096 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:38.711055    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:14:42.566806 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:42.566774    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:42.664707 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:42.664670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:43.113214 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:43.113172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:43.238869 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:43.238836    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:14:48.188575 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.188538    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:14:48.189001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.188619    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 21:14:48.304430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.304398    2558 generic.go:356] "Generic (PLEG): container finished" podID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerID="5f7cff620bd4d5caeef3715b6d9b0c3132c87aa2382faa62b18253a6c9c02f1d" exitCode=0
Sep 10 21:14:48.304604 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.304471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" event={"ID":"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da","Type":"ContainerDied","Data":"5f7cff620bd4d5caeef3715b6d9b0c3132c87aa2382faa62b18253a6c9c02f1d"}
Sep 10 21:14:48.304860 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.304845    2558 scope.go:117] "RemoveContainer" containerID="5f7cff620bd4d5caeef3715b6d9b0c3132c87aa2382faa62b18253a6c9c02f1d"
Sep 10 21:14:48.305840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.305813    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:48.305931 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.305896    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:48.305996 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:48.305942    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:49.311865 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:49.311829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" event={"ID":"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da","Type":"ContainerStarted","Data":"d2615ad8023c8a0a0265e95ad5c627355a2817a70cc217d43df00526ae7d6d06"}
Sep 10 21:14:50.175683 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:50.175641    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:50.175890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:50.175866    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:14:50.175936 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:50.175920    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 21:14:51.176480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:51.176435    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:14:51.176879 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:51.176500    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 21:14:52.176005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:52.175965    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:14:52.176190 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:52.176025    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 21:14:53.176113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.176071    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:14:53.176507 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.176129    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 21:14:53.423207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.423168    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"]
Sep 10 21:14:53.423414 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.423391    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l" podUID="3bd84142-cee9-4f54-b376-8d3e2d54a36b" containerName="maas-api" containerID="cri-o://65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e" gracePeriod=30
Sep 10 21:14:53.468378 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.468342    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:53.555606 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.555568    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:53.638898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.638873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:53.698773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.698687    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:53.721711 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.721683    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:53.876371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.876328    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd84142-cee9-4f54-b376-8d3e2d54a36b-openshift-service-ca\") pod \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") "
Sep 10 21:14:53.876545 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.876381    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-metrics-certs\") pod \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") "
Sep 10 21:14:53.876545 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.876440    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42wqq\" (UniqueName: \"kubernetes.io/projected/3bd84142-cee9-4f54-b376-8d3e2d54a36b-kube-api-access-42wqq\") pod \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") "
Sep 10 21:14:53.876545 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.876458    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls\") pod \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\" (UID: \"3bd84142-cee9-4f54-b376-8d3e2d54a36b\") "
Sep 10 21:14:53.876725 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.876703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bd84142-cee9-4f54-b376-8d3e2d54a36b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3bd84142-cee9-4f54-b376-8d3e2d54a36b" (UID: "3bd84142-cee9-4f54-b376-8d3e2d54a36b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:53.878665 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.878639    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd84142-cee9-4f54-b376-8d3e2d54a36b-kube-api-access-42wqq" (OuterVolumeSpecName: "kube-api-access-42wqq") pod "3bd84142-cee9-4f54-b376-8d3e2d54a36b" (UID: "3bd84142-cee9-4f54-b376-8d3e2d54a36b"). InnerVolumeSpecName "kube-api-access-42wqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:53.878771 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.878669    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3bd84142-cee9-4f54-b376-8d3e2d54a36b" (UID: "3bd84142-cee9-4f54-b376-8d3e2d54a36b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:53.878771 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.878702    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3bd84142-cee9-4f54-b376-8d3e2d54a36b" (UID: "3bd84142-cee9-4f54-b376-8d3e2d54a36b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:53.977645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.977540    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:53.977645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.977589    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd84142-cee9-4f54-b376-8d3e2d54a36b-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:53.977645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.977603    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bd84142-cee9-4f54-b376-8d3e2d54a36b-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:53.977645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:53.977611    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42wqq\" (UniqueName: \"kubernetes.io/projected/3bd84142-cee9-4f54-b376-8d3e2d54a36b-kube-api-access-42wqq\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:54.036276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.036236    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:54.176405 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.176364    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:14:54.176791 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.176422    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 21:14:54.349928 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.349891    2558 generic.go:356] "Generic (PLEG): container finished" podID="3bd84142-cee9-4f54-b376-8d3e2d54a36b" containerID="65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e" exitCode=0
Sep 10 21:14:54.350140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.349952    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"
Sep 10 21:14:54.350140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.349975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l" event={"ID":"3bd84142-cee9-4f54-b376-8d3e2d54a36b","Type":"ContainerDied","Data":"65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e"}
Sep 10 21:14:54.350140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.350033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l" event={"ID":"3bd84142-cee9-4f54-b376-8d3e2d54a36b","Type":"ContainerDied","Data":"a131cd44eded2251f97c57784e6208a65a74b28f2cbce73f9779d290a6f9f417"}
Sep 10 21:14:54.350140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.350071    2558 scope.go:117] "RemoveContainer" containerID="65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e"
Sep 10 21:14:54.360691 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.360639    2558 scope.go:117] "RemoveContainer" containerID="65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e"
Sep 10 21:14:54.361500 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:14:54.361320    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e\": container with ID starting with 65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e not found: ID does not exist" containerID="65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e"
Sep 10 21:14:54.361500 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.361361    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e"} err="failed to get container status \"65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e\": rpc error: code = NotFound desc = could not find container \"65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e\": container with ID starting with 65737bdbf00152d9798f89749d11bb1448cb301496d284dc76fe6b29195b583e not found: ID does not exist"
Sep 10 21:14:54.376036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.376006    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"]
Sep 10 21:14:54.383851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:54.383822    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db4a68ea-76ff487f7d-5kg7l"]
Sep 10 21:14:55.180553 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:55.180524    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:55.181009 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:55.180786    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:55.181648 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:55.181628    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:14:55.615086 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:55.615039    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bd84142-cee9-4f54-b376-8d3e2d54a36b" path="/var/lib/kubelet/pods/3bd84142-cee9-4f54-b376-8d3e2d54a36b/volumes"
Sep 10 21:14:56.610232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:56.610197    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:14:56.673421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:56.673378    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:58.145127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.145093    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:58.495991 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.495911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:58.787065 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.786970    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"]
Sep 10 21:14:58.787348 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.787335    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd84142-cee9-4f54-b376-8d3e2d54a36b" containerName="maas-api"
Sep 10 21:14:58.787393 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.787349    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd84142-cee9-4f54-b376-8d3e2d54a36b" containerName="maas-api"
Sep 10 21:14:58.787428 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.787416    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bd84142-cee9-4f54-b376-8d3e2d54a36b" containerName="maas-api"
Sep 10 21:14:58.791908 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.791885    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.794326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.794310    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-9f6475-openshift-default-dockercfg-4gqqv\""
Sep 10 21:14:58.803113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.803089    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"]
Sep 10 21:14:58.818496 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.818464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:58.918556 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bdf34a8-016f-41f0-82e7-14af823b5965-istiod-ca-cert\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.918752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-token\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.918752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-socket\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.918752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-envoy\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.918752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-data\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.918752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6879b\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-kube-api-access-6879b\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.919071 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-certs\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.919071 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-podinfo\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:58.919071 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:58.918944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-credential-socket\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020083 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-socket\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-envoy\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020184    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-data\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020207    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6879b\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-kube-api-access-6879b\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-certs\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020476 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-podinfo\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020476 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-credential-socket\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020476 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bdf34a8-016f-41f0-82e7-14af823b5965-istiod-ca-cert\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020476 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-token\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-socket\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-data\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-certs\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.020803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.020728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-credential-socket\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.021124 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.021104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bdf34a8-016f-41f0-82e7-14af823b5965-istiod-ca-cert\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.022674 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.022653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-envoy\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.022915 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.022897    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-podinfo\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.028969 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.028942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-token\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.029111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.029093    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6879b\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-kube-api-access-6879b\") pod \"e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") " pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.102995 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.102957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:14:59.114851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.114815    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:59.384222 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.384194    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"]
Sep 10 21:14:59.385877 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:14:59.385850    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdf34a8_016f_41f0_82e7_14af823b5965.slice/crio-2a9747fc7fb1ce25ab7a751a1f7f0d5bb4d547da85e65ab0efd0553eb0550537 WatchSource:0}: Error finding container 2a9747fc7fb1ce25ab7a751a1f7f0d5bb4d547da85e65ab0efd0553eb0550537: Status 404 returned error can't find the container with id 2a9747fc7fb1ce25ab7a751a1f7f0d5bb4d547da85e65ab0efd0553eb0550537
Sep 10 21:14:59.387954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.387922    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:59.388057 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.387990    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:14:59.388057 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:14:59.388021    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:15:00.281956 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:00.281920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:00.359830 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:00.359745    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:00.389777 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:00.389740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" event={"ID":"3bdf34a8-016f-41f0-82e7-14af823b5965","Type":"ContainerStarted","Data":"9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d"}
Sep 10 21:15:00.390231 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:00.389803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" event={"ID":"3bdf34a8-016f-41f0-82e7-14af823b5965","Type":"ContainerStarted","Data":"2a9747fc7fb1ce25ab7a751a1f7f0d5bb4d547da85e65ab0efd0553eb0550537"}
Sep 10 21:15:00.414760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:00.414703    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podStartSLOduration=2.414686937 podStartE2EDuration="2.414686937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:00.411695255 +0000 UTC m=+1029.322975048" watchObservedRunningTime="2026-09-10 21:15:00.414686937 +0000 UTC m=+1029.325966718"
Sep 10 21:15:00.541057 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:00.540962    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:00.906400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:00.906363    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:01.005457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:01.005423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:01.103919 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:01.103875    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:01.109428 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:01.109403    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:01.118417 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:01.118387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:01.395845 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:01.395816    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:01.396825 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:01.396806    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:02.461680 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:02.461627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:02.554323 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:02.554281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:03.576429 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.576390    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"]
Sep 10 21:15:03.580143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.580118    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.582425 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.582404    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-9f6475-serving-cert\""
Sep 10 21:15:03.593862 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.593825    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"]
Sep 10 21:15:03.612392 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.612316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:03.713256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.713218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:03.766589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.766547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fdcc88b-34cd-4aaa-a750-2fa471f28818-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.766589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.766589    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h64h\" (UniqueName: \"kubernetes.io/projected/5fdcc88b-34cd-4aaa-a750-2fa471f28818-kube-api-access-4h64h\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.766847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.766631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.766847 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.766693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.837181 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.837073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:03.867967 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.867924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fdcc88b-34cd-4aaa-a750-2fa471f28818-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.867967 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.867957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h64h\" (UniqueName: \"kubernetes.io/projected/5fdcc88b-34cd-4aaa-a750-2fa471f28818-kube-api-access-4h64h\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.868266 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.867989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.868266 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.868032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.868681 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.868648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fdcc88b-34cd-4aaa-a750-2fa471f28818-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.870375 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.870345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.870492 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.870419    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.883008 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.882960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h64h\" (UniqueName: \"kubernetes.io/projected/5fdcc88b-34cd-4aaa-a750-2fa471f28818-kube-api-access-4h64h\") pod \"maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:03.892110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:03.892067    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:04.101972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:04.101871    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:04.166600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:04.166574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"]
Sep 10 21:15:04.168674 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:15:04.168642    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdcc88b_34cd_4aaa_a750_2fa471f28818.slice/crio-30229a8d8b17338b4166986751b4f66bd03a4feeed19149fd31c466174929940 WatchSource:0}: Error finding container 30229a8d8b17338b4166986751b4f66bd03a4feeed19149fd31c466174929940: Status 404 returned error can't find the container with id 30229a8d8b17338b4166986751b4f66bd03a4feeed19149fd31c466174929940
Sep 10 21:15:04.284143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:04.284107    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:04.413264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:04.413179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp" event={"ID":"5fdcc88b-34cd-4aaa-a750-2fa471f28818","Type":"ContainerStarted","Data":"30229a8d8b17338b4166986751b4f66bd03a4feeed19149fd31c466174929940"}
Sep 10 21:15:05.422495 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:05.422455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp" event={"ID":"5fdcc88b-34cd-4aaa-a750-2fa471f28818","Type":"ContainerStarted","Data":"ea2d9ba78163e0144d21402efd77d3cecdc4927bcb776537f7f72dec1827d71f"}
Sep 10 21:15:05.422869 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:05.422522    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:05.440224 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:05.440176    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp" podStartSLOduration=2.114476138 podStartE2EDuration="2.440161453s" totalImagesPullingTime="325.685315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:05.439861362 +0000 UTC m=+1034.351141163" watchObservedRunningTime="2026-09-10 21:15:05.440161453 +0000 UTC m=+1034.351441235"
Sep 10 21:15:07.139172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:07.139125    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:07.199529 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:07.199496    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:07.269372 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:07.269336    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:07.369539 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:07.369503    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:07.403790 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:07.403711    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:15:07.516278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:07.516248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:11.434539 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:11.434504    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:15:13.474909 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:13.474874    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:13.575947 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:13.575911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:14.428831 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:14.428786    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:14.735450 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:14.735360    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:14.915610 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:14.915548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:16.866755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:16.865952    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": read tcp 10.133.0.2:56620->10.133.0.68:15021: read: connection reset by peer" start-of-body=
Sep 10 21:15:16.866755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:16.866029    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": read tcp 10.133.0.2:56620->10.133.0.68:15021: read: connection reset by peer"
Sep 10 21:15:17.516115 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.516080    2558 generic.go:356] "Generic (PLEG): container finished" podID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerID="9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d" exitCode=0
Sep 10 21:15:17.516295 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.516151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" event={"ID":"3bdf34a8-016f-41f0-82e7-14af823b5965","Type":"ContainerDied","Data":"9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d"}
Sep 10 21:15:17.516570 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.516554    2558 scope.go:117] "RemoveContainer" containerID="9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d"
Sep 10 21:15:17.517602 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.517577    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:15:17.517715 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.517642    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:15:17.517715 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.517676    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:15:17.817978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.817944    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:17.908828 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:17.908775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:18.524125 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:18.524089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" event={"ID":"3bdf34a8-016f-41f0-82e7-14af823b5965","Type":"ContainerStarted","Data":"462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb"}
Sep 10 21:15:19.075339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.075303    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:19.103334 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.103301    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:19.103510 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.103484    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:19.103562 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.103539    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 21:15:19.166127 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.166093    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:19.284636 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.284604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:19.561816 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.558184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:19.654276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:19.654244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:20.103303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:20.103267    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:20.103695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:20.103321    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 21:15:21.103677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:21.103634    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:21.104103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:21.103695    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 21:15:22.104228 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:22.104187    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:22.104626 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:22.104249    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 21:15:23.103629 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:23.103591    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:23.103809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:23.103652    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 10 21:15:24.107632 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:24.107603    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:24.108103 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:24.107874    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:24.108676 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:24.108660    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:15:25.006569 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:25.006532    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:15:25.564248 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:25.564211    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:27.459410 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:27.459369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:35.902957 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:35.902910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:36.002907 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:36.002872    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:39.955228 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:39.955184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:41.429177 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:41.429141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:42.831664 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:42.831634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:43.182562 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.182467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:43.542254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.542165    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"]
Sep 10 21:15:43.546977 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.546954    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.549527 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.549508    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-aca18f-openshift-default-dockercfg-g58gf\""
Sep 10 21:15:43.562447 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.562418    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"]
Sep 10 21:15:43.566734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.566707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:43.628357 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-credential-socket\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istiod-ca-cert\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-data\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-token\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8hhl\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-kube-api-access-t8hhl\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-envoy\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-podinfo\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628996 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-certs\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.628996 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.628782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-socket\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.729475 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-credential-socket\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.729678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istiod-ca-cert\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.729678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-data\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.729678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-token\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.729678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8hhl\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-kube-api-access-t8hhl\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.729678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-envoy\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.729678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-podinfo\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.730017 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-certs\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.730017 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-socket\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.730017 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729884    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-credential-socket\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.730017 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.729894    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-data\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.730249 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.730170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-socket\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.730249 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.730186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-certs\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.730564 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.730540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istiod-ca-cert\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.731968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.731939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-envoy\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.732234 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.732215    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-podinfo\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.737317 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.737298    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-token\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.737751 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.737731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8hhl\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-kube-api-access-t8hhl\") pod \"e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") " pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:43.807736 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.807697    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:43.857454 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:43.857379    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:44.137311 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.137276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"]
Sep 10 21:15:44.138590 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:15:44.138567    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d888b5_0f9d_4e35_a9f1_80147e40c78b.slice/crio-5e1edcaf56f9009510e909f4804fe3a68c8bef0ebadd85850548d506f0ea936a WatchSource:0}: Error finding container 5e1edcaf56f9009510e909f4804fe3a68c8bef0ebadd85850548d506f0ea936a: Status 404 returned error can't find the container with id 5e1edcaf56f9009510e909f4804fe3a68c8bef0ebadd85850548d506f0ea936a
Sep 10 21:15:44.141354 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.141319    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:15:44.141445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.141388    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:15:44.141445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.141417    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:15:44.685491 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.685451    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" event={"ID":"61d888b5-0f9d-4e35-a9f1-80147e40c78b","Type":"ContainerStarted","Data":"f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d"}
Sep 10 21:15:44.685708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.685510    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" event={"ID":"61d888b5-0f9d-4e35-a9f1-80147e40c78b","Type":"ContainerStarted","Data":"5e1edcaf56f9009510e909f4804fe3a68c8bef0ebadd85850548d506f0ea936a"}
Sep 10 21:15:44.706839 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.706791    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podStartSLOduration=1.706775438 podStartE2EDuration="1.706775438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:44.705745346 +0000 UTC m=+1073.617025128" watchObservedRunningTime="2026-09-10 21:15:44.706775438 +0000 UTC m=+1073.618055249"
Sep 10 21:15:44.858379 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:44.858340    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:45.862805 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:45.862771    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:46.211872 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:46.211789    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:15:46.629746 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:46.629713    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:46.697716 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:46.697685    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:46.698961 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:46.698940    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:15:46.727111 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:46.727069    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:47.925092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:47.925038    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"]
Sep 10 21:15:47.929266 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:47.929247    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:47.931899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:47.931873    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-aca18f-serving-cert\""
Sep 10 21:15:47.940723 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:47.940700    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"]
Sep 10 21:15:47.965177 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:47.965146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:48.064348 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.064317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:48.074514 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.074474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdbgk\" (UniqueName: \"kubernetes.io/projected/d166faca-c34f-4f00-89c2-9905fe9612d3-kube-api-access-vdbgk\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.074514 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.074523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d166faca-c34f-4f00-89c2-9905fe9612d3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.074773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.074578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.074773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.074654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.175699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.175601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.175699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.175663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdbgk\" (UniqueName: \"kubernetes.io/projected/d166faca-c34f-4f00-89c2-9905fe9612d3-kube-api-access-vdbgk\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.175699 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.175685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d166faca-c34f-4f00-89c2-9905fe9612d3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.176014 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.175798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.176335 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.176316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d166faca-c34f-4f00-89c2-9905fe9612d3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.178231 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.178211    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.178326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.178315    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.183962 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.183942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdbgk\" (UniqueName: \"kubernetes.io/projected/d166faca-c34f-4f00-89c2-9905fe9612d3-kube-api-access-vdbgk\") pod \"maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.241840 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.241804    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:48.470250 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.470172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:48.534616 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.534589    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"]
Sep 10 21:15:48.536167 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:15:48.536135    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd166faca_c34f_4f00_89c2_9905fe9612d3.slice/crio-46db94f07adcae8c6c6defbe719589c72f9211c3dca722a19b0b3958dcfd30ab WatchSource:0}: Error finding container 46db94f07adcae8c6c6defbe719589c72f9211c3dca722a19b0b3958dcfd30ab: Status 404 returned error can't find the container with id 46db94f07adcae8c6c6defbe719589c72f9211c3dca722a19b0b3958dcfd30ab
Sep 10 21:15:48.565348 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.565323    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:48.714537 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:48.714502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58" event={"ID":"d166faca-c34f-4f00-89c2-9905fe9612d3","Type":"ContainerStarted","Data":"46db94f07adcae8c6c6defbe719589c72f9211c3dca722a19b0b3958dcfd30ab"}
Sep 10 21:15:49.721438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:49.721395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58" event={"ID":"d166faca-c34f-4f00-89c2-9905fe9612d3","Type":"ContainerStarted","Data":"9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536"}
Sep 10 21:15:49.721844 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:49.721464    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:15:49.739844 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:49.739792    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58" podStartSLOduration=2.376023286 podStartE2EDuration="2.739776141s" totalImagesPullingTime="363.752855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:49.739541202 +0000 UTC m=+1078.650821005" watchObservedRunningTime="2026-09-10 21:15:49.739776141 +0000 UTC m=+1078.651055922"
Sep 10 21:15:55.733321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:15:55.733285    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:16:02.309497 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:02.309458    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:16:02.739306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:02.739212    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:16:02.739306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:02.739283    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:16:04.817794 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:04.817759    2558 generic.go:356] "Generic (PLEG): container finished" podID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerID="f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d" exitCode=0
Sep 10 21:16:04.818248 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:04.817831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" event={"ID":"61d888b5-0f9d-4e35-a9f1-80147e40c78b","Type":"ContainerDied","Data":"f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d"}
Sep 10 21:16:04.818248 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:04.818243    2558 scope.go:117] "RemoveContainer" containerID="f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d"
Sep 10 21:16:04.819299 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:04.819269    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:04.819412 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:04.819354    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:04.819412 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:04.819404    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:05.826028 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:05.825994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" event={"ID":"61d888b5-0f9d-4e35-a9f1-80147e40c78b","Type":"ContainerStarted","Data":"f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9"}
Sep 10 21:16:05.858262 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:05.858225    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:16:05.858430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:05.858410    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:05.858480 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:05.858454    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 21:16:06.858680 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:06.858642    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:06.859288 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:06.859256    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 21:16:07.857850 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:07.857813    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:07.858167 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:07.858134    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 21:16:08.858704 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:08.858656    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:08.859210 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:08.858731    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 21:16:09.858409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:09.858373    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:09.858698 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:09.858667    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 21:16:10.866649 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:10.866607    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:10.867186 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:10.866676    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 21:16:11.655173 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:11.655141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:11.861390 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:11.861361    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:16:11.861759 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:11.861738    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:16:11.862565 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:11.862546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:16:12.453557 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.453526    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7658-1a67b5"]
Sep 10 21:16:12.455765 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.455748    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:12.458079 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.458056    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-858x8\""
Sep 10 21:16:12.463692 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.463671    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-1a67b5"]
Sep 10 21:16:12.506095 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.506060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5t2s\" (UniqueName: \"kubernetes.io/projected/91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d-kube-api-access-w5t2s\") pod \"test-curl-7658-1a67b5\" (UID: \"91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d\") " pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:12.606895 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.606853    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5t2s\" (UniqueName: \"kubernetes.io/projected/91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d-kube-api-access-w5t2s\") pod \"test-curl-7658-1a67b5\" (UID: \"91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d\") " pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:12.617298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.617264    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5t2s\" (UniqueName: \"kubernetes.io/projected/91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d-kube-api-access-w5t2s\") pod \"test-curl-7658-1a67b5\" (UID: \"91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d\") " pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:12.766107 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:12.766002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:13.035326 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:13.035298    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-1a67b5"]
Sep 10 21:16:13.036666 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:16:13.036622    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91a97a30_18aa_46fe_a5ef_e1c1c2ecd87d.slice/crio-4d6427bb4399424bdb8b09ed48efb4ac0cc4143b1e0c30d2c584dd7b7e36e32a WatchSource:0}: Error finding container 4d6427bb4399424bdb8b09ed48efb4ac0cc4143b1e0c30d2c584dd7b7e36e32a: Status 404 returned error can't find the container with id 4d6427bb4399424bdb8b09ed48efb4ac0cc4143b1e0c30d2c584dd7b7e36e32a
Sep 10 21:16:13.881374 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:13.881333    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-1a67b5" event={"ID":"91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d","Type":"ContainerStarted","Data":"15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b"}
Sep 10 21:16:13.881374 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:13.881378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-1a67b5" event={"ID":"91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d","Type":"ContainerStarted","Data":"4d6427bb4399424bdb8b09ed48efb4ac0cc4143b1e0c30d2c584dd7b7e36e32a"}
Sep 10 21:16:13.899887 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:13.899837    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7658-1a67b5" podStartSLOduration=1.899822524 podStartE2EDuration="1.899822524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:13.898278614 +0000 UTC m=+1102.809558471" watchObservedRunningTime="2026-09-10 21:16:13.899822524 +0000 UTC m=+1102.811102307"
Sep 10 21:16:14.507208 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.507175    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7658-1a67b5"]
Sep 10 21:16:14.511396 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.511365    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7658-1a67b5"]
Sep 10 21:16:14.630947 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.630906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:14.631361 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.631339    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7658-3b623c"]
Sep 10 21:16:14.631724 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.631713    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" containerName="test-curl-7658-1a67b5"
Sep 10 21:16:14.631770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.631727    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" containerName="test-curl-7658-1a67b5"
Sep 10 21:16:14.631810 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.631801    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" containerName="test-curl-7658-1a67b5"
Sep 10 21:16:14.633803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.633787    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:14.641278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.641254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-3b623c"]
Sep 10 21:16:14.723843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.723810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plv7z\" (UniqueName: \"kubernetes.io/projected/2cc370a9-ef06-4903-8544-56db2f735355-kube-api-access-plv7z\") pod \"test-curl-7658-3b623c\" (UID: \"2cc370a9-ef06-4903-8544-56db2f735355\") " pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:14.824535 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.824493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plv7z\" (UniqueName: \"kubernetes.io/projected/2cc370a9-ef06-4903-8544-56db2f735355-kube-api-access-plv7z\") pod \"test-curl-7658-3b623c\" (UID: \"2cc370a9-ef06-4903-8544-56db2f735355\") " pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:14.832653 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.832626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plv7z\" (UniqueName: \"kubernetes.io/projected/2cc370a9-ef06-4903-8544-56db2f735355-kube-api-access-plv7z\") pod \"test-curl-7658-3b623c\" (UID: \"2cc370a9-ef06-4903-8544-56db2f735355\") " pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:14.887780 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:14.887697    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7658-1a67b5" container="test-curl-7658-1a67b5"
Sep 10 21:16:14.944081 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:14.944040    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:15.218130 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:15.218104    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-3b623c"]
Sep 10 21:16:15.219763 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:16:15.219734    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cc370a9_ef06_4903_8544_56db2f735355.slice/crio-acd996572492b5e01d0ab4aceec8865df708a47f72f22fc3375f46d9aa83610b WatchSource:0}: Error finding container acd996572492b5e01d0ab4aceec8865df708a47f72f22fc3375f46d9aa83610b: Status 404 returned error can't find the container with id acd996572492b5e01d0ab4aceec8865df708a47f72f22fc3375f46d9aa83610b
Sep 10 21:16:15.895734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:15.895695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-3b623c" event={"ID":"2cc370a9-ef06-4903-8544-56db2f735355","Type":"ContainerStarted","Data":"2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402"}
Sep 10 21:16:15.896203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:15.895746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-3b623c" event={"ID":"2cc370a9-ef06-4903-8544-56db2f735355","Type":"ContainerStarted","Data":"acd996572492b5e01d0ab4aceec8865df708a47f72f22fc3375f46d9aa83610b"}
Sep 10 21:16:15.896203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:15.895904    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7658-1a67b5" podUID="91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" containerName="test-curl-7658-1a67b5" containerID="cri-o://15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b" gracePeriod=2
Sep 10 21:16:15.910989 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:15.910935    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7658-3b623c" podStartSLOduration=1.910921082 podStartE2EDuration="1.910921082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:15.908869066 +0000 UTC m=+1104.820148848" watchObservedRunningTime="2026-09-10 21:16:15.910921082 +0000 UTC m=+1104.822200864"
Sep 10 21:16:16.552189 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.552155    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7658-3b623c"]
Sep 10 21:16:16.557076 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.557026    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7658-3b623c"]
Sep 10 21:16:16.680636 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.680552    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7658-dcac12"]
Sep 10 21:16:16.680961 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.680947    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc370a9-ef06-4903-8544-56db2f735355" containerName="test-curl-7658-3b623c"
Sep 10 21:16:16.681011 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.680963    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc370a9-ef06-4903-8544-56db2f735355" containerName="test-curl-7658-3b623c"
Sep 10 21:16:16.681073 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.681031    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cc370a9-ef06-4903-8544-56db2f735355" containerName="test-curl-7658-3b623c"
Sep 10 21:16:16.682904 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.682888    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:16.691577 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.691553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-dcac12"]
Sep 10 21:16:16.739465 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.739424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2z5p\" (UniqueName: \"kubernetes.io/projected/ee079f42-b6ba-4899-aa93-51b68c1fb93c-kube-api-access-g2z5p\") pod \"test-curl-7658-dcac12\" (UID: \"ee079f42-b6ba-4899-aa93-51b68c1fb93c\") " pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:16.840874 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.840837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2z5p\" (UniqueName: \"kubernetes.io/projected/ee079f42-b6ba-4899-aa93-51b68c1fb93c-kube-api-access-g2z5p\") pod \"test-curl-7658-dcac12\" (UID: \"ee079f42-b6ba-4899-aa93-51b68c1fb93c\") " pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:16.850799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.850765    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2z5p\" (UniqueName: \"kubernetes.io/projected/ee079f42-b6ba-4899-aa93-51b68c1fb93c-kube-api-access-g2z5p\") pod \"test-curl-7658-dcac12\" (UID: \"ee079f42-b6ba-4899-aa93-51b68c1fb93c\") " pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:16.901821 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:16.901791    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7658-3b623c" container="test-curl-7658-3b623c"
Sep 10 21:16:16.992295 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:16.992196    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:17.261062 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:17.261016    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-dcac12"]
Sep 10 21:16:17.262739 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:16:17.262698    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee079f42_b6ba_4899_aa93_51b68c1fb93c.slice/crio-7645e4291bde3bfcd3e08cc4d7134c0738042891353f68273e4ab96cbc19d014 WatchSource:0}: Error finding container 7645e4291bde3bfcd3e08cc4d7134c0738042891353f68273e4ab96cbc19d014: Status 404 returned error can't find the container with id 7645e4291bde3bfcd3e08cc4d7134c0738042891353f68273e4ab96cbc19d014
Sep 10 21:16:17.911276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:17.911250    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-dcac12" event={"ID":"ee079f42-b6ba-4899-aa93-51b68c1fb93c","Type":"ContainerStarted","Data":"4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1"}
Sep 10 21:16:17.911595 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:17.911290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-dcac12" event={"ID":"ee079f42-b6ba-4899-aa93-51b68c1fb93c","Type":"ContainerStarted","Data":"7645e4291bde3bfcd3e08cc4d7134c0738042891353f68273e4ab96cbc19d014"}
Sep 10 21:16:17.911595 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:17.911508    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7658-3b623c" podUID="2cc370a9-ef06-4903-8544-56db2f735355" containerName="test-curl-7658-3b623c" containerID="cri-o://2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402" gracePeriod=2
Sep 10 21:16:17.927400 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:17.927353    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7658-dcac12" podStartSLOduration=1.927339213 podStartE2EDuration="1.927339213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:17.925297252 +0000 UTC m=+1106.836577035" watchObservedRunningTime="2026-09-10 21:16:17.927339213 +0000 UTC m=+1106.838618995"
Sep 10 21:16:18.068515 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.068488    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:18.154360 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.154286    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5t2s\" (UniqueName: \"kubernetes.io/projected/91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d-kube-api-access-w5t2s\") pod \"91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d\" (UID: \"91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d\") "
Sep 10 21:16:18.156258 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.156230    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d-kube-api-access-w5t2s" (OuterVolumeSpecName: "kube-api-access-w5t2s") pod "91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" (UID: "91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d"). InnerVolumeSpecName "kube-api-access-w5t2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:16:18.255107 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.255076    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5t2s\" (UniqueName: \"kubernetes.io/projected/91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d-kube-api-access-w5t2s\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:18.525114 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.525013    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7658-dcac12"]
Sep 10 21:16:18.530027 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.529981    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7658-dcac12"]
Sep 10 21:16:18.652834 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.652789    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7658-558a27"]
Sep 10 21:16:18.653335 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.653314    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee079f42-b6ba-4899-aa93-51b68c1fb93c" containerName="test-curl-7658-dcac12"
Sep 10 21:16:18.653335 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.653336    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee079f42-b6ba-4899-aa93-51b68c1fb93c" containerName="test-curl-7658-dcac12"
Sep 10 21:16:18.653513 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.653437    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee079f42-b6ba-4899-aa93-51b68c1fb93c" containerName="test-curl-7658-dcac12"
Sep 10 21:16:18.655380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.655359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:18.661884 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.661862    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-558a27"]
Sep 10 21:16:18.760076 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.760026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc72k\" (UniqueName: \"kubernetes.io/projected/333f338e-2889-4cf7-8ccd-24bcdce7e6fa-kube-api-access-sc72k\") pod \"test-curl-7658-558a27\" (UID: \"333f338e-2889-4cf7-8ccd-24bcdce7e6fa\") " pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:18.861514 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.861472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc72k\" (UniqueName: \"kubernetes.io/projected/333f338e-2889-4cf7-8ccd-24bcdce7e6fa-kube-api-access-sc72k\") pod \"test-curl-7658-558a27\" (UID: \"333f338e-2889-4cf7-8ccd-24bcdce7e6fa\") " pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:18.871182 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.871149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc72k\" (UniqueName: \"kubernetes.io/projected/333f338e-2889-4cf7-8ccd-24bcdce7e6fa-kube-api-access-sc72k\") pod \"test-curl-7658-558a27\" (UID: \"333f338e-2889-4cf7-8ccd-24bcdce7e6fa\") " pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:18.918505 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.918469    2558 generic.go:356] "Generic (PLEG): container finished" podID="91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" containerID="15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b" exitCode=137
Sep 10 21:16:18.918854 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.918514    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:18.918854 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.918569    2558 scope.go:117] "RemoveContainer" containerID="15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b"
Sep 10 21:16:18.918958 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:18.918886    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7658-dcac12" container="test-curl-7658-dcac12"
Sep 10 21:16:18.928257 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.928240    2558 scope.go:117] "RemoveContainer" containerID="15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b"
Sep 10 21:16:18.928534 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:18.928514    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b\": container with ID starting with 15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b not found: ID does not exist" containerID="15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b"
Sep 10 21:16:18.928608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.928542    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b"} err="failed to get container status \"15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b\": rpc error: code = NotFound desc = could not find container \"15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b\": container with ID starting with 15a53deec2aff2c75d9ad0667ca98cfd62c2ba87289962823992faebf42a822b not found: ID does not exist"
Sep 10 21:16:18.929883 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:18.929861    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7658-1a67b5\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" pod="opendatahub/test-curl-7658-1a67b5"
Sep 10 21:16:18.966373 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:18.966340    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:19.199834 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:19.199757    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:16:19.237173 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:19.237140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7658-558a27"]
Sep 10 21:16:19.238273 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:16:19.238246    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod333f338e_2889_4cf7_8ccd_24bcdce7e6fa.slice/crio-6fde71337f3492a3165915475281dad541da5c76822a65b293358d21536cbac2 WatchSource:0}: Error finding container 6fde71337f3492a3165915475281dad541da5c76822a65b293358d21536cbac2: Status 404 returned error can't find the container with id 6fde71337f3492a3165915475281dad541da5c76822a65b293358d21536cbac2
Sep 10 21:16:19.615361 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:19.615327    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d" path="/var/lib/kubelet/pods/91a97a30-18aa-46fe-a5ef-e1c1c2ecd87d/volumes"
Sep 10 21:16:19.928956 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:19.928923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-558a27" event={"ID":"333f338e-2889-4cf7-8ccd-24bcdce7e6fa","Type":"ContainerStarted","Data":"7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29"}
Sep 10 21:16:19.929301 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:19.928980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7658-558a27" event={"ID":"333f338e-2889-4cf7-8ccd-24bcdce7e6fa","Type":"ContainerStarted","Data":"6fde71337f3492a3165915475281dad541da5c76822a65b293358d21536cbac2"}
Sep 10 21:16:19.929301 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:19.928992    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7658-dcac12" podUID="ee079f42-b6ba-4899-aa93-51b68c1fb93c" containerName="test-curl-7658-dcac12" containerID="cri-o://4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1" gracePeriod=2
Sep 10 21:16:19.948598 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:19.946551    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7658-558a27" podStartSLOduration=1.946529349 podStartE2EDuration="1.946529349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:19.946143183 +0000 UTC m=+1108.857422977" watchObservedRunningTime="2026-09-10 21:16:19.946529349 +0000 UTC m=+1108.857809133"
Sep 10 21:16:20.062863 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.062836    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:20.174821 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.174743    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plv7z\" (UniqueName: \"kubernetes.io/projected/2cc370a9-ef06-4903-8544-56db2f735355-kube-api-access-plv7z\") pod \"2cc370a9-ef06-4903-8544-56db2f735355\" (UID: \"2cc370a9-ef06-4903-8544-56db2f735355\") "
Sep 10 21:16:20.176965 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.176918    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc370a9-ef06-4903-8544-56db2f735355-kube-api-access-plv7z" (OuterVolumeSpecName: "kube-api-access-plv7z") pod "2cc370a9-ef06-4903-8544-56db2f735355" (UID: "2cc370a9-ef06-4903-8544-56db2f735355"). InnerVolumeSpecName "kube-api-access-plv7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:16:20.275538 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.275509    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plv7z\" (UniqueName: \"kubernetes.io/projected/2cc370a9-ef06-4903-8544-56db2f735355-kube-api-access-plv7z\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:20.563355 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.563302    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7658-558a27"]
Sep 10 21:16:20.568700 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.567355    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7658-558a27"]
Sep 10 21:16:20.942402 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.942304    2558 generic.go:356] "Generic (PLEG): container finished" podID="2cc370a9-ef06-4903-8544-56db2f735355" containerID="2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402" exitCode=137
Sep 10 21:16:20.942402 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.942357    2558 scope.go:117] "RemoveContainer" containerID="2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402"
Sep 10 21:16:20.942402 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.942368    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:20.942960 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:20.942815    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7658-558a27" container="test-curl-7658-558a27"
Sep 10 21:16:20.952579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.952562    2558 scope.go:117] "RemoveContainer" containerID="2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402"
Sep 10 21:16:20.952869 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:20.952844    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402\": container with ID starting with 2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402 not found: ID does not exist" containerID="2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402"
Sep 10 21:16:20.952961 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:20.952876    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402"} err="failed to get container status \"2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402\": rpc error: code = NotFound desc = could not find container \"2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402\": container with ID starting with 2d9e5b8009d66fd4205cbd900927530b995b420bdc6c986fa3d3c7ed3364f402 not found: ID does not exist"
Sep 10 21:16:20.954690 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:20.954665    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7658-3b623c\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="2cc370a9-ef06-4903-8544-56db2f735355" pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:21.192665 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.192580    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:21.469600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.469504    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"]
Sep 10 21:16:21.470057 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.470028    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333f338e-2889-4cf7-8ccd-24bcdce7e6fa" containerName="test-curl-7658-558a27"
Sep 10 21:16:21.470129 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.470068    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="333f338e-2889-4cf7-8ccd-24bcdce7e6fa" containerName="test-curl-7658-558a27"
Sep 10 21:16:21.470170 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.470152    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="333f338e-2889-4cf7-8ccd-24bcdce7e6fa" containerName="test-curl-7658-558a27"
Sep 10 21:16:21.474540 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.474523    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.476694 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:21.476653    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7658-3b623c\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="2cc370a9-ef06-4903-8544-56db2f735355" pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:21.476937 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.476917    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-669d5f22-openshift-default-dockercfg-z9c82\""
Sep 10 21:16:21.487316 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.487290    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"]
Sep 10 21:16:21.492227 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.492201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:21.587589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-socket\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-envoy\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-token\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-podinfo\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istiod-ca-cert\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-certs\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-data\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27kl9\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-kube-api-access-27kl9\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.587855 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.587800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-credential-socket\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.614326 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:21.614284    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7658-3b623c\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="2cc370a9-ef06-4903-8544-56db2f735355" pod="opendatahub/test-curl-7658-3b623c"
Sep 10 21:16:21.617112 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.617082    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc370a9-ef06-4903-8544-56db2f735355" path="/var/lib/kubelet/pods/2cc370a9-ef06-4903-8544-56db2f735355/volumes"
Sep 10 21:16:21.688724 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-podinfo\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.688892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istiod-ca-cert\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.688892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-certs\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.688892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-data\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.688892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27kl9\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-kube-api-access-27kl9\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.688892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-credential-socket\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.688892 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-socket\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.689222 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-envoy\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.689222 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.688927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-token\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.689335 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.689295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-socket\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.689390 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.689357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-certs\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.689479 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.689457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-data\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.689544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.689501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-credential-socket\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.689587 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.689558    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istiod-ca-cert\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.691391 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.691365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-envoy\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.691551 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.691533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-podinfo\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.696812 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.696790    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-token\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.697149 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.697126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27kl9\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-kube-api-access-27kl9\") pod \"e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") " pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.707345 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.707318    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:21.786947 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.786857    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:21.950658 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:21.950619    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7658-558a27" podUID="333f338e-2889-4cf7-8ccd-24bcdce7e6fa" containerName="test-curl-7658-558a27" containerID="cri-o://7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29" gracePeriod=2
Sep 10 21:16:22.068211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.068186    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:22.080377 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.080348    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"]
Sep 10 21:16:22.080780 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:16:22.080757    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae7b9bd_a7d9_4835_8f6b_27cde32b243e.slice/crio-9fe896a3c609220f64294c5e16bc8d7ca65ea590d71b02306b664c9c0bb2fa93 WatchSource:0}: Error finding container 9fe896a3c609220f64294c5e16bc8d7ca65ea590d71b02306b664c9c0bb2fa93: Status 404 returned error can't find the container with id 9fe896a3c609220f64294c5e16bc8d7ca65ea590d71b02306b664c9c0bb2fa93
Sep 10 21:16:22.083122 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.083087    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:22.083204 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.083161    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:22.083204 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.083191    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:22.194133 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.194099    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2z5p\" (UniqueName: \"kubernetes.io/projected/ee079f42-b6ba-4899-aa93-51b68c1fb93c-kube-api-access-g2z5p\") pod \"ee079f42-b6ba-4899-aa93-51b68c1fb93c\" (UID: \"ee079f42-b6ba-4899-aa93-51b68c1fb93c\") "
Sep 10 21:16:22.196390 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.196358    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee079f42-b6ba-4899-aa93-51b68c1fb93c-kube-api-access-g2z5p" (OuterVolumeSpecName: "kube-api-access-g2z5p") pod "ee079f42-b6ba-4899-aa93-51b68c1fb93c" (UID: "ee079f42-b6ba-4899-aa93-51b68c1fb93c"). InnerVolumeSpecName "kube-api-access-g2z5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:16:22.294939 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.294898    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2z5p\" (UniqueName: \"kubernetes.io/projected/ee079f42-b6ba-4899-aa93-51b68c1fb93c-kube-api-access-g2z5p\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:22.958663 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.958559    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" event={"ID":"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e","Type":"ContainerStarted","Data":"49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398"}
Sep 10 21:16:22.958663 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.958626    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" event={"ID":"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e","Type":"ContainerStarted","Data":"9fe896a3c609220f64294c5e16bc8d7ca65ea590d71b02306b664c9c0bb2fa93"}
Sep 10 21:16:22.959993 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.959970    2558 generic.go:356] "Generic (PLEG): container finished" podID="ee079f42-b6ba-4899-aa93-51b68c1fb93c" containerID="4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1" exitCode=137
Sep 10 21:16:22.960092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.960011    2558 scope.go:117] "RemoveContainer" containerID="4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1"
Sep 10 21:16:22.960092 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.960014    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:22.969507 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.969487    2558 scope.go:117] "RemoveContainer" containerID="4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1"
Sep 10 21:16:22.969769 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:22.969751    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1\": container with ID starting with 4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1 not found: ID does not exist" containerID="4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1"
Sep 10 21:16:22.969832 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.969782    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1"} err="failed to get container status \"4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1\": rpc error: code = NotFound desc = could not find container \"4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1\": container with ID starting with 4ad956d246adb72f727813ed635c82f4db85c06f072b7090a333afeec9bb3be1 not found: ID does not exist"
Sep 10 21:16:22.978981 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:22.978937    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podStartSLOduration=1.978925555 podStartE2EDuration="1.978925555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:22.978270886 +0000 UTC m=+1111.889550690" watchObservedRunningTime="2026-09-10 21:16:22.978925555 +0000 UTC m=+1111.890205337"
Sep 10 21:16:22.980190 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:22.980164    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7658-dcac12\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="ee079f42-b6ba-4899-aa93-51b68c1fb93c" pod="opendatahub/test-curl-7658-dcac12"
Sep 10 21:16:23.616417 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:23.616383    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee079f42-b6ba-4899-aa93-51b68c1fb93c" path="/var/lib/kubelet/pods/ee079f42-b6ba-4899-aa93-51b68c1fb93c/volumes"
Sep 10 21:16:23.787429 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:23.787397    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:23.792732 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:23.792712    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:23.967429 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:23.967406    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:23.968794 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:23.968777    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:24.149081 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.149058    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:24.212697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.212610    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc72k\" (UniqueName: \"kubernetes.io/projected/333f338e-2889-4cf7-8ccd-24bcdce7e6fa-kube-api-access-sc72k\") pod \"333f338e-2889-4cf7-8ccd-24bcdce7e6fa\" (UID: \"333f338e-2889-4cf7-8ccd-24bcdce7e6fa\") "
Sep 10 21:16:24.214749 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.214718    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/333f338e-2889-4cf7-8ccd-24bcdce7e6fa-kube-api-access-sc72k" (OuterVolumeSpecName: "kube-api-access-sc72k") pod "333f338e-2889-4cf7-8ccd-24bcdce7e6fa" (UID: "333f338e-2889-4cf7-8ccd-24bcdce7e6fa"). InnerVolumeSpecName "kube-api-access-sc72k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:16:24.313733 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.313700    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc72k\" (UniqueName: \"kubernetes.io/projected/333f338e-2889-4cf7-8ccd-24bcdce7e6fa-kube-api-access-sc72k\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:24.921902 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.921861    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:24.974507 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.974477    2558 generic.go:356] "Generic (PLEG): container finished" podID="333f338e-2889-4cf7-8ccd-24bcdce7e6fa" containerID="7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29" exitCode=137
Sep 10 21:16:24.974963 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.974536    2558 scope.go:117] "RemoveContainer" containerID="7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29"
Sep 10 21:16:24.974963 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.974537    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:24.984227 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.984211    2558 scope.go:117] "RemoveContainer" containerID="7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29"
Sep 10 21:16:24.984510 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:24.984491    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29\": container with ID starting with 7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29 not found: ID does not exist" containerID="7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29"
Sep 10 21:16:24.984566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:24.984517    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29"} err="failed to get container status \"7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29\": rpc error: code = NotFound desc = could not find container \"7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29\": container with ID starting with 7d04bf690d04396d376f2a1e6369d814233cf4ba8d83eb83b91a64903caadc29 not found: ID does not exist"
Sep 10 21:16:24.984899 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:24.984873    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7658-558a27\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="333f338e-2889-4cf7-8ccd-24bcdce7e6fa" pod="opendatahub/test-curl-7658-558a27"
Sep 10 21:16:25.018586 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:25.018536    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:25.615421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:25.615379    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="333f338e-2889-4cf7-8ccd-24bcdce7e6fa" path="/var/lib/kubelet/pods/333f338e-2889-4cf7-8ccd-24bcdce7e6fa/volumes"
Sep 10 21:16:26.224397 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.224365    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"]
Sep 10 21:16:26.228300 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.228219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.230502 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.230474    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-669d5f22-serving-cert\""
Sep 10 21:16:26.240072 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.240030    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"]
Sep 10 21:16:26.267153 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.267125    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:26.339416 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.339379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-metrics-certs\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.339809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.339695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fpdw\" (UniqueName: \"kubernetes.io/projected/84127cce-18ab-4d76-95a4-f8582dea9cde-kube-api-access-5fpdw\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.339809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.339783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.340037 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.339843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84127cce-18ab-4d76-95a4-f8582dea9cde-openshift-service-ca\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.364437 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.364404    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:26.441244 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.441213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.441399 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.441258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84127cce-18ab-4d76-95a4-f8582dea9cde-openshift-service-ca\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.441399 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.441328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-metrics-certs\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.441399 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:26.441358    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-serving-cert: secret "maas-api-e2e-mt-669d5f22-serving-cert" not found
Sep 10 21:16:26.441592 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:16:26.441430    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls podName:84127cce-18ab-4d76-95a4-f8582dea9cde nodeName:}" failed. No retries permitted until 2026-09-10 21:16:26.941414326 +0000 UTC m=+1115.852694085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls") pod "maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd" (UID: "84127cce-18ab-4d76-95a4-f8582dea9cde") : secret "maas-api-e2e-mt-669d5f22-serving-cert" not found
Sep 10 21:16:26.441592 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.441358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fpdw\" (UniqueName: \"kubernetes.io/projected/84127cce-18ab-4d76-95a4-f8582dea9cde-kube-api-access-5fpdw\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.441970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.441948    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84127cce-18ab-4d76-95a4-f8582dea9cde-openshift-service-ca\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.444313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.444288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-metrics-certs\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.451077 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.451017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fpdw\" (UniqueName: \"kubernetes.io/projected/84127cce-18ab-4d76-95a4-f8582dea9cde-kube-api-access-5fpdw\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.557686 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.557647    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:26.847062 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.846964    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:26.946295 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.946263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:26.948253 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.948221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:26.949399 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:26.949376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls\") pod \"maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:27.140143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:27.140054    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:27.429764 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:27.429734    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"]
Sep 10 21:16:27.431057 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:16:27.431022    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84127cce_18ab_4d76_95a4_f8582dea9cde.slice/crio-3fcefde75f0ecdeae6d4806bc547b06606226c18760d64338eb7f0cad836cdc4 WatchSource:0}: Error finding container 3fcefde75f0ecdeae6d4806bc547b06606226c18760d64338eb7f0cad836cdc4: Status 404 returned error can't find the container with id 3fcefde75f0ecdeae6d4806bc547b06606226c18760d64338eb7f0cad836cdc4
Sep 10 21:16:28.019534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:28.019508    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd" event={"ID":"84127cce-18ab-4d76-95a4-f8582dea9cde","Type":"ContainerStarted","Data":"5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34"}
Sep 10 21:16:28.019756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:28.019557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd" event={"ID":"84127cce-18ab-4d76-95a4-f8582dea9cde","Type":"ContainerStarted","Data":"3fcefde75f0ecdeae6d4806bc547b06606226c18760d64338eb7f0cad836cdc4"}
Sep 10 21:16:28.019756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:28.019611    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:28.038540 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:28.038494    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd" podStartSLOduration=1.523555269 podStartE2EDuration="2.038479487s" totalImagesPullingTime="514.924218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:28.035924619 +0000 UTC m=+1116.947204420" watchObservedRunningTime="2026-09-10 21:16:28.038479487 +0000 UTC m=+1116.949759268"
Sep 10 21:16:34.030358 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:34.030321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:16:37.413574 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:37.413533    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:16:48.139890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:48.139856    2558 generic.go:356] "Generic (PLEG): container finished" podID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerID="49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398" exitCode=0
Sep 10 21:16:48.140340 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:48.139934    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" event={"ID":"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e","Type":"ContainerDied","Data":"49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398"}
Sep 10 21:16:48.140472 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:48.140454    2558 scope.go:117] "RemoveContainer" containerID="49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398"
Sep 10 21:16:48.141607 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:48.141579    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:48.141671 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:48.141647    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:48.141708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:48.141679    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:16:49.151196 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:49.151153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" event={"ID":"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e","Type":"ContainerStarted","Data":"a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a"}
Sep 10 21:16:49.787540 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:49.787501    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:49.788678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:49.788653    2558 patch_prober.go:28] interesting pod/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 21:16:49.788739 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:49.788713    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 21:16:49.910107 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:49.910076    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:50.787732 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:50.787687    2558 patch_prober.go:28] interesting pod/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 21:16:50.788155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:50.787749    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 21:16:51.788184 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:51.788149    2558 patch_prober.go:28] interesting pod/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 21:16:51.788579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:51.788206    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 21:16:52.043156 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:52.043068    2558 scope.go:117] "RemoveContainer" containerID="f9637935a4fb914c94f82f92411cf819df7982aea9f42065afb7e28698dd5437"
Sep 10 21:16:52.787318 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:52.787279    2558 patch_prober.go:28] interesting pod/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 21:16:52.787504 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:52.787337    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 21:16:53.787327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:53.787290    2558 patch_prober.go:28] interesting pod/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 10 21:16:53.787714 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:53.787346    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 10 21:16:53.967594 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:53.967548    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:54.400914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:54.400877    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:16:54.817825 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:54.817788    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:54.819540 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:54.819514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:16:58.324166 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:58.324132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:59.025933 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:16:59.025898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:03.460314 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:03.460270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:14.003996 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:14.003911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:17:32.603824 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:32.603782    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:17:39.784885 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:39.784843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:51.109188 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:51.109153    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:17:55.218353 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.218310    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"]
Sep 10 21:17:55.218793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.218562    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd" podUID="84127cce-18ab-4d76-95a4-f8582dea9cde" containerName="maas-api" containerID="cri-o://5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34" gracePeriod=30
Sep 10 21:17:55.251570 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.251535    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:55.351419 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.351387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:55.450791 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.450761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:55.466463 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.466438    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:17:55.552887 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.552856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:55.555421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.555373    2558 generic.go:356] "Generic (PLEG): container finished" podID="84127cce-18ab-4d76-95a4-f8582dea9cde" containerID="5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34" exitCode=0
Sep 10 21:17:55.555549 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.555428    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"
Sep 10 21:17:55.555549 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.555450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd" event={"ID":"84127cce-18ab-4d76-95a4-f8582dea9cde","Type":"ContainerDied","Data":"5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34"}
Sep 10 21:17:55.555549 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.555505    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd" event={"ID":"84127cce-18ab-4d76-95a4-f8582dea9cde","Type":"ContainerDied","Data":"3fcefde75f0ecdeae6d4806bc547b06606226c18760d64338eb7f0cad836cdc4"}
Sep 10 21:17:55.555549 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.555537    2558 scope.go:117] "RemoveContainer" containerID="5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34"
Sep 10 21:17:55.566922 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.566896    2558 scope.go:117] "RemoveContainer" containerID="5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34"
Sep 10 21:17:55.567310 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:17:55.567283    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34\": container with ID starting with 5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34 not found: ID does not exist" containerID="5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34"
Sep 10 21:17:55.567395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.567323    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34"} err="failed to get container status \"5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34\": rpc error: code = NotFound desc = could not find container \"5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34\": container with ID starting with 5813a0a953c5974637c3f505d8b7fd93b5bfe1a9bfcd9f5973e562b5b4cb2d34 not found: ID does not exist"
Sep 10 21:17:55.621069 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.620377    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-metrics-certs\") pod \"84127cce-18ab-4d76-95a4-f8582dea9cde\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") "
Sep 10 21:17:55.621069 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.620427    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84127cce-18ab-4d76-95a4-f8582dea9cde-openshift-service-ca\") pod \"84127cce-18ab-4d76-95a4-f8582dea9cde\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") "
Sep 10 21:17:55.621069 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.620463    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls\") pod \"84127cce-18ab-4d76-95a4-f8582dea9cde\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") "
Sep 10 21:17:55.621069 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.620589    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fpdw\" (UniqueName: \"kubernetes.io/projected/84127cce-18ab-4d76-95a4-f8582dea9cde-kube-api-access-5fpdw\") pod \"84127cce-18ab-4d76-95a4-f8582dea9cde\" (UID: \"84127cce-18ab-4d76-95a4-f8582dea9cde\") "
Sep 10 21:17:55.621446 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.621304    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84127cce-18ab-4d76-95a4-f8582dea9cde-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84127cce-18ab-4d76-95a4-f8582dea9cde" (UID: "84127cce-18ab-4d76-95a4-f8582dea9cde"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:17:55.625287 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.625218    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84127cce-18ab-4d76-95a4-f8582dea9cde-kube-api-access-5fpdw" (OuterVolumeSpecName: "kube-api-access-5fpdw") pod "84127cce-18ab-4d76-95a4-f8582dea9cde" (UID: "84127cce-18ab-4d76-95a4-f8582dea9cde"). InnerVolumeSpecName "kube-api-access-5fpdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:17:55.629422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.629392    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84127cce-18ab-4d76-95a4-f8582dea9cde" (UID: "84127cce-18ab-4d76-95a4-f8582dea9cde"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:17:55.630770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.630747    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "84127cce-18ab-4d76-95a4-f8582dea9cde" (UID: "84127cce-18ab-4d76-95a4-f8582dea9cde"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:17:55.721952 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.721921    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fpdw\" (UniqueName: \"kubernetes.io/projected/84127cce-18ab-4d76-95a4-f8582dea9cde-kube-api-access-5fpdw\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:17:55.721952 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.721950    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:17:55.721952 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.721959    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84127cce-18ab-4d76-95a4-f8582dea9cde-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:17:55.722220 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.721971    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84127cce-18ab-4d76-95a4-f8582dea9cde-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:17:55.878265 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.878231    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"]
Sep 10 21:17:55.882415 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:55.882393    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-669d5f22-54ddb6cf75-7prbd"]
Sep 10 21:17:57.615201 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:57.615168    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84127cce-18ab-4d76-95a4-f8582dea9cde" path="/var/lib/kubelet/pods/84127cce-18ab-4d76-95a4-f8582dea9cde/volumes"
Sep 10 21:17:58.750809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:17:58.750766    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:03.827161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:03.827123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:08.913625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:08.913587    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:18:17.957988 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:17.957949    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:22.505449 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:22.505387    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:18:33.893352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.893316    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7661-3e5db8"]
Sep 10 21:18:33.893786 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.893711    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84127cce-18ab-4d76-95a4-f8582dea9cde" containerName="maas-api"
Sep 10 21:18:33.893786 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.893722    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84127cce-18ab-4d76-95a4-f8582dea9cde" containerName="maas-api"
Sep 10 21:18:33.893873 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.893795    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84127cce-18ab-4d76-95a4-f8582dea9cde" containerName="maas-api"
Sep 10 21:18:33.897104 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.897084    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-3e5db8"
Sep 10 21:18:33.899234 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.899213    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-858x8\""
Sep 10 21:18:33.903497 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.903471    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7661-3e5db8"]
Sep 10 21:18:33.980803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:33.980760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fxmd\" (UniqueName: \"kubernetes.io/projected/d51b76c4-6da1-4021-a7de-b6ece80f3d45-kube-api-access-7fxmd\") pod \"test-curl-7661-3e5db8\" (UID: \"d51b76c4-6da1-4021-a7de-b6ece80f3d45\") " pod="opendatahub/test-curl-7661-3e5db8"
Sep 10 21:18:34.082383 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:34.082340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fxmd\" (UniqueName: \"kubernetes.io/projected/d51b76c4-6da1-4021-a7de-b6ece80f3d45-kube-api-access-7fxmd\") pod \"test-curl-7661-3e5db8\" (UID: \"d51b76c4-6da1-4021-a7de-b6ece80f3d45\") " pod="opendatahub/test-curl-7661-3e5db8"
Sep 10 21:18:34.092248 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:34.092222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fxmd\" (UniqueName: \"kubernetes.io/projected/d51b76c4-6da1-4021-a7de-b6ece80f3d45-kube-api-access-7fxmd\") pod \"test-curl-7661-3e5db8\" (UID: \"d51b76c4-6da1-4021-a7de-b6ece80f3d45\") " pod="opendatahub/test-curl-7661-3e5db8"
Sep 10 21:18:34.208666 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:34.208570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-3e5db8"
Sep 10 21:18:34.479903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:34.479870    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7661-3e5db8"]
Sep 10 21:18:34.480920 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:18:34.480888    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd51b76c4_6da1_4021_a7de_b6ece80f3d45.slice/crio-1a51eea4365303119ad262301eac12f9dc631ca5821c039dbdc6ce2045197d2e WatchSource:0}: Error finding container 1a51eea4365303119ad262301eac12f9dc631ca5821c039dbdc6ce2045197d2e: Status 404 returned error can't find the container with id 1a51eea4365303119ad262301eac12f9dc631ca5821c039dbdc6ce2045197d2e
Sep 10 21:18:34.786325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:34.786233    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7661-3e5db8" event={"ID":"d51b76c4-6da1-4021-a7de-b6ece80f3d45","Type":"ContainerStarted","Data":"c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27"}
Sep 10 21:18:34.786325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:34.786279    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7661-3e5db8" event={"ID":"d51b76c4-6da1-4021-a7de-b6ece80f3d45","Type":"ContainerStarted","Data":"1a51eea4365303119ad262301eac12f9dc631ca5821c039dbdc6ce2045197d2e"}
Sep 10 21:18:34.803209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:34.803163    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7661-3e5db8" podStartSLOduration=1.803148486 podStartE2EDuration="1.803148486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:18:34.801579835 +0000 UTC m=+1243.712859641" watchObservedRunningTime="2026-09-10 21:18:34.803148486 +0000 UTC m=+1243.714428268"
Sep 10 21:18:35.409650 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:35.409616    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7661-3e5db8"]
Sep 10 21:18:35.414270 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:35.414237    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7661-3e5db8"]
Sep 10 21:18:35.791771 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:18:35.791741    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7661-3e5db8" container="test-curl-7661-3e5db8"
Sep 10 21:18:36.799920 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:36.799853    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7661-3e5db8" podUID="d51b76c4-6da1-4021-a7de-b6ece80f3d45" containerName="test-curl-7661-3e5db8" containerID="cri-o://c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27" gracePeriod=2
Sep 10 21:18:36.834132 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:36.834095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:37.948566 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:37.948530    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:38.983158 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:38.983132    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-3e5db8"
Sep 10 21:18:39.130731 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.130629    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fxmd\" (UniqueName: \"kubernetes.io/projected/d51b76c4-6da1-4021-a7de-b6ece80f3d45-kube-api-access-7fxmd\") pod \"d51b76c4-6da1-4021-a7de-b6ece80f3d45\" (UID: \"d51b76c4-6da1-4021-a7de-b6ece80f3d45\") "
Sep 10 21:18:39.132820 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.132789    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51b76c4-6da1-4021-a7de-b6ece80f3d45-kube-api-access-7fxmd" (OuterVolumeSpecName: "kube-api-access-7fxmd") pod "d51b76c4-6da1-4021-a7de-b6ece80f3d45" (UID: "d51b76c4-6da1-4021-a7de-b6ece80f3d45"). InnerVolumeSpecName "kube-api-access-7fxmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:18:39.232256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.232218    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fxmd\" (UniqueName: \"kubernetes.io/projected/d51b76c4-6da1-4021-a7de-b6ece80f3d45-kube-api-access-7fxmd\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:39.404131 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.404035    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:18:39.615654 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.615620    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51b76c4-6da1-4021-a7de-b6ece80f3d45" path="/var/lib/kubelet/pods/d51b76c4-6da1-4021-a7de-b6ece80f3d45/volumes"
Sep 10 21:18:39.818785 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.818751    2558 generic.go:356] "Generic (PLEG): container finished" podID="d51b76c4-6da1-4021-a7de-b6ece80f3d45" containerID="c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27" exitCode=137
Sep 10 21:18:39.818968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.818803    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-3e5db8"
Sep 10 21:18:39.818968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.818861    2558 scope.go:117] "RemoveContainer" containerID="c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27"
Sep 10 21:18:39.828001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.827981    2558 scope.go:117] "RemoveContainer" containerID="c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27"
Sep 10 21:18:39.828286 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:18:39.828269    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27\": container with ID starting with c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27 not found: ID does not exist" containerID="c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27"
Sep 10 21:18:39.828355 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:39.828293    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27"} err="failed to get container status \"c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27\": rpc error: code = NotFound desc = could not find container \"c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27\": container with ID starting with c7f2f134f00f1439330c604875a2c194c75f45f261057380cc6ba6785ff4ed27 not found: ID does not exist"
Sep 10 21:18:40.770146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:40.770112    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:41.264749 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:41.264709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:45.539034 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:45.538955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:47.432115 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:47.432086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:53.322386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:53.322346    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:53.424409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:53.424375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:53.579366 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:53.579280    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"]
Sep 10 21:18:53.579633 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:53.579527    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy" containerID="cri-o://a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a" gracePeriod=30
Sep 10 21:18:53.600018 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:53.599985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:54.820517 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:54.820484    2558 patch_prober.go:28] interesting pod/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:18:54.820889 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:54.820539    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:18:54.919244 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:54.919207    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:55.019034 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:55.019000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:55.118905 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:55.118821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:55.798436 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:55.798400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:55.892634 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:55.892591    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:55.993241 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:55.993210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:57.312223 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:57.312193    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:58.502297 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.502262    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:18:58.839200 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.839174    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:18:58.914738 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.914703    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-certs\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.914738 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.914740    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-socket\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.914968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.914798    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-credential-socket\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.914968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.914824    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-data\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.914968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.914858    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-envoy\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.914968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.914885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-podinfo\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.914968 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.914958    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istiod-ca-cert\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.915267 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915006    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-token\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.915267 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915073    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27kl9\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-kube-api-access-27kl9\") pod \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\" (UID: \"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e\") "
Sep 10 21:18:58.915267 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915076    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:58.915267 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915088    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:58.915482 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915365    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:18:58.915482 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915177    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:58.915482 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915218    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:58.915482 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915477    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:58.915695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915493    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:58.915695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915502    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:58.915695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915512    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:58.915695 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.915523    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:58.917240 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.917205    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:18:58.917335 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.917209    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:18:58.917335 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.917239    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:18:58.917335 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.917312    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-kube-api-access-27kl9" (OuterVolumeSpecName: "kube-api-access-27kl9") pod "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" (UID: "5ae7b9bd-a7d9-4835-8f6b-27cde32b243e"). InnerVolumeSpecName "kube-api-access-27kl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:18:58.941159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.941128    2558 generic.go:356] "Generic (PLEG): container finished" podID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerID="a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a" exitCode=0
Sep 10 21:18:58.941266 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.941187    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"
Sep 10 21:18:58.941266 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.941218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" event={"ID":"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e","Type":"ContainerDied","Data":"a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a"}
Sep 10 21:18:58.941341 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.941273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx" event={"ID":"5ae7b9bd-a7d9-4835-8f6b-27cde32b243e","Type":"ContainerDied","Data":"9fe896a3c609220f64294c5e16bc8d7ca65ea590d71b02306b664c9c0bb2fa93"}
Sep 10 21:18:58.941341 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.941302    2558 scope.go:117] "RemoveContainer" containerID="a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a"
Sep 10 21:18:58.951916 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.951896    2558 scope.go:117] "RemoveContainer" containerID="49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398"
Sep 10 21:18:58.960408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.960391    2558 scope.go:117] "RemoveContainer" containerID="a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a"
Sep 10 21:18:58.960685 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:18:58.960666    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a\": container with ID starting with a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a not found: ID does not exist" containerID="a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a"
Sep 10 21:18:58.960745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.960695    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a"} err="failed to get container status \"a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a\": rpc error: code = NotFound desc = could not find container \"a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a\": container with ID starting with a64273fca866534469b6669d85ce538d78196cbc35fef354f1787d5f6840337a not found: ID does not exist"
Sep 10 21:18:58.960745 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.960712    2558 scope.go:117] "RemoveContainer" containerID="49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398"
Sep 10 21:18:58.960995 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:18:58.960972    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398\": container with ID starting with 49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398 not found: ID does not exist" containerID="49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398"
Sep 10 21:18:58.960995 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.961007    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398"} err="failed to get container status \"49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398\": rpc error: code = NotFound desc = could not find container \"49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398\": container with ID starting with 49463aa1789734501a6d9af1bb8250f7e13b35ecde8b8ad4fb015ba7b462f398 not found: ID does not exist"
Sep 10 21:18:58.964543 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.964518    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"]
Sep 10 21:18:58.967435 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:58.967415    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-669d5f22-openshift-default-5bdf588c84-bt5tx"]
Sep 10 21:18:59.023183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:59.023143    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:59.023183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:59.023187    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27kl9\" (UniqueName: \"kubernetes.io/projected/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-kube-api-access-27kl9\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:59.023368 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:59.023203    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:59.023368 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:59.023216    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:59.615655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:18:59.615619    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" path="/var/lib/kubelet/pods/5ae7b9bd-a7d9-4835-8f6b-27cde32b243e/volumes"
Sep 10 21:19:03.484039 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:03.483997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:03.549177 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:03.549139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:04.228061 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:04.228012    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:10.476809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:10.476769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:10.582106 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:10.582070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:10.677943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:10.677905    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:15.809454 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:15.809422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:19:17.740138 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:17.740095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:21.211604 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:21.211572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:21.459463 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:21.459405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:28.107019 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:28.106983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:19:28.893430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:28.893389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:28.967660 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:28.967622    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:37.806060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:37.806004    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:19:42.418796 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:42.418761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:48.244465 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.244429    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7661-953a7a"]
Sep 10 21:19:48.244944 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.244875    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51b76c4-6da1-4021-a7de-b6ece80f3d45" containerName="test-curl-7661-3e5db8"
Sep 10 21:19:48.244944 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.244890    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51b76c4-6da1-4021-a7de-b6ece80f3d45" containerName="test-curl-7661-3e5db8"
Sep 10 21:19:48.244944 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.244901    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy"
Sep 10 21:19:48.244944 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.244907    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy"
Sep 10 21:19:48.244944 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.244931    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy"
Sep 10 21:19:48.244944 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.244937    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy"
Sep 10 21:19:48.245274 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.245001    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy"
Sep 10 21:19:48.245274 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.245011    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51b76c4-6da1-4021-a7de-b6ece80f3d45" containerName="test-curl-7661-3e5db8"
Sep 10 21:19:48.245274 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.245019    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae7b9bd-a7d9-4835-8f6b-27cde32b243e" containerName="istio-proxy"
Sep 10 21:19:48.248323 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.248299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:48.250886 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.250867    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-858x8\""
Sep 10 21:19:48.254405 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.254380    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7661-953a7a"]
Sep 10 21:19:48.396867 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.396827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hfr2\" (UniqueName: \"kubernetes.io/projected/d74602b9-14b6-4750-8257-4eb573787da9-kube-api-access-9hfr2\") pod \"test-curl-7661-953a7a\" (UID: \"d74602b9-14b6-4750-8257-4eb573787da9\") " pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:48.498336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.498251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfr2\" (UniqueName: \"kubernetes.io/projected/d74602b9-14b6-4750-8257-4eb573787da9-kube-api-access-9hfr2\") pod \"test-curl-7661-953a7a\" (UID: \"d74602b9-14b6-4750-8257-4eb573787da9\") " pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:48.506183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.506153    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hfr2\" (UniqueName: \"kubernetes.io/projected/d74602b9-14b6-4750-8257-4eb573787da9-kube-api-access-9hfr2\") pod \"test-curl-7661-953a7a\" (UID: \"d74602b9-14b6-4750-8257-4eb573787da9\") " pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:48.559271 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.559232    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:48.657813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.657778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:48.760227 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.760137    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:48.830251 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:48.830225    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7661-953a7a"]
Sep 10 21:19:48.831921 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:19:48.831897    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd74602b9_14b6_4750_8257_4eb573787da9.slice/crio-433bb771024a2d711c589b87f0b45947220ac15f1fc24480aacc791d50967c11 WatchSource:0}: Error finding container 433bb771024a2d711c589b87f0b45947220ac15f1fc24480aacc791d50967c11: Status 404 returned error can't find the container with id 433bb771024a2d711c589b87f0b45947220ac15f1fc24480aacc791d50967c11
Sep 10 21:19:49.015285 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.015206    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:49.235791 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.235757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7661-953a7a" event={"ID":"d74602b9-14b6-4750-8257-4eb573787da9","Type":"ContainerStarted","Data":"022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71"}
Sep 10 21:19:49.235791 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.235803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7661-953a7a" event={"ID":"d74602b9-14b6-4750-8257-4eb573787da9","Type":"ContainerStarted","Data":"433bb771024a2d711c589b87f0b45947220ac15f1fc24480aacc791d50967c11"}
Sep 10 21:19:49.251387 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.251339    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7661-953a7a" podStartSLOduration=1.251323904 podStartE2EDuration="1.251323904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:49.250739407 +0000 UTC m=+1318.162019190" watchObservedRunningTime="2026-09-10 21:19:49.251323904 +0000 UTC m=+1318.162603711"
Sep 10 21:19:49.293281 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.293197    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"]
Sep 10 21:19:49.296793 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.296770    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.299265 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.299246    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-0778a4-openshift-default-dockercfg-pm7xm\""
Sep 10 21:19:49.309186 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.309157    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"]
Sep 10 21:19:49.315604 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.315578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:49.407223 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-certs\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407223 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-data\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-token\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-credential-socket\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407412    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-socket\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-envoy\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhgcj\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-kube-api-access-jhgcj\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-podinfo\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.407647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.407576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84c1db87-206b-459a-a464-eecb7f12b0d7-istiod-ca-cert\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.475826 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.475793    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:49.508146 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-certs\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-data\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-token\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-credential-socket\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-socket\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-envoy\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhgcj\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-kube-api-access-jhgcj\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508634 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-podinfo\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508634 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-data\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508634 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84c1db87-206b-459a-a464-eecb7f12b0d7-istiod-ca-cert\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508786 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-credential-socket\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508786 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-certs\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.508906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.508887    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-socket\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.509268 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.509246    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84c1db87-206b-459a-a464-eecb7f12b0d7-istiod-ca-cert\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.510567 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.510544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-envoy\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.510890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.510874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-podinfo\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.516450 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.516424    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-token\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.516564 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.516543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhgcj\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-kube-api-access-jhgcj\") pod \"e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") " pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.609641 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.609601    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:49.862584 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.862501    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7661-953a7a"]
Sep 10 21:19:49.872764 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.872706    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7661-953a7a"]
Sep 10 21:19:49.890299 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.890263    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"]
Sep 10 21:19:49.891564 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:19:49.891536    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c1db87_206b_459a_a464_eecb7f12b0d7.slice/crio-0c4db1858b9c26acee0cbe92fe5658296cfd8260759eb43322985329a4cf2200 WatchSource:0}: Error finding container 0c4db1858b9c26acee0cbe92fe5658296cfd8260759eb43322985329a4cf2200: Status 404 returned error can't find the container with id 0c4db1858b9c26acee0cbe92fe5658296cfd8260759eb43322985329a4cf2200
Sep 10 21:19:49.894224 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.894192    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:19:49.894306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.894255    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:19:49.894306 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.894288    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:19:49.992631 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.992586    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7661-98cb2c"]
Sep 10 21:19:49.993294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.993267    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74602b9-14b6-4750-8257-4eb573787da9" containerName="test-curl-7661-953a7a"
Sep 10 21:19:49.993294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.993294    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74602b9-14b6-4750-8257-4eb573787da9" containerName="test-curl-7661-953a7a"
Sep 10 21:19:49.993441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.993398    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74602b9-14b6-4750-8257-4eb573787da9" containerName="test-curl-7661-953a7a"
Sep 10 21:19:49.996974 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:49.996953    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:50.002363 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.002329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7661-98cb2c"]
Sep 10 21:19:50.114932 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.114837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbhq2\" (UniqueName: \"kubernetes.io/projected/2e76f080-9c03-439d-858d-809748dcd94b-kube-api-access-bbhq2\") pod \"test-curl-7661-98cb2c\" (UID: \"2e76f080-9c03-439d-858d-809748dcd94b\") " pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:50.216204 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.216175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbhq2\" (UniqueName: \"kubernetes.io/projected/2e76f080-9c03-439d-858d-809748dcd94b-kube-api-access-bbhq2\") pod \"test-curl-7661-98cb2c\" (UID: \"2e76f080-9c03-439d-858d-809748dcd94b\") " pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:50.224750 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.224718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbhq2\" (UniqueName: \"kubernetes.io/projected/2e76f080-9c03-439d-858d-809748dcd94b-kube-api-access-bbhq2\") pod \"test-curl-7661-98cb2c\" (UID: \"2e76f080-9c03-439d-858d-809748dcd94b\") " pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:50.245192 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.245147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" event={"ID":"84c1db87-206b-459a-a464-eecb7f12b0d7","Type":"ContainerStarted","Data":"7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f"}
Sep 10 21:19:50.245350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.245220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" event={"ID":"84c1db87-206b-459a-a464-eecb7f12b0d7","Type":"ContainerStarted","Data":"0c4db1858b9c26acee0cbe92fe5658296cfd8260759eb43322985329a4cf2200"}
Sep 10 21:19:50.245547 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:50.245524    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7661-953a7a" container="test-curl-7661-953a7a"
Sep 10 21:19:50.284183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.284130    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podStartSLOduration=1.28411492 podStartE2EDuration="1.28411492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:50.281337654 +0000 UTC m=+1319.192617436" watchObservedRunningTime="2026-09-10 21:19:50.28411492 +0000 UTC m=+1319.195394701"
Sep 10 21:19:50.309340 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.309310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:50.581287 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.581259    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7661-98cb2c"]
Sep 10 21:19:50.582990 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:19:50.582962    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e76f080_9c03_439d_858d_809748dcd94b.slice/crio-ed4fea68a165c7af048637f6bedf16e5ece52ad7b38040bdce10ecea6b3aca36 WatchSource:0}: Error finding container ed4fea68a165c7af048637f6bedf16e5ece52ad7b38040bdce10ecea6b3aca36: Status 404 returned error can't find the container with id ed4fea68a165c7af048637f6bedf16e5ece52ad7b38040bdce10ecea6b3aca36
Sep 10 21:19:50.610524 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.610503    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:50.615473 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:50.615452    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:51.252589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.252553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7661-98cb2c" event={"ID":"2e76f080-9c03-439d-858d-809748dcd94b","Type":"ContainerStarted","Data":"84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74"}
Sep 10 21:19:51.252792 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.252604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7661-98cb2c" event={"ID":"2e76f080-9c03-439d-858d-809748dcd94b","Type":"ContainerStarted","Data":"ed4fea68a165c7af048637f6bedf16e5ece52ad7b38040bdce10ecea6b3aca36"}
Sep 10 21:19:51.252792 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.252645    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7661-953a7a" podUID="d74602b9-14b6-4750-8257-4eb573787da9" containerName="test-curl-7661-953a7a" containerID="cri-o://022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71" gracePeriod=2
Sep 10 21:19:51.252981 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.252965    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:51.254179 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.254158    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:19:51.254790 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:51.254768    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7661-953a7a\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="d74602b9-14b6-4750-8257-4eb573787da9" pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:51.271571 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.271521    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7661-98cb2c" podStartSLOduration=2.271505343 podStartE2EDuration="2.271505343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:51.269829761 +0000 UTC m=+1320.181109545" watchObservedRunningTime="2026-09-10 21:19:51.271505343 +0000 UTC m=+1320.182785124"
Sep 10 21:19:51.293671 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:51.293634    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7661-953a7a\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="d74602b9-14b6-4750-8257-4eb573787da9" pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:51.613654 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:51.613617    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7661-953a7a\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="d74602b9-14b6-4750-8257-4eb573787da9" pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:51.871407 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.871320    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7661-98cb2c"]
Sep 10 21:19:51.875663 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:51.875606    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7661-98cb2c"]
Sep 10 21:19:52.202339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:52.202310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:52.258671 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:52.258640    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7661-98cb2c" container="test-curl-7661-98cb2c"
Sep 10 21:19:52.298833 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:52.298804    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:53.264615 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.264562    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7661-98cb2c" podUID="2e76f080-9c03-439d-858d-809748dcd94b" containerName="test-curl-7661-98cb2c" containerID="cri-o://84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74" gracePeriod=2
Sep 10 21:19:53.266841 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:53.266813    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7661-98cb2c\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="2e76f080-9c03-439d-858d-809748dcd94b" pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:53.399881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.399844    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:53.421662 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.421639    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:53.423587 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:53.423559    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7661-98cb2c\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="2e76f080-9c03-439d-858d-809748dcd94b" pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:53.496589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.496533    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:53.550366 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.550343    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hfr2\" (UniqueName: \"kubernetes.io/projected/d74602b9-14b6-4750-8257-4eb573787da9-kube-api-access-9hfr2\") pod \"d74602b9-14b6-4750-8257-4eb573787da9\" (UID: \"d74602b9-14b6-4750-8257-4eb573787da9\") "
Sep 10 21:19:53.552530 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.552503    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74602b9-14b6-4750-8257-4eb573787da9-kube-api-access-9hfr2" (OuterVolumeSpecName: "kube-api-access-9hfr2") pod "d74602b9-14b6-4750-8257-4eb573787da9" (UID: "d74602b9-14b6-4750-8257-4eb573787da9"). InnerVolumeSpecName "kube-api-access-9hfr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:19:53.596800 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.596772    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:53.617057 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.617015    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74602b9-14b6-4750-8257-4eb573787da9" path="/var/lib/kubelet/pods/d74602b9-14b6-4750-8257-4eb573787da9/volumes"
Sep 10 21:19:53.651352 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.651322    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hfr2\" (UniqueName: \"kubernetes.io/projected/d74602b9-14b6-4750-8257-4eb573787da9-kube-api-access-9hfr2\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:53.876379 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.876290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:53.966719 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:53.966683    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:54.271829 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:54.271737    2558 generic.go:356] "Generic (PLEG): container finished" podID="d74602b9-14b6-4750-8257-4eb573787da9" containerID="022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71" exitCode=137
Sep 10 21:19:54.271829 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:54.271783    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-953a7a"
Sep 10 21:19:54.272036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:54.271840    2558 scope.go:117] "RemoveContainer" containerID="022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71"
Sep 10 21:19:54.280895 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:54.280878    2558 scope.go:117] "RemoveContainer" containerID="022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71"
Sep 10 21:19:54.281178 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:54.281157    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71\": container with ID starting with 022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71 not found: ID does not exist" containerID="022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71"
Sep 10 21:19:54.281226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:54.281187    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71"} err="failed to get container status \"022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71\": rpc error: code = NotFound desc = could not find container \"022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71\": container with ID starting with 022c10f521fb9cba687c8060ba02ffe7fae2a9167656790415490db3aaf49b71 not found: ID does not exist"
Sep 10 21:19:55.430002 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:55.429981    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:55.507972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:55.507942    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:55.570290 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:55.570259    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbhq2\" (UniqueName: \"kubernetes.io/projected/2e76f080-9c03-439d-858d-809748dcd94b-kube-api-access-bbhq2\") pod \"2e76f080-9c03-439d-858d-809748dcd94b\" (UID: \"2e76f080-9c03-439d-858d-809748dcd94b\") "
Sep 10 21:19:55.572207 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:55.572181    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e76f080-9c03-439d-858d-809748dcd94b-kube-api-access-bbhq2" (OuterVolumeSpecName: "kube-api-access-bbhq2") pod "2e76f080-9c03-439d-858d-809748dcd94b" (UID: "2e76f080-9c03-439d-858d-809748dcd94b"). InnerVolumeSpecName "kube-api-access-bbhq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:19:55.615852 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:55.615812    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e76f080-9c03-439d-858d-809748dcd94b" path="/var/lib/kubelet/pods/2e76f080-9c03-439d-858d-809748dcd94b/volumes"
Sep 10 21:19:55.671308 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:55.671271    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbhq2\" (UniqueName: \"kubernetes.io/projected/2e76f080-9c03-439d-858d-809748dcd94b-kube-api-access-bbhq2\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:56.286315 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:56.286279    2558 generic.go:356] "Generic (PLEG): container finished" podID="2e76f080-9c03-439d-858d-809748dcd94b" containerID="84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74" exitCode=137
Sep 10 21:19:56.286494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:56.286325    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7661-98cb2c"
Sep 10 21:19:56.286494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:56.286380    2558 scope.go:117] "RemoveContainer" containerID="84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74"
Sep 10 21:19:56.295341 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:56.295175    2558 scope.go:117] "RemoveContainer" containerID="84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74"
Sep 10 21:19:56.295442 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:19:56.295425    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74\": container with ID starting with 84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74 not found: ID does not exist" containerID="84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74"
Sep 10 21:19:56.295484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:56.295450    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74"} err="failed to get container status \"84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74\": rpc error: code = NotFound desc = could not find container \"84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74\": container with ID starting with 84efe0df54aaf050e988e1e894cb25e1cd9986cf1bdb2752fa135665e521ab74 not found: ID does not exist"
Sep 10 21:19:56.310543 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:56.310521    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:19:56.906866 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:56.906833    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:57.386622 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:57.386587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:59.207954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:19:59.207913    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:06.269401 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.269363    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": read tcp 10.133.0.2:53408->10.133.0.80:15021: read: connection reset by peer" start-of-body=
Sep 10 21:20:06.269835 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.269453    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": read tcp 10.133.0.2:53408->10.133.0.80:15021: read: connection reset by peer"
Sep 10 21:20:06.353004 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.352967    2558 generic.go:356] "Generic (PLEG): container finished" podID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerID="7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f" exitCode=0
Sep 10 21:20:06.353174 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.353040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" event={"ID":"84c1db87-206b-459a-a464-eecb7f12b0d7","Type":"ContainerDied","Data":"7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f"}
Sep 10 21:20:06.353484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.353470    2558 scope.go:117] "RemoveContainer" containerID="7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f"
Sep 10 21:20:06.354704 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.354678    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:20:06.354756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.354744    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:20:06.354792 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:06.354780    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:20:07.371725 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:07.371679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" event={"ID":"84c1db87-206b-459a-a464-eecb7f12b0d7","Type":"ContainerStarted","Data":"3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0"}
Sep 10 21:20:07.610913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:07.610874    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:20:07.611115 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:07.610942    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 21:20:07.616515 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:07.616491    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:20:08.610038 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:08.610002    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:20:08.610456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:08.610081    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 21:20:09.226444 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.226410    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"]
Sep 10 21:20:09.226874 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.226858    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e76f080-9c03-439d-858d-809748dcd94b" containerName="test-curl-7661-98cb2c"
Sep 10 21:20:09.226943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.226875    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e76f080-9c03-439d-858d-809748dcd94b" containerName="test-curl-7661-98cb2c"
Sep 10 21:20:09.227002 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.226967    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e76f080-9c03-439d-858d-809748dcd94b" containerName="test-curl-7661-98cb2c"
Sep 10 21:20:09.228949 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.228930    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.234822 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.234588    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-828c7c\"/\"default-dockercfg-5bcln\""
Sep 10 21:20:09.234822 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.234689    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-828c7c\"/\"rate-test-model-828c7c-kserve-self-signed-certs\""
Sep 10 21:20:09.235017 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.234913    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-828c7c\"/\"openshift-service-ca.crt\""
Sep 10 21:20:09.235211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.235193    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-828c7c\"/\"kube-root-ca.crt\""
Sep 10 21:20:09.239976 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.239540    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"]
Sep 10 21:20:09.281981 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.281890    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:09.317824 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.317794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-model-cache\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.317980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.317833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tmp-dir\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.317980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.317881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnhc5\" (UniqueName: \"kubernetes.io/projected/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-kube-api-access-fnhc5\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.317980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.317944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-home\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.318119 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.317986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tls-certs\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.318119 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.318010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-dshm\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.418581 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.418546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tmp-dir\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.418776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.418608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnhc5\" (UniqueName: \"kubernetes.io/projected/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-kube-api-access-fnhc5\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.418776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.418639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-home\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.418776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.418666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tls-certs\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.418776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.418691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-dshm\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.418776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.418767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-model-cache\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.419074 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.419002    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tmp-dir\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.419074 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.419011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-home\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.419264 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.419246    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-model-cache\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.421133 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.421114    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-dshm\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.421340 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.421324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tls-certs\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.426959 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.426937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnhc5\" (UniqueName: \"kubernetes.io/projected/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-kube-api-access-fnhc5\") pod \"rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") " pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.544657 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.544542    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:09.611110 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.611079    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:20:09.611535 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.611503    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 21:20:09.838194 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:09.838171    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"]
Sep 10 21:20:09.839806 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:20:09.839775    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecf136eb_40c6_4a6e_ba54_35f1ab0f864c.slice/crio-f20e13b7453bfeb7974c3c680590ccd282ff5cc0aa3f79694d5cf2633a6a2330 WatchSource:0}: Error finding container f20e13b7453bfeb7974c3c680590ccd282ff5cc0aa3f79694d5cf2633a6a2330: Status 404 returned error can't find the container with id f20e13b7453bfeb7974c3c680590ccd282ff5cc0aa3f79694d5cf2633a6a2330
Sep 10 21:20:10.391630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:10.391593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk" event={"ID":"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c","Type":"ContainerStarted","Data":"96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d"}
Sep 10 21:20:10.391803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:10.391639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk" event={"ID":"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c","Type":"ContainerStarted","Data":"f20e13b7453bfeb7974c3c680590ccd282ff5cc0aa3f79694d5cf2633a6a2330"}
Sep 10 21:20:10.411935 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:10.411891    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk" podStartSLOduration=1.4118767669999999 podStartE2EDuration="1.411876767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:10.410942618 +0000 UTC m=+1339.322222399" watchObservedRunningTime="2026-09-10 21:20:10.411876767 +0000 UTC m=+1339.323156548"
Sep 10 21:20:10.610370 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:10.610338    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:20:10.610539 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:10.610392    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 21:20:11.610202 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:11.610159    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:20:11.610680 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:11.610215    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 21:20:12.610854 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:12.610820    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 21:20:12.611257 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:12.610878    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 21:20:13.616485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:13.616452    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:20:13.616977 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:13.616951    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:20:13.617677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:13.617656    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:20:14.260534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:14.260500    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:15.617756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:15.617724    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:20:17.250100 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:17.250068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:17.720218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:17.720183    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:18.058406 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:18.058367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:18.433330 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:18.433246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:19.545519 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:19.545481    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:19.545921 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:19.545546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:19.559115 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:19.559087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:20.468067 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:20.468018    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:20:21.539723 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:21.539685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:21.637587 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:21.637547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:22.994243 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:22.994209    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:23.091883 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:23.091847    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:23.447614 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:23.447577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:23.550997 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:23.550947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:23.625896 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:23.625866    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:26.357564 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:26.357521    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:32.922418 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:32.922361    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:20:40.672419 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:40.672381    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:44.027717 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:44.027676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:46.562971 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:46.562925    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:49.517491 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:49.517459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:49.877231 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:49.877199    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:51.142426 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:51.142393    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:52.145141 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:52.145110    2558 scope.go:117] "RemoveContainer" containerID="f53086d31e55b3b891a57a5d7f7977ded051c712e574e8fba17cf1c48099c170"
Sep 10 21:20:52.155068 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:52.155032    2558 scope.go:117] "RemoveContainer" containerID="94c57b1bbe8b3d1494aecbec044de8fd8d13f181b580d58acc10365b4647246e"
Sep 10 21:20:56.412024 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:20:56.411990    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:21:05.433165 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:05.433122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:05.533887 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:05.533850    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:05.612671 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:05.612637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:05.677325 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:05.677285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:06.000297 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:06.000264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:10.532561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:10.532525    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:10.714498 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:10.714460    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:21:12.575256 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:12.575223    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.639265 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:12.639233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.828889 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:12.828788    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"]
Sep 10 21:21:12.829089 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:12.829059    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" containerID="cri-o://3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0" gracePeriod=30
Sep 10 21:21:12.866430 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:12.866381    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:13.500492 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:13.500458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:13.619605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:13.619567    2558 patch_prober.go:28] interesting pod/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:21:13.619972 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:13.619640    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:21:18.075202 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.075176    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:21:18.100161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100081    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84c1db87-206b-459a-a464-eecb7f12b0d7-istiod-ca-cert\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100128    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-socket\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100161 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100151    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-envoy\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100174    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhgcj\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-kube-api-access-jhgcj\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100227    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-podinfo\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100257    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-data\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100279    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-credential-socket\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100347    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-token\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100494 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-certs\") pod \"84c1db87-206b-459a-a464-eecb7f12b0d7\" (UID: \"84c1db87-206b-459a-a464-eecb7f12b0d7\") "
Sep 10 21:21:18.100805 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100508    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84c1db87-206b-459a-a464-eecb7f12b0d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:18.100805 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100760    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:18.100970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100923    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.100970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100951    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84c1db87-206b-459a-a464-eecb7f12b0d7-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.100970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.100918    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:18.101414 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.101380    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:18.101414 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.101400    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:18.104639 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.104604    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-kube-api-access-jhgcj" (OuterVolumeSpecName: "kube-api-access-jhgcj") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "kube-api-access-jhgcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:18.104846 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.104825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:18.105687 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.105649    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:21:18.105782 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.105720    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84c1db87-206b-459a-a464-eecb7f12b0d7" (UID: "84c1db87-206b-459a-a464-eecb7f12b0d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:18.202337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.202303    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.202337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.202332    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.202337 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.202343    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhgcj\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-kube-api-access-jhgcj\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.202578 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.202355    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.202578 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.202363    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.202578 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.202371    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84c1db87-206b-459a-a464-eecb7f12b0d7-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.202578 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.202379    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84c1db87-206b-459a-a464-eecb7f12b0d7-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:18.808245 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.808207    2558 generic.go:356] "Generic (PLEG): container finished" podID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerID="3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0" exitCode=0
Sep 10 21:21:18.808441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.808265    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"
Sep 10 21:21:18.808441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.808290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" event={"ID":"84c1db87-206b-459a-a464-eecb7f12b0d7","Type":"ContainerDied","Data":"3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0"}
Sep 10 21:21:18.808441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.808344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj" event={"ID":"84c1db87-206b-459a-a464-eecb7f12b0d7","Type":"ContainerDied","Data":"0c4db1858b9c26acee0cbe92fe5658296cfd8260759eb43322985329a4cf2200"}
Sep 10 21:21:18.808441 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.808369    2558 scope.go:117] "RemoveContainer" containerID="3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0"
Sep 10 21:21:18.818534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.818516    2558 scope.go:117] "RemoveContainer" containerID="7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f"
Sep 10 21:21:18.826740 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.826723    2558 scope.go:117] "RemoveContainer" containerID="3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0"
Sep 10 21:21:18.827008 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:21:18.826992    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0\": container with ID starting with 3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0 not found: ID does not exist" containerID="3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0"
Sep 10 21:21:18.827140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.827016    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0"} err="failed to get container status \"3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0\": rpc error: code = NotFound desc = could not find container \"3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0\": container with ID starting with 3b38d9bdce41f45551416102d6d3a3c56bb2c3715c9302a22d4179eac3dabed0 not found: ID does not exist"
Sep 10 21:21:18.827140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.827031    2558 scope.go:117] "RemoveContainer" containerID="7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f"
Sep 10 21:21:18.827297 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:21:18.827280    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f\": container with ID starting with 7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f not found: ID does not exist" containerID="7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f"
Sep 10 21:21:18.827336 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.827302    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f"} err="failed to get container status \"7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f\": rpc error: code = NotFound desc = could not find container \"7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f\": container with ID starting with 7543d1d590dc0cb6531de0e857a3e1a812fd0792c2638b62641c4e149c58816f not found: ID does not exist"
Sep 10 21:21:18.830928 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.830909    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"]
Sep 10 21:21:18.834240 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:18.834218    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-0778a4-openshift-default-66999f59bb-zmjxj"]
Sep 10 21:21:19.615727 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:19.615688    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" path="/var/lib/kubelet/pods/84c1db87-206b-459a-a464-eecb7f12b0d7/volumes"
Sep 10 21:21:23.712945 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:23.712909    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:21:28.703302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:28.703240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:28.805383 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:28.805349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:28.903611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:28.903574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:29.003914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:29.003822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:29.293775 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:29.293685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:30.509029 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:30.508945    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"]
Sep 10 21:21:30.529005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:30.528974    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:31.503423 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:31.503387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:31.957357 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:31.957318    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:32.251755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.251682    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"]
Sep 10 21:21:32.252097 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.252084    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy"
Sep 10 21:21:32.252154 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.252099    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy"
Sep 10 21:21:32.252154 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.252121    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy"
Sep 10 21:21:32.252154 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.252126    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy"
Sep 10 21:21:32.252248 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.252188    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy"
Sep 10 21:21:32.255267 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.255250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.257672 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.257650    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-f7eb29-openshift-default-dockercfg-rntjm\""
Sep 10 21:21:32.267454 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.267432    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"]
Sep 10 21:21:32.277957 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.277932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:32.342434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-socket\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.342434 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-data\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.342708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-istio-token\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.342708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-certs\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.342708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-envoy\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.342708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342557    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3baca107-4a10-469b-9b97-85a283e83a45-istio-podinfo\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.342708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3baca107-4a10-469b-9b97-85a283e83a45-istiod-ca-cert\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.342708 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46j8\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-kube-api-access-f46j8\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.343036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.342715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-credential-socket\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444132 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3baca107-4a10-469b-9b97-85a283e83a45-istio-podinfo\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444351 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3baca107-4a10-469b-9b97-85a283e83a45-istiod-ca-cert\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444351 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f46j8\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-kube-api-access-f46j8\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444351 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-credential-socket\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444532 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-socket\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444532 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-data\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444532 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-istio-token\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444532 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-certs\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-envoy\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-credential-socket\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.444910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.444888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-data\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.445164 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.445143    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3baca107-4a10-469b-9b97-85a283e83a45-istiod-ca-cert\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.445246 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.445197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-socket\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.445246 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.445216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-certs\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.446807 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.446779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3baca107-4a10-469b-9b97-85a283e83a45-istio-podinfo\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.447036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.447018    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-envoy\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.452884 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.452846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-istio-token\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.452962 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.452902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46j8\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-kube-api-access-f46j8\") pod \"e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") " pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.566473 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.566438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:32.642227 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.642189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:32.843451 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.843417    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"]
Sep 10 21:21:32.845233 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:21:32.845203    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3baca107_4a10_469b_9b97_85a283e83a45.slice/crio-f1e4f09736294be225aca1765a4e5c192031185bc21d5ebe19d9ffb2bc332a9c WatchSource:0}: Error finding container f1e4f09736294be225aca1765a4e5c192031185bc21d5ebe19d9ffb2bc332a9c: Status 404 returned error can't find the container with id f1e4f09736294be225aca1765a4e5c192031185bc21d5ebe19d9ffb2bc332a9c
Sep 10 21:21:32.848198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.848162    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:21:32.848367 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.848255    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:21:32.848367 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.848307    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:21:32.898762 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:32.898735    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" event={"ID":"3baca107-4a10-469b-9b97-85a283e83a45","Type":"ContainerStarted","Data":"f1e4f09736294be225aca1765a4e5c192031185bc21d5ebe19d9ffb2bc332a9c"}
Sep 10 21:21:33.906796 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:33.906764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" event={"ID":"3baca107-4a10-469b-9b97-85a283e83a45","Type":"ContainerStarted","Data":"5460be63249a3c172d24acbe3dcf71e9afd24aeb78438452d77ccd9356e330b7"}
Sep 10 21:21:33.928489 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:33.928437    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podStartSLOduration=1.928422125 podStartE2EDuration="1.928422125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:21:33.926248532 +0000 UTC m=+1422.837528336" watchObservedRunningTime="2026-09-10 21:21:33.928422125 +0000 UTC m=+1422.839701907"
Sep 10 21:21:34.567130 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:34.567095    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:34.572529 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:34.572504    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:34.912721 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:34.912641    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:34.913600 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:34.913580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:35.718375 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:35.718344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:35.819524 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:35.819493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:35.921881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:35.921846    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:36.023655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:36.023569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:36.574624 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:36.574595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:37.340752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:37.340712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:37.402456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:37.402418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:37.506558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:37.506512    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:21:37.912379 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:37.912341    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:38.003234 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:38.003194    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:38.443009 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:38.442974    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:39.146673 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:39.146638    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:45.528023 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.527904    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk" podUID="ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" containerName="main" containerID="cri-o://96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d" gracePeriod=45
Sep 10 21:21:45.781500 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.781370    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:21:45.875348 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875311    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-dshm\") pod \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") "
Sep 10 21:21:45.875523 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-home\") pod \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") "
Sep 10 21:21:45.875523 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnhc5\" (UniqueName: \"kubernetes.io/projected/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-kube-api-access-fnhc5\") pod \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") "
Sep 10 21:21:45.875523 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875506    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tmp-dir\") pod \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") "
Sep 10 21:21:45.875651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875523    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-model-cache\") pod \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") "
Sep 10 21:21:45.875651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875548    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tls-certs\") pod \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\" (UID: \"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c\") "
Sep 10 21:21:45.875728 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875644    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-home" (OuterVolumeSpecName: "home") pod "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" (UID: "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:45.875802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875772    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" (UID: "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:45.875862 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875799    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" (UID: "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:45.875940 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875918    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tmp-dir\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:45.875995 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875944    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-model-cache\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:45.875995 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.875953    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-home\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:45.877704 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.877680    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" (UID: "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:45.877704 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.877694    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-dshm" (OuterVolumeSpecName: "dshm") pod "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" (UID: "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:45.877839 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.877810    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-kube-api-access-fnhc5" (OuterVolumeSpecName: "kube-api-access-fnhc5") pod "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" (UID: "ecf136eb-40c6-4a6e-ba54-35f1ab0f864c"). InnerVolumeSpecName "kube-api-access-fnhc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:45.976232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976197    2558 generic.go:356] "Generic (PLEG): container finished" podID="ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" containerID="96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d" exitCode=0
Sep 10 21:21:45.976420 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976243    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"
Sep 10 21:21:45.976420 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976285    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk" event={"ID":"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c","Type":"ContainerDied","Data":"96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d"}
Sep 10 21:21:45.976420 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976333    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk" event={"ID":"ecf136eb-40c6-4a6e-ba54-35f1ab0f864c","Type":"ContainerDied","Data":"f20e13b7453bfeb7974c3c680590ccd282ff5cc0aa3f79694d5cf2633a6a2330"}
Sep 10 21:21:45.976420 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976355    2558 scope.go:117] "RemoveContainer" containerID="96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d"
Sep 10 21:21:45.976718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976702    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-tls-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:45.976799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976724    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-dshm\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:45.976799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.976738    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnhc5\" (UniqueName: \"kubernetes.io/projected/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c-kube-api-access-fnhc5\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:45.990423 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.990404    2558 scope.go:117] "RemoveContainer" containerID="96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d"
Sep 10 21:21:45.990781 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:21:45.990758    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d\": container with ID starting with 96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d not found: ID does not exist" containerID="96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d"
Sep 10 21:21:45.990880 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:45.990787    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d"} err="failed to get container status \"96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d\": rpc error: code = NotFound desc = could not find container \"96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d\": container with ID starting with 96c23e0769dc91e72d7666c7c30e25e97d5c5c340c816fcc27baa2df53e2906d not found: ID does not exist"
Sep 10 21:21:46.002075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:46.002019    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"]
Sep 10 21:21:46.004321 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:46.004304    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-828c7c/rate-test-model-828c7c-kserve-67dcbb6fff-zf9nk"]
Sep 10 21:21:46.463567 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:46.463534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:47.063066 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:47.062629    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:47.160069 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:47.155875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:47.236660 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:47.236626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:47.334439 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:47.334349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:47.399630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:47.399591    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:47.615626 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:47.615544    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" path="/var/lib/kubelet/pods/ecf136eb-40c6-4a6e-ba54-35f1ab0f864c/volumes"
Sep 10 21:21:47.725363 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:47.725335    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:52.309515 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:52.309475    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:21:53.953248 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:53.953190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:54.020357 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:54.020311    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:54.246819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:54.246729    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:54.737726 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:54.737690    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:56.037269 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:56.037234    2558 generic.go:356] "Generic (PLEG): container finished" podID="3baca107-4a10-469b-9b97-85a283e83a45" containerID="5460be63249a3c172d24acbe3dcf71e9afd24aeb78438452d77ccd9356e330b7" exitCode=0
Sep 10 21:21:56.037755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:56.037307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" event={"ID":"3baca107-4a10-469b-9b97-85a283e83a45","Type":"ContainerDied","Data":"5460be63249a3c172d24acbe3dcf71e9afd24aeb78438452d77ccd9356e330b7"}
Sep 10 21:21:56.037755 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:56.037696    2558 scope.go:117] "RemoveContainer" containerID="5460be63249a3c172d24acbe3dcf71e9afd24aeb78438452d77ccd9356e330b7"
Sep 10 21:21:56.038836 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:56.038806    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:21:56.038911 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:56.038896    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:21:56.038953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:56.038932    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:21:57.046382 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:57.046331    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" event={"ID":"3baca107-4a10-469b-9b97-85a283e83a45","Type":"ContainerStarted","Data":"f94e487b13b7d81d5a8ec193b95d66af3c4295e50af8594c1f0b71d9e227969f"}
Sep 10 21:21:57.567172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:57.567130    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:21:57.567497 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:57.567229    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 21:21:57.567655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:57.567629    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 21:21:58.457258 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:58.457218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:58.567130 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:58.567070    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 21:21:58.567349 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:58.567139    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 21:21:59.567611 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:59.567567    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 21:21:59.568164 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:21:59.567652    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 21:22:00.567483 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:00.567441    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 21:22:00.567777 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:00.567744    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 21:22:00.922941 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:00.922851    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:01.567626 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:01.567588    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 21:22:01.567835 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:01.567676    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 21:22:01.621071 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:01.621016    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:01.958630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:01.958542    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:02.567461 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:02.567415    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 21:22:02.567677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:02.567489    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 21:22:02.585596 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:02.585564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:03.571418 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:03.571382    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:22:03.571711 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:03.571681    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:22:03.572415 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:03.572396    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:22:04.142970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:04.142930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:04.768481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:04.768445    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"]
Sep 10 21:22:04.768772 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:04.768734    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58" podUID="d166faca-c34f-4f00-89c2-9905fe9612d3" containerName="maas-api" containerID="cri-o://9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536" gracePeriod=30
Sep 10 21:22:04.825059 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:04.825011    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:04.922644 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:04.922610    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:04.987313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:04.987280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:05.017379 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.017358    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:22:05.061890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.061856    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-metrics-certs\") pod \"d166faca-c34f-4f00-89c2-9905fe9612d3\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") "
Sep 10 21:22:05.062087 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.061940    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d166faca-c34f-4f00-89c2-9905fe9612d3-openshift-service-ca\") pod \"d166faca-c34f-4f00-89c2-9905fe9612d3\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") "
Sep 10 21:22:05.062087 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.062032    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-maas-api-tls\") pod \"d166faca-c34f-4f00-89c2-9905fe9612d3\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") "
Sep 10 21:22:05.062222 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.062087    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdbgk\" (UniqueName: \"kubernetes.io/projected/d166faca-c34f-4f00-89c2-9905fe9612d3-kube-api-access-vdbgk\") pod \"d166faca-c34f-4f00-89c2-9905fe9612d3\" (UID: \"d166faca-c34f-4f00-89c2-9905fe9612d3\") "
Sep 10 21:22:05.062406 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.062365    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d166faca-c34f-4f00-89c2-9905fe9612d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d166faca-c34f-4f00-89c2-9905fe9612d3" (UID: "d166faca-c34f-4f00-89c2-9905fe9612d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:05.064072 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.064029    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d166faca-c34f-4f00-89c2-9905fe9612d3" (UID: "d166faca-c34f-4f00-89c2-9905fe9612d3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:22:05.064162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.064098    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d166faca-c34f-4f00-89c2-9905fe9612d3" (UID: "d166faca-c34f-4f00-89c2-9905fe9612d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:22:05.064162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.064104    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d166faca-c34f-4f00-89c2-9905fe9612d3-kube-api-access-vdbgk" (OuterVolumeSpecName: "kube-api-access-vdbgk") pod "d166faca-c34f-4f00-89c2-9905fe9612d3" (UID: "d166faca-c34f-4f00-89c2-9905fe9612d3"). InnerVolumeSpecName "kube-api-access-vdbgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:05.105411 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.105375    2558 generic.go:356] "Generic (PLEG): container finished" podID="d166faca-c34f-4f00-89c2-9905fe9612d3" containerID="9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536" exitCode=0
Sep 10 21:22:05.105594 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.105422    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"
Sep 10 21:22:05.105594 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.105455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58" event={"ID":"d166faca-c34f-4f00-89c2-9905fe9612d3","Type":"ContainerDied","Data":"9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536"}
Sep 10 21:22:05.105594 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.105510    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58" event={"ID":"d166faca-c34f-4f00-89c2-9905fe9612d3","Type":"ContainerDied","Data":"46db94f07adcae8c6c6defbe719589c72f9211c3dca722a19b0b3958dcfd30ab"}
Sep 10 21:22:05.105594 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.105540    2558 scope.go:117] "RemoveContainer" containerID="9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536"
Sep 10 21:22:05.115869 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.115843    2558 scope.go:117] "RemoveContainer" containerID="9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536"
Sep 10 21:22:05.116220 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:22:05.116199    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536\": container with ID starting with 9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536 not found: ID does not exist" containerID="9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536"
Sep 10 21:22:05.116303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.116225    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536"} err="failed to get container status \"9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536\": rpc error: code = NotFound desc = could not find container \"9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536\": container with ID starting with 9438d8336fcab2c1858c75cdbe0fbc0dccbfdcf321ed879c80ecc4398a81a536 not found: ID does not exist"
Sep 10 21:22:05.135529 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.135497    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"]
Sep 10 21:22:05.141544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.141518    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aca18f-5bb6d96494-r4z58"]
Sep 10 21:22:05.147642 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.147596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:05.163509 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.163487    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:05.163509 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.163508    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdbgk\" (UniqueName: \"kubernetes.io/projected/d166faca-c34f-4f00-89c2-9905fe9612d3-kube-api-access-vdbgk\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:05.163678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.163529    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d166faca-c34f-4f00-89c2-9905fe9612d3-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:05.163678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.163544    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d166faca-c34f-4f00-89c2-9905fe9612d3-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:05.239576 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.239543    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:05.360202 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.360086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:05.615627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:05.615548    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d166faca-c34f-4f00-89c2-9905fe9612d3" path="/var/lib/kubelet/pods/d166faca-c34f-4f00-89c2-9905fe9612d3/volumes"
Sep 10 21:22:06.293861 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.293829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:06.303386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303355    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"]
Sep 10 21:22:06.303770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303755    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" containerName="main"
Sep 10 21:22:06.303813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303772    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" containerName="main"
Sep 10 21:22:06.303813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303788    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d166faca-c34f-4f00-89c2-9905fe9612d3" containerName="maas-api"
Sep 10 21:22:06.303813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303793    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d166faca-c34f-4f00-89c2-9905fe9612d3" containerName="maas-api"
Sep 10 21:22:06.303906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303855    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c1db87-206b-459a-a464-eecb7f12b0d7" containerName="istio-proxy"
Sep 10 21:22:06.303906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303863    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d166faca-c34f-4f00-89c2-9905fe9612d3" containerName="maas-api"
Sep 10 21:22:06.303906 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.303869    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecf136eb-40c6-4a6e-ba54-35f1ab0f864c" containerName="main"
Sep 10 21:22:06.308511 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.308493    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.312077 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.312060    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-1427b1-serving-cert\""
Sep 10 21:22:06.333667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.333637    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"]
Sep 10 21:22:06.374628 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.374596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-maas-api-tls\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.374794 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.374648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-metrics-certs\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.374794 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.374726    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znl9n\" (UniqueName: \"kubernetes.io/projected/ae65e73d-012f-4439-846b-360b927f4b30-kube-api-access-znl9n\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.374794 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.374767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae65e73d-012f-4439-846b-360b927f4b30-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.399773 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.399730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:06.475520 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.475478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znl9n\" (UniqueName: \"kubernetes.io/projected/ae65e73d-012f-4439-846b-360b927f4b30-kube-api-access-znl9n\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.475691 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.475534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae65e73d-012f-4439-846b-360b927f4b30-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.475691 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.475598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-maas-api-tls\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.475691 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.475652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-metrics-certs\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.476203 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.476182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae65e73d-012f-4439-846b-360b927f4b30-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.478152 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.478123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-maas-api-tls\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.478252 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.478183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-metrics-certs\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.484133 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.484113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znl9n\" (UniqueName: \"kubernetes.io/projected/ae65e73d-012f-4439-846b-360b927f4b30-kube-api-access-znl9n\") pod \"maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.493171 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.493145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:06.619201 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.619169    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:06.892618 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.892577    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"]
Sep 10 21:22:06.893504 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:22:06.893480    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae65e73d_012f_4439_846b_360b927f4b30.slice/crio-5d0db0f69ef15e671c427b3fdab0c9f6d7e44b6da986590a56004629b362e928 WatchSource:0}: Error finding container 5d0db0f69ef15e671c427b3fdab0c9f6d7e44b6da986590a56004629b362e928: Status 404 returned error can't find the container with id 5d0db0f69ef15e671c427b3fdab0c9f6d7e44b6da986590a56004629b362e928
Sep 10 21:22:06.894852 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.894834    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:22:06.944080 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:06.944027    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:07.043794 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:07.043757    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:07.119521 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:07.119488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q" event={"ID":"ae65e73d-012f-4439-846b-360b927f4b30","Type":"ContainerStarted","Data":"5d0db0f69ef15e671c427b3fdab0c9f6d7e44b6da986590a56004629b362e928"}
Sep 10 21:22:07.971064 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:07.971009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:08.127074 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:08.127024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q" event={"ID":"ae65e73d-012f-4439-846b-360b927f4b30","Type":"ContainerStarted","Data":"1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283"}
Sep 10 21:22:08.127260 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:08.127142    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:08.145719 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:08.145656    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q" podStartSLOduration=1.687368985 podStartE2EDuration="2.145635428s" totalImagesPullingTime="458.266443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:08.143341244 +0000 UTC m=+1457.054621036" watchObservedRunningTime="2026-09-10 21:22:08.145635428 +0000 UTC m=+1457.056915211"
Sep 10 21:22:08.802305 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:08.802260    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:22:11.530752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:11.530711    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:11.591672 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:11.591639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:11.787139 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:11.787040    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"]
Sep 10 21:22:11.787281 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:11.787257    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" containerID="cri-o://f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9" gracePeriod=30
Sep 10 21:22:11.829260 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:11.829227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:11.863832 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:11.863801    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:22:11.863985 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:11.863858    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:22:13.363635 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:13.363595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:14.139500 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:14.139466    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:22:17.031479 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.031455    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:22:17.079307 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079272    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-envoy\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079307 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079308    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istiod-ca-cert\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079324    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-socket\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079349    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8hhl\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-kube-api-access-t8hhl\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-token\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079439    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-data\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079502    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-podinfo\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079546    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-certs\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079584    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-credential-socket\") pod \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\" (UID: \"61d888b5-0f9d-4e35-a9f1-80147e40c78b\") "
Sep 10 21:22:17.079882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079633    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:17.079882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079744    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-data" (OuterVolumeSpecName: "istio-data") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:17.080036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079884    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:17.080036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079899    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:17.080036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.079980    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.080036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.080006    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.080339 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.080315    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:17.081650 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.081622    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:17.081823 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.081803    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-kube-api-access-t8hhl" (OuterVolumeSpecName: "kube-api-access-t8hhl") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "kube-api-access-t8hhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:17.082006 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.081987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:22:17.082116 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.082102    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-token" (OuterVolumeSpecName: "istio-token") pod "61d888b5-0f9d-4e35-a9f1-80147e40c78b" (UID: "61d888b5-0f9d-4e35-a9f1-80147e40c78b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:17.179273 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.179236    2558 generic.go:356] "Generic (PLEG): container finished" podID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerID="f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9" exitCode=0
Sep 10 21:22:17.179433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.179286    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"
Sep 10 21:22:17.179433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.179324    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" event={"ID":"61d888b5-0f9d-4e35-a9f1-80147e40c78b","Type":"ContainerDied","Data":"f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9"}
Sep 10 21:22:17.179433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.179382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb" event={"ID":"61d888b5-0f9d-4e35-a9f1-80147e40c78b","Type":"ContainerDied","Data":"5e1edcaf56f9009510e909f4804fe3a68c8bef0ebadd85850548d506f0ea936a"}
Sep 10 21:22:17.179433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.179414    2558 scope.go:117] "RemoveContainer" containerID="f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9"
Sep 10 21:22:17.180469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.180449    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.180469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.180472    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.180627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.180487    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8hhl\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-kube-api-access-t8hhl\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.180627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.180503    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.180627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.180514    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61d888b5-0f9d-4e35-a9f1-80147e40c78b-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.180627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.180526    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.180627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.180539    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61d888b5-0f9d-4e35-a9f1-80147e40c78b-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:17.189953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.189934    2558 scope.go:117] "RemoveContainer" containerID="f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d"
Sep 10 21:22:17.198490 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.198461    2558 scope.go:117] "RemoveContainer" containerID="f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9"
Sep 10 21:22:17.198759 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:22:17.198740    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9\": container with ID starting with f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9 not found: ID does not exist" containerID="f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9"
Sep 10 21:22:17.198809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.198768    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9"} err="failed to get container status \"f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9\": rpc error: code = NotFound desc = could not find container \"f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9\": container with ID starting with f251c60553b4590a241fd4429bbecbfad4e008a61294b5b5a65cbed4c52767c9 not found: ID does not exist"
Sep 10 21:22:17.198809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.198787    2558 scope.go:117] "RemoveContainer" containerID="f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d"
Sep 10 21:22:17.199026 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:22:17.199012    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d\": container with ID starting with f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d not found: ID does not exist" containerID="f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d"
Sep 10 21:22:17.199086 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.199030    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d"} err="failed to get container status \"f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d\": rpc error: code = NotFound desc = could not find container \"f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d\": container with ID starting with f9793960a363e4b8d3f969f6bc9e252e397c8cedfb39dc467d09c4ef6334902d not found: ID does not exist"
Sep 10 21:22:17.202597 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.202575    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"]
Sep 10 21:22:17.205984 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.205963    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-aca18f-openshift-default-58d8f5596d-x9rsb"]
Sep 10 21:22:17.616008 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:17.615976    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" path="/var/lib/kubelet/pods/61d888b5-0f9d-4e35-a9f1-80147e40c78b/volumes"
Sep 10 21:22:30.156482 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:30.156437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:37.329233 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:37.329199    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:41.417667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:41.417633    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:22:54.310320 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:22:54.310279    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:23:01.817254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.817221    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"]
Sep 10 21:23:01.817640 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.817626    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy"
Sep 10 21:23:01.817685 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.817641    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy"
Sep 10 21:23:01.817734 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.817725    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy"
Sep 10 21:23:01.817771 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.817736    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy"
Sep 10 21:23:01.822220 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.822202    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.824837 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.824812    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-c1753c-openshift-default-dockercfg-svx5l\""
Sep 10 21:23:01.835254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.835228    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"]
Sep 10 21:23:01.903588 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-envoy\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.903803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903604    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-data\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.903803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-podinfo\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.903803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.903803 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nghvk\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-kube-api-access-nghvk\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.904061 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903897    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-credential-socket\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.904061 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-certs\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.904061 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-token\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:01.904061 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:01.903981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-socket\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.004661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.004613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-data\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.004661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.004666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-podinfo\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.004933 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.004795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.004933 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.004846    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nghvk\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-kube-api-access-nghvk\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.004967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-credential-socket\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.004997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-certs\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-token\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005075 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-data\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005296 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-socket\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005296 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-envoy\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-socket\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-certs\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.005625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.005601    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-credential-socket\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.007220 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.007199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-podinfo\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.007319 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.007293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-envoy\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.014931 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.014907    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nghvk\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-kube-api-access-nghvk\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.015082 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.015033    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-token\") pod \"e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") " pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.132424 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.132331    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:02.415897 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.415863    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"]
Sep 10 21:23:02.417411 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:23:02.417385    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3573b7_9fd4_4c53_a05c_009e4b55188a.slice/crio-df4d4e545cb621d96393481452fe9acf9e27e78045eba0e09b17f7a974e5ea4b WatchSource:0}: Error finding container df4d4e545cb621d96393481452fe9acf9e27e78045eba0e09b17f7a974e5ea4b: Status 404 returned error can't find the container with id df4d4e545cb621d96393481452fe9acf9e27e78045eba0e09b17f7a974e5ea4b
Sep 10 21:23:02.419753 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.419722    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:23:02.419857 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.419801    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:23:02.419857 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.419846    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:23:02.437097 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.437069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" event={"ID":"6b3573b7-9fd4-4c53-a05c-009e4b55188a","Type":"ContainerStarted","Data":"df4d4e545cb621d96393481452fe9acf9e27e78045eba0e09b17f7a974e5ea4b"}
Sep 10 21:23:02.609882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.609849    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:02.708917 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:02.708822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:03.445784 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:03.445751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" event={"ID":"6b3573b7-9fd4-4c53-a05c-009e4b55188a","Type":"ContainerStarted","Data":"488a578feba12509bda67f95302d710db305239d521ad7dce8bbee312bb2b6ad"}
Sep 10 21:23:03.473940 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:03.473885    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podStartSLOduration=2.473868702 podStartE2EDuration="2.473868702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:23:03.470457891 +0000 UTC m=+1512.381737684" watchObservedRunningTime="2026-09-10 21:23:03.473868702 +0000 UTC m=+1512.385148475"
Sep 10 21:23:04.133380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:04.133342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:04.139064 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:04.139026    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:04.452705 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:04.452619    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:04.453799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:04.453777    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:05.489180 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:05.489148    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:05.584005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:05.583969    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:06.625563 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.625529    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"]
Sep 10 21:23:06.625970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.625958    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy"
Sep 10 21:23:06.626032 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.625973    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d888b5-0f9d-4e35-a9f1-80147e40c78b" containerName="istio-proxy"
Sep 10 21:23:06.629240 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.629219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.631980 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.631935    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-c1753c-serving-cert\""
Sep 10 21:23:06.637786 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.637766    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"]
Sep 10 21:23:06.652754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.652726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:06.711764 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.711724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:06.751692 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.751636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.751692 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.751689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29cw\" (UniqueName: \"kubernetes.io/projected/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-kube-api-access-r29cw\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.751966 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.751780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.751966 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.751853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.852453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.852405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.852651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.852528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.852651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.852565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29cw\" (UniqueName: \"kubernetes.io/projected/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-kube-api-access-r29cw\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.852651 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.852608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.852813 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:23:06.852789    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-serving-cert: secret "maas-api-e2e-ipp-cleanup-c1753c-serving-cert" not found
Sep 10 21:23:06.852885 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:23:06.852870    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls podName:4895e77c-c2f7-4ce7-b36b-c1a0f207abcb nodeName:}" failed. No retries permitted until 2026-09-10 21:23:07.352847928 +0000 UTC m=+1516.264127693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4" (UID: "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb") : secret "maas-api-e2e-ipp-cleanup-c1753c-serving-cert" not found
Sep 10 21:23:06.853277 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.853258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.854965 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.854944    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:06.861291 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:06.861268    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29cw\" (UniqueName: \"kubernetes.io/projected/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-kube-api-access-r29cw\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:07.074625 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:07.074584    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:07.179076 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:07.179030    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:07.263715 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:07.263670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:07.358094 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:07.357995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:07.360384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:07.360363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:07.541583 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:07.541541    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:07.831518 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:07.831489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"]
Sep 10 21:23:07.834082 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:23:07.833082    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4895e77c_c2f7_4ce7_b36b_c1a0f207abcb.slice/crio-6ae49ba3a784c927e5d986c5e121182c2b625076d8f77dc9eb8820b2a4e70efe WatchSource:0}: Error finding container 6ae49ba3a784c927e5d986c5e121182c2b625076d8f77dc9eb8820b2a4e70efe: Status 404 returned error can't find the container with id 6ae49ba3a784c927e5d986c5e121182c2b625076d8f77dc9eb8820b2a4e70efe
Sep 10 21:23:08.476891 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:08.476850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4" event={"ID":"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb","Type":"ContainerStarted","Data":"63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745"}
Sep 10 21:23:08.477081 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:08.476915    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4" event={"ID":"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb","Type":"ContainerStarted","Data":"6ae49ba3a784c927e5d986c5e121182c2b625076d8f77dc9eb8820b2a4e70efe"}
Sep 10 21:23:08.477081 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:08.476944    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:08.497677 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:08.497629    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4" podStartSLOduration=2.035625762 podStartE2EDuration="2.497612563s" totalImagesPullingTime="461.986801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:23:08.497549587 +0000 UTC m=+1517.408829389" watchObservedRunningTime="2026-09-10 21:23:08.497612563 +0000 UTC m=+1517.408892342"
Sep 10 21:23:14.489851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:14.489775    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:15.235371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:15.235335    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:23:25.588928 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:25.588890    2558 generic.go:356] "Generic (PLEG): container finished" podID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerID="488a578feba12509bda67f95302d710db305239d521ad7dce8bbee312bb2b6ad" exitCode=0
Sep 10 21:23:25.589382 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:25.588960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" event={"ID":"6b3573b7-9fd4-4c53-a05c-009e4b55188a","Type":"ContainerDied","Data":"488a578feba12509bda67f95302d710db305239d521ad7dce8bbee312bb2b6ad"}
Sep 10 21:23:25.589382 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:25.589374    2558 scope.go:117] "RemoveContainer" containerID="488a578feba12509bda67f95302d710db305239d521ad7dce8bbee312bb2b6ad"
Sep 10 21:23:25.590439 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:25.590413    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:23:25.590496 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:25.590480    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:23:25.590534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:25.590509    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 10 21:23:26.597013 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:26.596978    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" event={"ID":"6b3573b7-9fd4-4c53-a05c-009e4b55188a","Type":"ContainerStarted","Data":"3f2def0a36da03004ef3c5eeb3d768381584e36b5212e4270d0b9efb73055482"}
Sep 10 21:23:27.133230 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:27.133195    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:27.133408 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:27.133371    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 21:23:27.133457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:27.133420    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 21:23:28.133421 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:28.133385    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 21:23:28.133789 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:28.133439    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 21:23:29.133114 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:29.133073    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 21:23:29.133302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:29.133146    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 21:23:30.133455 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:30.133409    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 21:23:30.133955 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:30.133488    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 21:23:30.537913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:30.537820    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:31.133166 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:31.133124    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 21:23:31.133341 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:31.133239    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 21:23:32.137449 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:32.137418    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:32.137897 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:32.137850    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:32.138574 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:32.138556    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:37.269623 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.269583    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"]
Sep 10 21:23:37.270105 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.269805    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4" podUID="4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" containerName="maas-api" containerID="cri-o://63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745" gracePeriod=30
Sep 10 21:23:37.335252 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.335217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:37.463843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.463809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:37.538529 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.538495    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:37.540151 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.540131    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:37.641696 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.641665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:37.660721 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.660690    2558 generic.go:356] "Generic (PLEG): container finished" podID="4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" containerID="63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745" exitCode=0
Sep 10 21:23:37.660903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.660741    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"
Sep 10 21:23:37.660903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.660784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4" event={"ID":"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb","Type":"ContainerDied","Data":"63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745"}
Sep 10 21:23:37.660903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.660835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4" event={"ID":"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb","Type":"ContainerDied","Data":"6ae49ba3a784c927e5d986c5e121182c2b625076d8f77dc9eb8820b2a4e70efe"}
Sep 10 21:23:37.660903 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.660862    2558 scope.go:117] "RemoveContainer" containerID="63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745"
Sep 10 21:23:37.667298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.667272    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls\") pod \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") "
Sep 10 21:23:37.667424 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.667321    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r29cw\" (UniqueName: \"kubernetes.io/projected/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-kube-api-access-r29cw\") pod \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") "
Sep 10 21:23:37.667467 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.667451    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-metrics-certs\") pod \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") "
Sep 10 21:23:37.667504 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.667487    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-openshift-service-ca\") pod \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\" (UID: \"4895e77c-c2f7-4ce7-b36b-c1a0f207abcb\") "
Sep 10 21:23:37.667927 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.667898    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" (UID: "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:37.669445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.669408    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" (UID: "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:23:37.669809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.669788    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" (UID: "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:23:37.669900 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.669803    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-kube-api-access-r29cw" (OuterVolumeSpecName: "kube-api-access-r29cw") pod "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" (UID: "4895e77c-c2f7-4ce7-b36b-c1a0f207abcb"). InnerVolumeSpecName "kube-api-access-r29cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:37.670257 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.670236    2558 scope.go:117] "RemoveContainer" containerID="63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745"
Sep 10 21:23:37.670565 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:23:37.670546    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745\": container with ID starting with 63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745 not found: ID does not exist" containerID="63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745"
Sep 10 21:23:37.670630 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.670573    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745"} err="failed to get container status \"63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745\": rpc error: code = NotFound desc = could not find container \"63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745\": container with ID starting with 63f040d5c8787f9ada7a72ac2ffd5db3ca392cb098d3a6a7f1f8417377d71745 not found: ID does not exist"
Sep 10 21:23:37.716653 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.716592    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:37.768605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.768565    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:37.768605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.768604    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r29cw\" (UniqueName: \"kubernetes.io/projected/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-kube-api-access-r29cw\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:37.768879 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.768619    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:37.768879 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.768643    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:37.986057 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.986021    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"]
Sep 10 21:23:37.991485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:37.991455    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c1753c-7bb9db4bd6-xbnz4"]
Sep 10 21:23:38.071517 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:38.071483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:39.615333 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:39.615301    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" path="/var/lib/kubelet/pods/4895e77c-c2f7-4ce7-b36b-c1a0f207abcb/volumes"
Sep 10 21:23:41.820350 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:41.820311    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:23:44.285908 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:44.285876    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:44.360453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:44.360414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:44.534520 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:44.534489    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"]
Sep 10 21:23:44.534732 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:44.534707    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy" containerID="cri-o://3f2def0a36da03004ef3c5eeb3d768381584e36b5212e4270d0b9efb73055482" gracePeriod=30
Sep 10 21:23:44.560140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:44.560110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:47.140511 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:47.140468    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:23:47.141079 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:47.140543    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:23:48.557360 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:48.557283    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:49.734962 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.734894    2558 generic.go:356] "Generic (PLEG): container finished" podID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerID="3f2def0a36da03004ef3c5eeb3d768381584e36b5212e4270d0b9efb73055482" exitCode=0
Sep 10 21:23:49.735386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.734956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" event={"ID":"6b3573b7-9fd4-4c53-a05c-009e4b55188a","Type":"ContainerDied","Data":"3f2def0a36da03004ef3c5eeb3d768381584e36b5212e4270d0b9efb73055482"}
Sep 10 21:23:49.735386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.735035    2558 scope.go:117] "RemoveContainer" containerID="488a578feba12509bda67f95302d710db305239d521ad7dce8bbee312bb2b6ad"
Sep 10 21:23:49.793937 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.793912    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:49.886254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886228    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-credential-socket\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886271    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-certs\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886308    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nghvk\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-kube-api-access-nghvk\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886332    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-podinfo\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886349    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-token\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886376    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-data\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-socket\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886457    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istiod-ca-cert\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886505    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-envoy\") pod \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\" (UID: \"6b3573b7-9fd4-4c53-a05c-009e4b55188a\") "
Sep 10 21:23:49.886761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886529    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:49.886761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886664    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:49.886761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886744    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:49.887067 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886921    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:49.887067 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886950    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.887067 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886969    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.887067 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886979    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.887067 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.886985    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:49.888563 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.888533    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:49.888563 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.888543    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:23:49.888837 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.888816    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-kube-api-access-nghvk" (OuterVolumeSpecName: "kube-api-access-nghvk") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "kube-api-access-nghvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:49.888882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.888867    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b3573b7-9fd4-4c53-a05c-009e4b55188a" (UID: "6b3573b7-9fd4-4c53-a05c-009e4b55188a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:49.988280 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.988242    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nghvk\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-kube-api-access-nghvk\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.988280 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.988273    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.988280 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.988283    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.988518 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.988292    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.988518 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.988301    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:49.988518 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:49.988309    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b3573b7-9fd4-4c53-a05c-009e4b55188a-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:50.741954 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:50.741924    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"
Sep 10 21:23:50.742433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:50.741960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz" event={"ID":"6b3573b7-9fd4-4c53-a05c-009e4b55188a","Type":"ContainerDied","Data":"df4d4e545cb621d96393481452fe9acf9e27e78045eba0e09b17f7a974e5ea4b"}
Sep 10 21:23:50.742433 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:50.742019    2558 scope.go:117] "RemoveContainer" containerID="3f2def0a36da03004ef3c5eeb3d768381584e36b5212e4270d0b9efb73055482"
Sep 10 21:23:50.767990 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:50.767962    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"]
Sep 10 21:23:50.775093 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:50.775068    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c1753c-openshift-default-659974cb76-v5wgz"]
Sep 10 21:23:51.615368 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:23:51.615333    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" path="/var/lib/kubelet/pods/6b3573b7-9fd4-4c53-a05c-009e4b55188a/volumes"
Sep 10 21:24:01.701461 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:01.701422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:24:03.917254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:03.917214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:03.989532 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:03.989494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:04.057782 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:04.057743    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:04.129509 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:04.129475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:04.187287 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:04.187194    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:04.517506 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:04.517407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:09.613136 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:09.613101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:14.712573 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:14.712535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:24:52.726327 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:52.726248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:53.397978 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:53.397926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:58.094826 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:58.094784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:59.573960 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:24:59.573921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:23.774596 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:23.774557    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:23.837710 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:23.837677    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:24.055449 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:24.055413    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"]
Sep 10 21:25:24.055713 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:24.055690    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy" containerID="cri-o://f94e487b13b7d81d5a8ec193b95d66af3c4295e50af8594c1f0b71d9e227969f" gracePeriod=30
Sep 10 21:25:24.071674 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:24.071647    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:24.658447 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:24.658409    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:27.061283 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:27.061247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:29.301267 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.301232    2558 generic.go:356] "Generic (PLEG): container finished" podID="3baca107-4a10-469b-9b97-85a283e83a45" containerID="f94e487b13b7d81d5a8ec193b95d66af3c4295e50af8594c1f0b71d9e227969f" exitCode=0
Sep 10 21:25:29.301626 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.301301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" event={"ID":"3baca107-4a10-469b-9b97-85a283e83a45","Type":"ContainerDied","Data":"f94e487b13b7d81d5a8ec193b95d66af3c4295e50af8594c1f0b71d9e227969f"}
Sep 10 21:25:29.301626 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.301365    2558 scope.go:117] "RemoveContainer" containerID="5460be63249a3c172d24acbe3dcf71e9afd24aeb78438452d77ccd9356e330b7"
Sep 10 21:25:29.320539 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.320518    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:25:29.414479 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414444    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3baca107-4a10-469b-9b97-85a283e83a45-istiod-ca-cert\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.414667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-data\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.414667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-istio-token\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.414667 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414640    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-socket\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.414843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414701    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f46j8\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-kube-api-access-f46j8\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.414843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414747    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-envoy\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.414843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414781    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-credential-socket\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.414843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414784    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-data" (OuterVolumeSpecName: "istio-data") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:29.414843 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414807    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3baca107-4a10-469b-9b97-85a283e83a45-istio-podinfo\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.415143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414848    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-certs\") pod \"3baca107-4a10-469b-9b97-85a283e83a45\" (UID: \"3baca107-4a10-469b-9b97-85a283e83a45\") "
Sep 10 21:25:29.415143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414933    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:29.415143 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.414952    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3baca107-4a10-469b-9b97-85a283e83a45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:29.415303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.415212    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:29.415303 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.415287    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.415384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.415308    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3baca107-4a10-469b-9b97-85a283e83a45-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.415384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.415322    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.415384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.415322    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:29.415384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.415334    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.417294 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.417270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-istio-token" (OuterVolumeSpecName: "istio-token") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:29.417395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.417255    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3baca107-4a10-469b-9b97-85a283e83a45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:25:29.417395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.417349    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-kube-api-access-f46j8" (OuterVolumeSpecName: "kube-api-access-f46j8") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "kube-api-access-f46j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:29.417395 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.417362    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3baca107-4a10-469b-9b97-85a283e83a45" (UID: "3baca107-4a10-469b-9b97-85a283e83a45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:29.515813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.515776    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.515813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.515806    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3baca107-4a10-469b-9b97-85a283e83a45-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.515813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.515815    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3baca107-4a10-469b-9b97-85a283e83a45-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.515813 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.515824    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:29.516113 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:29.515833    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f46j8\" (UniqueName: \"kubernetes.io/projected/3baca107-4a10-469b-9b97-85a283e83a45-kube-api-access-f46j8\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:30.308022 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:30.307993    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"
Sep 10 21:25:30.308488 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:30.307989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl" event={"ID":"3baca107-4a10-469b-9b97-85a283e83a45","Type":"ContainerDied","Data":"f1e4f09736294be225aca1765a4e5c192031185bc21d5ebe19d9ffb2bc332a9c"}
Sep 10 21:25:30.308488 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:30.308134    2558 scope.go:117] "RemoveContainer" containerID="f94e487b13b7d81d5a8ec193b95d66af3c4295e50af8594c1f0b71d9e227969f"
Sep 10 21:25:30.342783 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:30.342749    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"]
Sep 10 21:25:30.346812 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:30.346787    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-f7eb29-openshift-default-76b8f8fdd-rpfbl"]
Sep 10 21:25:31.615654 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:31.615615    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3baca107-4a10-469b-9b97-85a283e83a45" path="/var/lib/kubelet/pods/3baca107-4a10-469b-9b97-85a283e83a45/volumes"
Sep 10 21:25:34.723070 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:34.723019    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:35.356287 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.356250    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"]
Sep 10 21:25:35.356522 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.356493    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q" podUID="ae65e73d-012f-4439-846b-360b927f4b30" containerName="maas-api" containerID="cri-o://1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283" gracePeriod=30
Sep 10 21:25:35.381240 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.381209    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:35.466736 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.466698    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:35.539947 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.539917    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:35.620770 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.620696    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:25:35.655768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.655739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:35.658769 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.658750    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-metrics-certs\") pod \"ae65e73d-012f-4439-846b-360b927f4b30\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") "
Sep 10 21:25:35.658833 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.658803    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-maas-api-tls\") pod \"ae65e73d-012f-4439-846b-360b927f4b30\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") "
Sep 10 21:25:35.658883 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.658834    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae65e73d-012f-4439-846b-360b927f4b30-openshift-service-ca\") pod \"ae65e73d-012f-4439-846b-360b927f4b30\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") "
Sep 10 21:25:35.658883 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.658873    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znl9n\" (UniqueName: \"kubernetes.io/projected/ae65e73d-012f-4439-846b-360b927f4b30-kube-api-access-znl9n\") pod \"ae65e73d-012f-4439-846b-360b927f4b30\" (UID: \"ae65e73d-012f-4439-846b-360b927f4b30\") "
Sep 10 21:25:35.659226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.659190    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae65e73d-012f-4439-846b-360b927f4b30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae65e73d-012f-4439-846b-360b927f4b30" (UID: "ae65e73d-012f-4439-846b-360b927f4b30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:35.661115 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.661085    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae65e73d-012f-4439-846b-360b927f4b30" (UID: "ae65e73d-012f-4439-846b-360b927f4b30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:25:35.661221 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.661107    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae65e73d-012f-4439-846b-360b927f4b30" (UID: "ae65e73d-012f-4439-846b-360b927f4b30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:25:35.661221 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.661113    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae65e73d-012f-4439-846b-360b927f4b30-kube-api-access-znl9n" (OuterVolumeSpecName: "kube-api-access-znl9n") pod "ae65e73d-012f-4439-846b-360b927f4b30" (UID: "ae65e73d-012f-4439-846b-360b927f4b30"). InnerVolumeSpecName "kube-api-access-znl9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:35.743461 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.743419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:35.759589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.759559    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:35.759589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.759583    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae65e73d-012f-4439-846b-360b927f4b30-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:35.759589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.759592    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae65e73d-012f-4439-846b-360b927f4b30-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:35.759897 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:35.759603    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znl9n\" (UniqueName: \"kubernetes.io/projected/ae65e73d-012f-4439-846b-360b927f4b30-kube-api-access-znl9n\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:36.149292 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.149252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:36.351951 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.351914    2558 generic.go:356] "Generic (PLEG): container finished" podID="ae65e73d-012f-4439-846b-360b927f4b30" containerID="1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283" exitCode=0
Sep 10 21:25:36.352159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.351958    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"
Sep 10 21:25:36.352159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.352003    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q" event={"ID":"ae65e73d-012f-4439-846b-360b927f4b30","Type":"ContainerDied","Data":"1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283"}
Sep 10 21:25:36.352159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.352083    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q" event={"ID":"ae65e73d-012f-4439-846b-360b927f4b30","Type":"ContainerDied","Data":"5d0db0f69ef15e671c427b3fdab0c9f6d7e44b6da986590a56004629b362e928"}
Sep 10 21:25:36.352159 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.352113    2558 scope.go:117] "RemoveContainer" containerID="1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283"
Sep 10 21:25:36.362693 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.362497    2558 scope.go:117] "RemoveContainer" containerID="1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283"
Sep 10 21:25:36.362862 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:25:36.362837    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283\": container with ID starting with 1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283 not found: ID does not exist" containerID="1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283"
Sep 10 21:25:36.362924 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.362871    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283"} err="failed to get container status \"1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283\": rpc error: code = NotFound desc = could not find container \"1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283\": container with ID starting with 1ae12592d3649354e25006cb91e4506a044210b1dc2695af644582af802de283 not found: ID does not exist"
Sep 10 21:25:36.378453 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.378424    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"]
Sep 10 21:25:36.382688 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:36.382665    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1427b1-86c9866fd7-ktt4q"]
Sep 10 21:25:37.616534 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:37.616496    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae65e73d-012f-4439-846b-360b927f4b30" path="/var/lib/kubelet/pods/ae65e73d-012f-4439-846b-360b927f4b30/volumes"
Sep 10 21:25:38.261184 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:38.261153    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:39.056087 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:39.056035    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:25:42.794284 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:42.794243    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:42.868693 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:42.868646    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:43.179976 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:43.179937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:43.826864 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:43.826821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:53.985740 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:53.985697    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"]
Sep 10 21:25:53.986260 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:53.985931    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c" podUID="fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" containerName="maas-api" containerID="cri-o://d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d" gracePeriod=30
Sep 10 21:25:54.011445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.011412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.109405 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.109337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.195579 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.195530    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.229645 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.229616    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:25:54.251771 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.251675    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.312989 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.312952    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls\") pod \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") "
Sep 10 21:25:54.313198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.313027    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rgrv\" (UniqueName: \"kubernetes.io/projected/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-kube-api-access-4rgrv\") pod \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") "
Sep 10 21:25:54.313198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.313133    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-openshift-service-ca\") pod \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") "
Sep 10 21:25:54.313198 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.313189    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-metrics-certs\") pod \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\" (UID: \"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6\") "
Sep 10 21:25:54.313573 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.313544    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" (UID: "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:54.315412 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.315367    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-kube-api-access-4rgrv" (OuterVolumeSpecName: "kube-api-access-4rgrv") pod "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" (UID: "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6"). InnerVolumeSpecName "kube-api-access-4rgrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:54.315558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.315529    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" (UID: "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:25:54.315655 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.315629    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" (UID: "fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:25:54.413802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.413766    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:54.413802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.413793    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:54.413802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.413802    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rgrv\" (UniqueName: \"kubernetes.io/projected/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-kube-api-access-4rgrv\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:54.413802 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.413812    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:54.467010 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.466972    2558 generic.go:356] "Generic (PLEG): container finished" podID="fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" containerID="d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d" exitCode=0
Sep 10 21:25:54.467195 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.467023    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"
Sep 10 21:25:54.467195 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.467080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c" event={"ID":"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6","Type":"ContainerDied","Data":"d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d"}
Sep 10 21:25:54.467195 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.467139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c" event={"ID":"fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6","Type":"ContainerDied","Data":"6cc4058719b1bf967d48990f619553c40203f31c6e249aaf9507846cbb8dbc22"}
Sep 10 21:25:54.467195 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.467162    2558 scope.go:117] "RemoveContainer" containerID="d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d"
Sep 10 21:25:54.477259 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.477245    2558 scope.go:117] "RemoveContainer" containerID="d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d"
Sep 10 21:25:54.477534 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:25:54.477514    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d\": container with ID starting with d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d not found: ID does not exist" containerID="d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d"
Sep 10 21:25:54.477589 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.477542    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d"} err="failed to get container status \"d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d\": rpc error: code = NotFound desc = could not find container \"d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d\": container with ID starting with d93ba9816a435297f558208ab0cfe8b56fff9d1c0e0316152a1a97df6f65632d not found: ID does not exist"
Sep 10 21:25:54.489605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.489566    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"]
Sep 10 21:25:54.493605 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.493584    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-828c7c-6979d7656f-55h9c"]
Sep 10 21:25:54.603209 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:54.603177    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:55.615857 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:55.615821    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" path="/var/lib/kubelet/pods/fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6/volumes"
Sep 10 21:25:56.999799 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:25:56.999763    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:26:01.110689 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:01.110646    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:01.170942 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:01.170906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:01.378766 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:01.378678    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"]
Sep 10 21:26:01.378953 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:01.378913    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy" containerID="cri-o://d2615ad8023c8a0a0265e95ad5c627355a2817a70cc217d43df00526ae7d6d06" gracePeriod=30
Sep 10 21:26:01.402910 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:01.402878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:02.047284 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:02.047244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:06.540538 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.540506    2558 generic.go:356] "Generic (PLEG): container finished" podID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerID="d2615ad8023c8a0a0265e95ad5c627355a2817a70cc217d43df00526ae7d6d06" exitCode=0
Sep 10 21:26:06.540925 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.540593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" event={"ID":"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da","Type":"ContainerDied","Data":"d2615ad8023c8a0a0265e95ad5c627355a2817a70cc217d43df00526ae7d6d06"}
Sep 10 21:26:06.540925 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.540673    2558 scope.go:117] "RemoveContainer" containerID="5f7cff620bd4d5caeef3715b6d9b0c3132c87aa2382faa62b18253a6c9c02f1d"
Sep 10 21:26:06.636304 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.636278    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:26:06.719946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.719858    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-credential-socket\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.719946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.719902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istiod-ca-cert\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.719946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.719922    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-envoy\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.720205 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.719955    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-podinfo\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.720205 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720011    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-socket\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.720205 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720065    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-token\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.720205 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720096    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-certs\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.720205 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720126    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-data\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.720205 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720155    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnvbr\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-kube-api-access-fnvbr\") pod \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\" (UID: \"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da\") "
Sep 10 21:26:06.720442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720220    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:06.720442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:06.720544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720496    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:06.720544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720506    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.720544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720531    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.720697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720598    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:06.720697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.720603    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:06.722427 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.722398    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-kube-api-access-fnvbr" (OuterVolumeSpecName: "kube-api-access-fnvbr") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "kube-api-access-fnvbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:06.722544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.722432    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:06.722544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.722464    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:06.722544 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.722480    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" (UID: "ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:26:06.821004 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.820964    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnvbr\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-kube-api-access-fnvbr\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.821004 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.820999    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.821004 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.821009    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.821278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.821017    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.821278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.821026    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.821278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.821037    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:06.821278 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:06.821070    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:07.547935 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:07.547905    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"
Sep 10 21:26:07.548390 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:07.547946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f" event={"ID":"ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da","Type":"ContainerDied","Data":"c34c53e01e94247b59308ec334b56f94839992d4c5177e204d90353ef67aef1e"}
Sep 10 21:26:07.548390 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:07.548008    2558 scope.go:117] "RemoveContainer" containerID="d2615ad8023c8a0a0265e95ad5c627355a2817a70cc217d43df00526ae7d6d06"
Sep 10 21:26:07.570382 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:07.570353    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"]
Sep 10 21:26:07.576234 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:07.576212    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-828c7c-openshift-default-5f57cf747d-4tb6f"]
Sep 10 21:26:07.615249 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:07.615215    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" path="/var/lib/kubelet/pods/ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da/volumes"
Sep 10 21:26:12.363225 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.363190    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"]
Sep 10 21:26:12.363809 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.363391    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp" podUID="5fdcc88b-34cd-4aaa-a750-2fa471f28818" containerName="maas-api" containerID="cri-o://ea2d9ba78163e0144d21402efd77d3cecdc4927bcb776537f7f72dec1827d71f" gracePeriod=30
Sep 10 21:26:12.393485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.393453    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:12.515233 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.515194    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:12.581919 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.581879    2558 generic.go:356] "Generic (PLEG): container finished" podID="5fdcc88b-34cd-4aaa-a750-2fa471f28818" containerID="ea2d9ba78163e0144d21402efd77d3cecdc4927bcb776537f7f72dec1827d71f" exitCode=0
Sep 10 21:26:12.581919 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.581917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp" event={"ID":"5fdcc88b-34cd-4aaa-a750-2fa471f28818","Type":"ContainerDied","Data":"ea2d9ba78163e0144d21402efd77d3cecdc4927bcb776537f7f72dec1827d71f"}
Sep 10 21:26:12.606902 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.606878    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:26:12.614250 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.614183    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:12.673998 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.673962    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-metrics-certs\") pod \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") "
Sep 10 21:26:12.674206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.674018    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h64h\" (UniqueName: \"kubernetes.io/projected/5fdcc88b-34cd-4aaa-a750-2fa471f28818-kube-api-access-4h64h\") pod \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") "
Sep 10 21:26:12.674206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.674066    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-maas-api-tls\") pod \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") "
Sep 10 21:26:12.674206 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.674136    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fdcc88b-34cd-4aaa-a750-2fa471f28818-openshift-service-ca\") pod \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\" (UID: \"5fdcc88b-34cd-4aaa-a750-2fa471f28818\") "
Sep 10 21:26:12.674551 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.674527    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fdcc88b-34cd-4aaa-a750-2fa471f28818-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fdcc88b-34cd-4aaa-a750-2fa471f28818" (UID: "5fdcc88b-34cd-4aaa-a750-2fa471f28818"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:12.676271 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.676247    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5fdcc88b-34cd-4aaa-a750-2fa471f28818" (UID: "5fdcc88b-34cd-4aaa-a750-2fa471f28818"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:12.676362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.676278    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fdcc88b-34cd-4aaa-a750-2fa471f28818" (UID: "5fdcc88b-34cd-4aaa-a750-2fa471f28818"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:12.676362 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.676296    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fdcc88b-34cd-4aaa-a750-2fa471f28818-kube-api-access-4h64h" (OuterVolumeSpecName: "kube-api-access-4h64h") pod "5fdcc88b-34cd-4aaa-a750-2fa471f28818" (UID: "5fdcc88b-34cd-4aaa-a750-2fa471f28818"). InnerVolumeSpecName "kube-api-access-4h64h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:12.723970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.723939    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:12.775703 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.775670    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:12.775703 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.775698    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h64h\" (UniqueName: \"kubernetes.io/projected/5fdcc88b-34cd-4aaa-a750-2fa471f28818-kube-api-access-4h64h\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:12.775960 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.775718    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fdcc88b-34cd-4aaa-a750-2fa471f28818-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:12.775960 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.775726    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fdcc88b-34cd-4aaa-a750-2fa471f28818-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:12.786117 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:12.786085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:13.160088 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:13.160037    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:13.589211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:13.589178    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp" event={"ID":"5fdcc88b-34cd-4aaa-a750-2fa471f28818","Type":"ContainerDied","Data":"30229a8d8b17338b4166986751b4f66bd03a4feeed19149fd31c466174929940"}
Sep 10 21:26:13.589211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:13.589206    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"
Sep 10 21:26:13.589739 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:13.589239    2558 scope.go:117] "RemoveContainer" containerID="ea2d9ba78163e0144d21402efd77d3cecdc4927bcb776537f7f72dec1827d71f"
Sep 10 21:26:13.615286 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:13.615258    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"]
Sep 10 21:26:13.619217 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:13.619194    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9f6475-6fbf45878-s6gnp"]
Sep 10 21:26:15.006858 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:15.006820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:26:15.614391 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:15.614356    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fdcc88b-34cd-4aaa-a750-2fa471f28818" path="/var/lib/kubelet/pods/5fdcc88b-34cd-4aaa-a750-2fa471f28818/volumes"
Sep 10 21:26:19.616001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:19.615967    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:19.672837 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:19.672797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:19.899687 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:19.899605    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"]
Sep 10 21:26:19.899861 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:19.899837    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" containerID="cri-o://462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb" gracePeriod=30
Sep 10 21:26:19.915411 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:19.915379    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:23.728851 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:23.728812    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:26:24.110262 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:24.110225    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:26:24.110460 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:24.110287    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:26:25.167882 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.167810    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:26:25.282608 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-token\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.282819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282619    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-envoy\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.282819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282644    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bdf34a8-016f-41f0-82e7-14af823b5965-istiod-ca-cert\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.282819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282675    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-socket\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.282819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282707    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-credential-socket\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.282819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6879b\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-kube-api-access-6879b\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.282819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282774    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-podinfo\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.282819 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282814    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-data\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.283226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282873    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-certs\") pod \"3bdf34a8-016f-41f0-82e7-14af823b5965\" (UID: \"3bdf34a8-016f-41f0-82e7-14af823b5965\") "
Sep 10 21:26:25.283226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.282994    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:25.283226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.283039    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:25.283226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.283155    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bdf34a8-016f-41f0-82e7-14af823b5965-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:25.283226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.283219    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.283438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.283239    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.283438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.283268    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:25.283438 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.283280    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-data" (OuterVolumeSpecName: "istio-data") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:25.285001 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.284969    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:25.285163 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.285062    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-token" (OuterVolumeSpecName: "istio-token") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:25.285163 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.285104    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:26:25.285254 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.285167    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-kube-api-access-6879b" (OuterVolumeSpecName: "kube-api-access-6879b") pod "3bdf34a8-016f-41f0-82e7-14af823b5965" (UID: "3bdf34a8-016f-41f0-82e7-14af823b5965"). InnerVolumeSpecName "kube-api-access-6879b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:25.383949 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.383907    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6879b\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-kube-api-access-6879b\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.383949 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.383948    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.384183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.383963    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.384183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.383978    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.384183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.383991    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.384183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.384004    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bdf34a8-016f-41f0-82e7-14af823b5965-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.384183 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.384017    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bdf34a8-016f-41f0-82e7-14af823b5965-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:25.663282 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.663249    2558 generic.go:356] "Generic (PLEG): container finished" podID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerID="462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb" exitCode=0
Sep 10 21:26:25.663481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.663299    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"
Sep 10 21:26:25.663481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.663309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" event={"ID":"3bdf34a8-016f-41f0-82e7-14af823b5965","Type":"ContainerDied","Data":"462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb"}
Sep 10 21:26:25.663481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.663364    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8" event={"ID":"3bdf34a8-016f-41f0-82e7-14af823b5965","Type":"ContainerDied","Data":"2a9747fc7fb1ce25ab7a751a1f7f0d5bb4d547da85e65ab0efd0553eb0550537"}
Sep 10 21:26:25.663481 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.663394    2558 scope.go:117] "RemoveContainer" containerID="462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb"
Sep 10 21:26:25.672409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.672391    2558 scope.go:117] "RemoveContainer" containerID="9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d"
Sep 10 21:26:25.681036 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.681013    2558 scope.go:117] "RemoveContainer" containerID="462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb"
Sep 10 21:26:25.681478 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:26:25.681458    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb\": container with ID starting with 462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb not found: ID does not exist" containerID="462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb"
Sep 10 21:26:25.681559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.681485    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb"} err="failed to get container status \"462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb\": rpc error: code = NotFound desc = could not find container \"462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb\": container with ID starting with 462c32bdf485ea21d51b627b79e4e95af7cb05889f9996963a908c09c6db32eb not found: ID does not exist"
Sep 10 21:26:25.681559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.681507    2558 scope.go:117] "RemoveContainer" containerID="9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d"
Sep 10 21:26:25.681800 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:26:25.681784    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d\": container with ID starting with 9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d not found: ID does not exist" containerID="9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d"
Sep 10 21:26:25.681852 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.681802    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d"} err="failed to get container status \"9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d\": rpc error: code = NotFound desc = could not find container \"9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d\": container with ID starting with 9b1518f90fcec8e0d1b606f03eb3089e3949ccd64c50623203b0ef66bc5fae8d not found: ID does not exist"
Sep 10 21:26:25.681948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.681927    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"]
Sep 10 21:26:25.687467 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:25.687439    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9f6475-openshift-default-576dd67dfb-b9sp8"]
Sep 10 21:26:27.615386 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:26:27.615350    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" path="/var/lib/kubelet/pods/3bdf34a8-016f-41f0-82e7-14af823b5965/volumes"
Sep 10 21:27:44.762039 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:27:44.761956    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:27:45.702484 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:27:45.702446    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:27:46.324179 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:27:46.324144    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:27:47.830149 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:27:47.830110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:27:50.323510 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:27:50.323471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:27:55.440371 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:27:55.440339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:28:09.326876 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:09.326814    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:28:09.443780 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:09.443744    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:28:12.212547 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:12.212511    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:28:20.308838 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:20.308803    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:28:28.203319 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:28.203286    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:28:36.368665 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:36.368633    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:28:46.003313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:46.003273    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:28:52.712647 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:52.712607    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:28:55.912469 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:55.912430    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"]
Sep 10 21:28:55.912946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:55.912696    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4" podUID="64895201-d3a3-4db8-8740-9ee6a2312c2e" containerName="manager" containerID="cri-o://295d089d92d12edd530836b537a4e1c02945fc86c9f8b943f3a800a58d316884" gracePeriod=10
Sep 10 21:28:56.479427 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.479391    2558 generic.go:356] "Generic (PLEG): container finished" podID="64895201-d3a3-4db8-8740-9ee6a2312c2e" containerID="295d089d92d12edd530836b537a4e1c02945fc86c9f8b943f3a800a58d316884" exitCode=0
Sep 10 21:28:56.479588 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.479461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4" event={"ID":"64895201-d3a3-4db8-8740-9ee6a2312c2e","Type":"ContainerDied","Data":"295d089d92d12edd530836b537a4e1c02945fc86c9f8b943f3a800a58d316884"}
Sep 10 21:28:56.567029 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.567005    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:28:56.655914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.655822    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64895201-d3a3-4db8-8740-9ee6a2312c2e-extensions-socket-volume\") pod \"64895201-d3a3-4db8-8740-9ee6a2312c2e\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") "
Sep 10 21:28:56.655914 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.655901    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thxzd\" (UniqueName: \"kubernetes.io/projected/64895201-d3a3-4db8-8740-9ee6a2312c2e-kube-api-access-thxzd\") pod \"64895201-d3a3-4db8-8740-9ee6a2312c2e\" (UID: \"64895201-d3a3-4db8-8740-9ee6a2312c2e\") "
Sep 10 21:28:56.656215 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.656178    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64895201-d3a3-4db8-8740-9ee6a2312c2e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "64895201-d3a3-4db8-8740-9ee6a2312c2e" (UID: "64895201-d3a3-4db8-8740-9ee6a2312c2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:28:56.657881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.657860    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64895201-d3a3-4db8-8740-9ee6a2312c2e-kube-api-access-thxzd" (OuterVolumeSpecName: "kube-api-access-thxzd") pod "64895201-d3a3-4db8-8740-9ee6a2312c2e" (UID: "64895201-d3a3-4db8-8740-9ee6a2312c2e"). InnerVolumeSpecName "kube-api-access-thxzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:28:56.756741 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.756701    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64895201-d3a3-4db8-8740-9ee6a2312c2e-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:28:56.756741 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:56.756733    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thxzd\" (UniqueName: \"kubernetes.io/projected/64895201-d3a3-4db8-8740-9ee6a2312c2e-kube-api-access-thxzd\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:28:57.486384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:57.486347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4" event={"ID":"64895201-d3a3-4db8-8740-9ee6a2312c2e","Type":"ContainerDied","Data":"086a14bfdb9b024d3db5b1f751bcfd0733c1b652f8687e079ab952281b9490b4"}
Sep 10 21:28:57.486384 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:57.486380    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"
Sep 10 21:28:57.486879 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:57.486411    2558 scope.go:117] "RemoveContainer" containerID="295d089d92d12edd530836b537a4e1c02945fc86c9f8b943f3a800a58d316884"
Sep 10 21:28:57.511298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:57.511270    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"]
Sep 10 21:28:57.515970 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:57.515946    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7f4x4"]
Sep 10 21:28:57.614696 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:28:57.614668    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64895201-d3a3-4db8-8740-9ee6a2312c2e" path="/var/lib/kubelet/pods/64895201-d3a3-4db8-8740-9ee6a2312c2e/volumes"
Sep 10 21:29:56.614672 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.614616    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"]
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615100    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" containerName="maas-api"
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615120    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" containerName="maas-api"
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615132    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy"
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615141    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy"
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615148    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy"
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615156    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy"
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615164    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy"
Sep 10 21:29:56.615162 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615170    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615177    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae65e73d-012f-4439-846b-360b927f4b30" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615183    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae65e73d-012f-4439-846b-360b927f4b30" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615191    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64895201-d3a3-4db8-8740-9ee6a2312c2e" containerName="manager"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615197    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="64895201-d3a3-4db8-8740-9ee6a2312c2e" containerName="manager"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615204    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615210    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615214    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615220    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615227    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615233    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615240    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fdcc88b-34cd-4aaa-a750-2fa471f28818" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615244    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fdcc88b-34cd-4aaa-a750-2fa471f28818" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615252    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615257    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615263    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615268    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615324    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615332    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615339    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4895e77c-c2f7-4ce7-b36b-c1a0f207abcb" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615346    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615351    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3baca107-4a10-469b-9b97-85a283e83a45" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615358    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="64895201-d3a3-4db8-8740-9ee6a2312c2e" containerName="manager"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615363    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615369    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615374    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fdcc88b-34cd-4aaa-a750-2fa471f28818" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615379    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3573b7-9fd4-4c53-a05c-009e4b55188a" containerName="istio-proxy"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615385    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae65e73d-012f-4439-846b-360b927f4b30" containerName="maas-api"
Sep 10 21:29:56.615470 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.615391    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc4adeee-eccd-4ea8-bd5a-b076f0d0fcb6" containerName="maas-api"
Sep 10 21:29:56.618238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.618220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:56.620621 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.620599    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nrtth\""
Sep 10 21:29:56.630445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.630419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"]
Sep 10 21:29:56.643616 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.643583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr626\" (UniqueName: \"kubernetes.io/projected/ae881c1e-7a8c-4120-a546-fb99a8fe40d9-kube-api-access-sr626\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4zghb\" (UID: \"ae881c1e-7a8c-4120-a546-fb99a8fe40d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:56.643761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.643741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae881c1e-7a8c-4120-a546-fb99a8fe40d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4zghb\" (UID: \"ae881c1e-7a8c-4120-a546-fb99a8fe40d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:56.744552 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.744509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae881c1e-7a8c-4120-a546-fb99a8fe40d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4zghb\" (UID: \"ae881c1e-7a8c-4120-a546-fb99a8fe40d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:56.744729 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.744563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr626\" (UniqueName: \"kubernetes.io/projected/ae881c1e-7a8c-4120-a546-fb99a8fe40d9-kube-api-access-sr626\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4zghb\" (UID: \"ae881c1e-7a8c-4120-a546-fb99a8fe40d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:56.744898 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.744877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae881c1e-7a8c-4120-a546-fb99a8fe40d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4zghb\" (UID: \"ae881c1e-7a8c-4120-a546-fb99a8fe40d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:56.752524 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.752494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr626\" (UniqueName: \"kubernetes.io/projected/ae881c1e-7a8c-4120-a546-fb99a8fe40d9-kube-api-access-sr626\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4zghb\" (UID: \"ae881c1e-7a8c-4120-a546-fb99a8fe40d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:56.927575 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:56.927489    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:57.203681 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:57.203653    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"]
Sep 10 21:29:57.205580 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:29:57.205552    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae881c1e_7a8c_4120_a546_fb99a8fe40d9.slice/crio-23034b65ce9a6606edf340019b6f2b1510ca9115d83f0b1d06a1953a105563f5 WatchSource:0}: Error finding container 23034b65ce9a6606edf340019b6f2b1510ca9115d83f0b1d06a1953a105563f5: Status 404 returned error can't find the container with id 23034b65ce9a6606edf340019b6f2b1510ca9115d83f0b1d06a1953a105563f5
Sep 10 21:29:57.805005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:57.804959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb" event={"ID":"ae881c1e-7a8c-4120-a546-fb99a8fe40d9","Type":"ContainerStarted","Data":"0a7f98636a84c62a7ed693000e008096cf439c4ce174a33288258d55b07eaa60"}
Sep 10 21:29:57.805444 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:57.805029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb" event={"ID":"ae881c1e-7a8c-4120-a546-fb99a8fe40d9","Type":"ContainerStarted","Data":"23034b65ce9a6606edf340019b6f2b1510ca9115d83f0b1d06a1953a105563f5"}
Sep 10 21:29:57.805444 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:57.805085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:29:57.828878 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:29:57.828828    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb" podStartSLOduration=1.8288125370000001 podStartE2EDuration="1.828812537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:29:57.825844342 +0000 UTC m=+1926.737124124" watchObservedRunningTime="2026-09-10 21:29:57.828812537 +0000 UTC m=+1926.740092319"
Sep 10 21:30:08.812180 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:08.812148    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4zghb"
Sep 10 21:30:19.401187 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:19.401147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:30:26.507945 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:26.507903    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:30:43.304244 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.304204    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"]
Sep 10 21:30:43.304781 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.304760    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy"
Sep 10 21:30:43.304781 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.304782    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bdf34a8-016f-41f0-82e7-14af823b5965" containerName="istio-proxy"
Sep 10 21:30:43.304962 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.304868    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8ed9b5-d9f9-4a63-98a8-d6cdb0c7c8da" containerName="istio-proxy"
Sep 10 21:30:43.307578 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.307561    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.309830 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.309804    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 21:30:43.310150 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.310132    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-62ecef60-kserve-self-signed-certs\""
Sep 10 21:30:43.310801 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.310781    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 21:30:43.310943 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.310924    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mbf94\""
Sep 10 21:30:43.316918 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.316896    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"]
Sep 10 21:30:43.346815 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.346781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-dshm\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.347005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.346829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv6dx\" (UniqueName: \"kubernetes.io/projected/d99f7adf-26c4-4028-9d47-02090f2bb686-kube-api-access-xv6dx\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.347005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.346865    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99f7adf-26c4-4028-9d47-02090f2bb686-tls-certs\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.347005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.346886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-home\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.347005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.346918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-model-cache\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.347005 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.346981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-tmp-dir\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.365984 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.365920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:30:43.447457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.447414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-dshm\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.447457 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.447457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv6dx\" (UniqueName: \"kubernetes.io/projected/d99f7adf-26c4-4028-9d47-02090f2bb686-kube-api-access-xv6dx\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.447718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.447487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99f7adf-26c4-4028-9d47-02090f2bb686-tls-certs\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.447718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.447511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-home\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.447718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.447548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-model-cache\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.447718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.447592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-tmp-dir\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.448017 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.447994    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-tmp-dir\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.448097 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.448013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-model-cache\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.448165 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.448111    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-home\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.450094 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.450059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-dshm\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.450373 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.450353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99f7adf-26c4-4028-9d47-02090f2bb686-tls-certs\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.455376 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.455351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv6dx\" (UniqueName: \"kubernetes.io/projected/d99f7adf-26c4-4028-9d47-02090f2bb686-kube-api-access-xv6dx\") pod \"e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") " pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.617668 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.617590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:43.890792 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:43.890766    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"]
Sep 10 21:30:43.892587 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:30:43.892558    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd99f7adf_26c4_4028_9d47_02090f2bb686.slice/crio-c6f9523285b2ae13d7cb944bfe590a9fbb7de46397696534477d3f900efba26b WatchSource:0}: Error finding container c6f9523285b2ae13d7cb944bfe590a9fbb7de46397696534477d3f900efba26b: Status 404 returned error can't find the container with id c6f9523285b2ae13d7cb944bfe590a9fbb7de46397696534477d3f900efba26b
Sep 10 21:30:44.053307 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:44.053268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m" event={"ID":"d99f7adf-26c4-4028-9d47-02090f2bb686","Type":"ContainerStarted","Data":"aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c"}
Sep 10 21:30:44.053511 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:44.053318    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m" event={"ID":"d99f7adf-26c4-4028-9d47-02090f2bb686","Type":"ContainerStarted","Data":"c6f9523285b2ae13d7cb944bfe590a9fbb7de46397696534477d3f900efba26b"}
Sep 10 21:30:44.070155 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:44.070098    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m" podStartSLOduration=1.070081001 podStartE2EDuration="1.070081001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:30:44.069358735 +0000 UTC m=+1972.980638562" watchObservedRunningTime="2026-09-10 21:30:44.070081001 +0000 UTC m=+1972.981360782"
Sep 10 21:30:45.901865 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:45.901831    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:30:50.952403 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:50.952373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:30:53.507266 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:53.507223    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:30:53.618998 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:53.618966    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:53.619218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:53.619008    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:53.632169 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:53.632139    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:30:54.129279 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:30:54.129248    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:31:11.584908 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:11.584875    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"]
Sep 10 21:31:11.607112 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:11.607081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:31:13.603230 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:13.603184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:31:13.839752 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:13.839717    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:31:22.606227 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:22.606191    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:31:26.604379 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.604333    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m" podUID="d99f7adf-26c4-4028-9d47-02090f2bb686" containerName="main" containerID="cri-o://aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c" gracePeriod=45
Sep 10 21:31:26.839859 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.839835    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:31:26.903524 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903441    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-dshm\") pod \"d99f7adf-26c4-4028-9d47-02090f2bb686\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") "
Sep 10 21:31:26.903524 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903504    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-home\") pod \"d99f7adf-26c4-4028-9d47-02090f2bb686\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") "
Sep 10 21:31:26.903761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903556    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-tmp-dir\") pod \"d99f7adf-26c4-4028-9d47-02090f2bb686\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") "
Sep 10 21:31:26.903761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903585    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv6dx\" (UniqueName: \"kubernetes.io/projected/d99f7adf-26c4-4028-9d47-02090f2bb686-kube-api-access-xv6dx\") pod \"d99f7adf-26c4-4028-9d47-02090f2bb686\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") "
Sep 10 21:31:26.903761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903610    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-model-cache\") pod \"d99f7adf-26c4-4028-9d47-02090f2bb686\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") "
Sep 10 21:31:26.903761 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903640    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99f7adf-26c4-4028-9d47-02090f2bb686-tls-certs\") pod \"d99f7adf-26c4-4028-9d47-02090f2bb686\" (UID: \"d99f7adf-26c4-4028-9d47-02090f2bb686\") "
Sep 10 21:31:26.903948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903776    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-home" (OuterVolumeSpecName: "home") pod "d99f7adf-26c4-4028-9d47-02090f2bb686" (UID: "d99f7adf-26c4-4028-9d47-02090f2bb686"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:31:26.903948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d99f7adf-26c4-4028-9d47-02090f2bb686" (UID: "d99f7adf-26c4-4028-9d47-02090f2bb686"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:31:26.903948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.903924    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-model-cache" (OuterVolumeSpecName: "model-cache") pod "d99f7adf-26c4-4028-9d47-02090f2bb686" (UID: "d99f7adf-26c4-4028-9d47-02090f2bb686"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:31:26.905722 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.905691    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-dshm" (OuterVolumeSpecName: "dshm") pod "d99f7adf-26c4-4028-9d47-02090f2bb686" (UID: "d99f7adf-26c4-4028-9d47-02090f2bb686"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:31:26.905722 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.905695    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99f7adf-26c4-4028-9d47-02090f2bb686-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d99f7adf-26c4-4028-9d47-02090f2bb686" (UID: "d99f7adf-26c4-4028-9d47-02090f2bb686"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:31:26.905867 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:26.905739    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99f7adf-26c4-4028-9d47-02090f2bb686-kube-api-access-xv6dx" (OuterVolumeSpecName: "kube-api-access-xv6dx") pod "d99f7adf-26c4-4028-9d47-02090f2bb686" (UID: "d99f7adf-26c4-4028-9d47-02090f2bb686"). InnerVolumeSpecName "kube-api-access-xv6dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:31:27.004754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.004718    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-home\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:27.004754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.004748    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-tmp-dir\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:27.004754 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.004759    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv6dx\" (UniqueName: \"kubernetes.io/projected/d99f7adf-26c4-4028-9d47-02090f2bb686-kube-api-access-xv6dx\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:27.004975 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.004768    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-model-cache\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:27.004975 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.004781    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99f7adf-26c4-4028-9d47-02090f2bb686-tls-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:27.004975 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.004791    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99f7adf-26c4-4028-9d47-02090f2bb686-dshm\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:27.305818 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.305781    2558 generic.go:356] "Generic (PLEG): container finished" podID="d99f7adf-26c4-4028-9d47-02090f2bb686" containerID="aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c" exitCode=0
Sep 10 21:31:27.305999 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.305841    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"
Sep 10 21:31:27.305999 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.305868    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m" event={"ID":"d99f7adf-26c4-4028-9d47-02090f2bb686","Type":"ContainerDied","Data":"aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c"}
Sep 10 21:31:27.305999 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.305911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m" event={"ID":"d99f7adf-26c4-4028-9d47-02090f2bb686","Type":"ContainerDied","Data":"c6f9523285b2ae13d7cb944bfe590a9fbb7de46397696534477d3f900efba26b"}
Sep 10 21:31:27.305999 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.305929    2558 scope.go:117] "RemoveContainer" containerID="aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c"
Sep 10 21:31:27.315351 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.315334    2558 scope.go:117] "RemoveContainer" containerID="aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c"
Sep 10 21:31:27.315598 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:31:27.315583    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c\": container with ID starting with aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c not found: ID does not exist" containerID="aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c"
Sep 10 21:31:27.315669 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.315604    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c"} err="failed to get container status \"aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c\": rpc error: code = NotFound desc = could not find container \"aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c\": container with ID starting with aa5beabfaf26cc6d45064991eb52c205d003dca1427a1aff13e8a20bf8a0171c not found: ID does not exist"
Sep 10 21:31:27.326652 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.326626    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"]
Sep 10 21:31:27.329419 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.329398    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-62ecef60-kserve-7dd64656c5-wz44m"]
Sep 10 21:31:27.615692 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:27.615605    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99f7adf-26c4-4028-9d47-02090f2bb686" path="/var/lib/kubelet/pods/d99f7adf-26c4-4028-9d47-02090f2bb686/volumes"
Sep 10 21:31:29.634591 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.634556    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"]
Sep 10 21:31:29.634932 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.634899    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99f7adf-26c4-4028-9d47-02090f2bb686" containerName="main"
Sep 10 21:31:29.634932 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.634909    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99f7adf-26c4-4028-9d47-02090f2bb686" containerName="main"
Sep 10 21:31:29.635030 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.634977    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99f7adf-26c4-4028-9d47-02090f2bb686" containerName="main"
Sep 10 21:31:29.639380 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.639357    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.642538 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.642508    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 21:31:29.642702 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.642612    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 21:31:29.642702 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.642666    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rf2kh\""
Sep 10 21:31:29.642841 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.642736    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:31:29.642841 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.642824    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 21:31:29.651089 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.651037    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"]
Sep 10 21:31:29.653343 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.653322    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"]
Sep 10 21:31:29.656733 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.656710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.665211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.665165    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"]
Sep 10 21:31:29.728016 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.727981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb76db8-5819-43e5-a0a8-558172f33c91-openshift-service-ca\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.728217 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.728140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-metrics-certs\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.728298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.728215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131491d3-8afd-4544-bad1-17331207b636-openshift-service-ca\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.728298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.728250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131491d3-8afd-4544-bad1-17331207b636-maas-api-tls\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.728298 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.728277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhk76\" (UniqueName: \"kubernetes.io/projected/131491d3-8afd-4544-bad1-17331207b636-kube-api-access-vhk76\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.728444 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.728352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-maas-api-tls\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.728485 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.728450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/131491d3-8afd-4544-bad1-17331207b636-metrics-certs\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.728561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.728542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8hcx\" (UniqueName: \"kubernetes.io/projected/6bb76db8-5819-43e5-a0a8-558172f33c91-kube-api-access-z8hcx\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.829232 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8hcx\" (UniqueName: \"kubernetes.io/projected/6bb76db8-5819-43e5-a0a8-558172f33c91-kube-api-access-z8hcx\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb76db8-5819-43e5-a0a8-558172f33c91-openshift-service-ca\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-metrics-certs\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131491d3-8afd-4544-bad1-17331207b636-openshift-service-ca\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131491d3-8afd-4544-bad1-17331207b636-maas-api-tls\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhk76\" (UniqueName: \"kubernetes.io/projected/131491d3-8afd-4544-bad1-17331207b636-kube-api-access-vhk76\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.829409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-maas-api-tls\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.829737 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.829416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/131491d3-8afd-4544-bad1-17331207b636-metrics-certs\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.830218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.830186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131491d3-8afd-4544-bad1-17331207b636-openshift-service-ca\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.830346 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.830211    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb76db8-5819-43e5-a0a8-558172f33c91-openshift-service-ca\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.831925 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.831889    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-maas-api-tls\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.832096 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.832075    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131491d3-8afd-4544-bad1-17331207b636-maas-api-tls\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.832401 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.832382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-metrics-certs\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.832442 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.832382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/131491d3-8afd-4544-bad1-17331207b636-metrics-certs\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.837422 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.837404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhk76\" (UniqueName: \"kubernetes.io/projected/131491d3-8afd-4544-bad1-17331207b636-kube-api-access-vhk76\") pod \"maas-api-767c774f97-9gnsg\" (UID: \"131491d3-8afd-4544-bad1-17331207b636\") " pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:29.837504 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.837433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8hcx\" (UniqueName: \"kubernetes.io/projected/6bb76db8-5819-43e5-a0a8-558172f33c91-kube-api-access-z8hcx\") pod \"maas-api-5867c8d69-bxks7\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") " pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.952131 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.952037    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:29.971344 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:29.971317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:30.011631 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:30.011420    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:31:30.230226 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:30.230193    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"]
Sep 10 21:31:30.231709 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:31:30.231683    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb76db8_5819_43e5_a0a8_558172f33c91.slice/crio-1f346e0751764ce0e921891ee94865822564c52affe26d0c3326218a32ad34ec WatchSource:0}: Error finding container 1f346e0751764ce0e921891ee94865822564c52affe26d0c3326218a32ad34ec: Status 404 returned error can't find the container with id 1f346e0751764ce0e921891ee94865822564c52affe26d0c3326218a32ad34ec
Sep 10 21:31:30.233114 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:30.233096    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:31:30.255458 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:30.255433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"]
Sep 10 21:31:30.256380 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:31:30.256352    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131491d3_8afd_4544_bad1_17331207b636.slice/crio-6178e9bc042b2858fbe8364521e2961210b6a58b99edab6fd6cbb323492f9d45 WatchSource:0}: Error finding container 6178e9bc042b2858fbe8364521e2961210b6a58b99edab6fd6cbb323492f9d45: Status 404 returned error can't find the container with id 6178e9bc042b2858fbe8364521e2961210b6a58b99edab6fd6cbb323492f9d45
Sep 10 21:31:30.322798 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:30.322763    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7" event={"ID":"6bb76db8-5819-43e5-a0a8-558172f33c91","Type":"ContainerStarted","Data":"1f346e0751764ce0e921891ee94865822564c52affe26d0c3326218a32ad34ec"}
Sep 10 21:31:30.323948 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:30.323920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg" event={"ID":"131491d3-8afd-4544-bad1-17331207b636","Type":"ContainerStarted","Data":"6178e9bc042b2858fbe8364521e2961210b6a58b99edab6fd6cbb323492f9d45"}
Sep 10 21:31:31.330435 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:31.330383    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7" event={"ID":"6bb76db8-5819-43e5-a0a8-558172f33c91","Type":"ContainerStarted","Data":"37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059"}
Sep 10 21:31:31.330846 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:31.330447    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:31.331998 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:31.331972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg" event={"ID":"131491d3-8afd-4544-bad1-17331207b636","Type":"ContainerStarted","Data":"03d72f96f806ec5f19934f1b2a0fb6505479e2d6fd5e33b283eea642a1808de2"}
Sep 10 21:31:31.332139 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:31.332082    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:31.358558 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:31.358500    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7" podStartSLOduration=1.93485018 podStartE2EDuration="2.358482692s" totalImagesPullingTime="423.632512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:31:31.357022797 +0000 UTC m=+2020.268302594" watchObservedRunningTime="2026-09-10 21:31:31.358482692 +0000 UTC m=+2020.269762474"
Sep 10 21:31:31.401666 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:31.401612    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg" podStartSLOduration=1.977910066 podStartE2EDuration="2.401593262s" totalImagesPullingTime="423.683196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:31:31.399012388 +0000 UTC m=+2020.310292196" watchObservedRunningTime="2026-09-10 21:31:31.401593262 +0000 UTC m=+2020.312873044"
Sep 10 21:31:37.219532 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.219489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:31:37.348260 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.348225    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:37.348918 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.348813    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-767c774f97-9gnsg"
Sep 10 21:31:37.424883 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.424845    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"]
Sep 10 21:31:37.425082 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.425030    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7" podUID="6bb76db8-5819-43e5-a0a8-558172f33c91" containerName="maas-api" containerID="cri-o://37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059" gracePeriod=30
Sep 10 21:31:37.674713 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.674687    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:37.802595 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.802568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-maas-api-tls\") pod \"6bb76db8-5819-43e5-a0a8-558172f33c91\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") "
Sep 10 21:31:37.802756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.802625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8hcx\" (UniqueName: \"kubernetes.io/projected/6bb76db8-5819-43e5-a0a8-558172f33c91-kube-api-access-z8hcx\") pod \"6bb76db8-5819-43e5-a0a8-558172f33c91\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") "
Sep 10 21:31:37.802756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.802672    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb76db8-5819-43e5-a0a8-558172f33c91-openshift-service-ca\") pod \"6bb76db8-5819-43e5-a0a8-558172f33c91\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") "
Sep 10 21:31:37.802756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.802723    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-metrics-certs\") pod \"6bb76db8-5819-43e5-a0a8-558172f33c91\" (UID: \"6bb76db8-5819-43e5-a0a8-558172f33c91\") "
Sep 10 21:31:37.803129 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.803097    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb76db8-5819-43e5-a0a8-558172f33c91-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6bb76db8-5819-43e5-a0a8-558172f33c91" (UID: "6bb76db8-5819-43e5-a0a8-558172f33c91"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:31:37.804899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.804869    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6bb76db8-5819-43e5-a0a8-558172f33c91" (UID: "6bb76db8-5819-43e5-a0a8-558172f33c91"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:31:37.804899 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.804875    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb76db8-5819-43e5-a0a8-558172f33c91-kube-api-access-z8hcx" (OuterVolumeSpecName: "kube-api-access-z8hcx") pod "6bb76db8-5819-43e5-a0a8-558172f33c91" (UID: "6bb76db8-5819-43e5-a0a8-558172f33c91"). InnerVolumeSpecName "kube-api-access-z8hcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:31:37.805028 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.804934    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6bb76db8-5819-43e5-a0a8-558172f33c91" (UID: "6bb76db8-5819-43e5-a0a8-558172f33c91"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:31:37.904238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.904187    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-metrics-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:37.904238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.904232    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb76db8-5819-43e5-a0a8-558172f33c91-maas-api-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:37.904238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.904242    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8hcx\" (UniqueName: \"kubernetes.io/projected/6bb76db8-5819-43e5-a0a8-558172f33c91-kube-api-access-z8hcx\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:37.904238 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:37.904251    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb76db8-5819-43e5-a0a8-558172f33c91-openshift-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
Sep 10 21:31:38.374409 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.374363    2558 generic.go:356] "Generic (PLEG): container finished" podID="6bb76db8-5819-43e5-a0a8-558172f33c91" containerID="37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059" exitCode=0
Sep 10 21:31:38.374913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.374428    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"
Sep 10 21:31:38.374913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.374447    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7" event={"ID":"6bb76db8-5819-43e5-a0a8-558172f33c91","Type":"ContainerDied","Data":"37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059"}
Sep 10 21:31:38.374913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.374505    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5867c8d69-bxks7" event={"ID":"6bb76db8-5819-43e5-a0a8-558172f33c91","Type":"ContainerDied","Data":"1f346e0751764ce0e921891ee94865822564c52affe26d0c3326218a32ad34ec"}
Sep 10 21:31:38.374913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.374530    2558 scope.go:117] "RemoveContainer" containerID="37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059"
Sep 10 21:31:38.385893 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.385722    2558 scope.go:117] "RemoveContainer" containerID="37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059"
Sep 10 21:31:38.386093 ip-10-0-134-100 kubenswrapper[2558]: E0910 21:31:38.386065    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059\": container with ID starting with 37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059 not found: ID does not exist" containerID="37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059"
Sep 10 21:31:38.386169 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.386104    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059"} err="failed to get container status \"37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059\": rpc error: code = NotFound desc = could not find container \"37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059\": container with ID starting with 37e0b7b3e5b6870a68b98184fab028b6b3e538426f1a1d8e796a67cc8f17f059 not found: ID does not exist"
Sep 10 21:31:38.405023 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.404990    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"]
Sep 10 21:31:38.409750 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:38.409728    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5867c8d69-bxks7"]
Sep 10 21:31:39.615697 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:39.615667    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb76db8-5819-43e5-a0a8-558172f33c91" path="/var/lib/kubelet/pods/6bb76db8-5819-43e5-a0a8-558172f33c91/volumes"
Sep 10 21:31:44.199363 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:44.199320    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:31:50.299211 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:50.299173    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:31:57.203217 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:57.203177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-jmsdn"]
Sep 10 21:31:59.747573 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:31:59.747537    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66988d5cd8-84vsc_b5bf47d1-266e-468a-ab53-c8a52555d07d/authorino/0.log"
Sep 10 21:32:05.289246 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:05.289215    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dt662_cff1fda2-da66-4b33-994c-c01ef7f83b03/manager/0.log"
Sep 10 21:32:05.410820 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:05.410790    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6vc7f_7daa75af-8038-4494-a210-503d51a3ba0f/manager/0.log"
Sep 10 21:32:05.672913 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:05.672884    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2scfr_d3d47442-e9f9-4b18-8d6b-9fc2413b13e1/server/0.log"
Sep 10 21:32:06.200612 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:06.200583    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4c889df7-mzx4c_df418f19-8f48-4767-9d2c-266526a89c96/copy-manifests/0.log"
Sep 10 21:32:06.207280 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:06.207258    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4c889df7-mzx4c_df418f19-8f48-4767-9d2c-266526a89c96/manager/0.log"
Sep 10 21:32:06.579276 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:06.579249    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-767c774f97-9gnsg_131491d3-8afd-4544-bad1-17331207b636/maas-api/0.log"
Sep 10 21:32:07.856805 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:07.856769    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66988d5cd8-84vsc_b5bf47d1-266e-468a-ab53-c8a52555d07d/authorino/0.log"
Sep 10 21:32:07.972705 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:07.972676    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-h26rn_9a5ee140-5233-4c96-b8ee-c9b6905eb214/manager/0.log"
Sep 10 21:32:08.097685 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:08.097648    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-x5g5h_e659077c-8270-4f2a-9652-a255985070c6/manager/0.log"
Sep 10 21:32:08.330285 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:08.330253    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-4zghb_ae881c1e-7a8c-4120-a546-fb99a8fe40d9/manager/0.log"
Sep 10 21:32:08.451663 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:08.451637    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-jmsdn_66489f94-0c51-4e5d-82e2-2851f98629c2/limitador/0.log"
Sep 10 21:32:08.580249 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:08.580220    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-sqvr6_113dcc13-0869-40fc-bb8a-ace6041594ab/manager/0.log"
Sep 10 21:32:09.316218 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:09.316190    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f4cb8c76f-j8wdn_bd69589a-578a-4968-a79b-49bbc8e49f95/kube-auth-proxy/0.log"
Sep 10 21:32:09.442449 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:09.442405    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s6fhp_ea18f009-8376-4cff-9382-d06e4e6c47ca/istio-proxy/1.log"
Sep 10 21:32:16.852310 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.852204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:32:16.863976 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.863944    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mst9f/must-gather-9xgnv"]
Sep 10 21:32:16.864313 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.864300    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb76db8-5819-43e5-a0a8-558172f33c91" containerName="maas-api"
Sep 10 21:32:16.864372 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.864315    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb76db8-5819-43e5-a0a8-558172f33c91" containerName="maas-api"
Sep 10 21:32:16.864411 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.864386    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb76db8-5819-43e5-a0a8-558172f33c91" containerName="maas-api"
Sep 10 21:32:16.867678 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.867661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:16.873288 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.873261    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mst9f\"/\"kube-root-ca.crt\""
Sep 10 21:32:16.873601 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.873585    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mst9f\"/\"default-dockercfg-jxlqh\""
Sep 10 21:32:16.881776 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.881753    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mst9f\"/\"openshift-service-ca.crt\""
Sep 10 21:32:16.897757 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.897727    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mst9f/must-gather-9xgnv"]
Sep 10 21:32:16.935756 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.935724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/272bd904-e177-49b7-bdf2-f3d311ca92af-must-gather-output\") pod \"must-gather-9xgnv\" (UID: \"272bd904-e177-49b7-bdf2-f3d311ca92af\") " pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:16.935946 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.935832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwsp\" (UniqueName: \"kubernetes.io/projected/272bd904-e177-49b7-bdf2-f3d311ca92af-kube-api-access-5lwsp\") pod \"must-gather-9xgnv\" (UID: \"272bd904-e177-49b7-bdf2-f3d311ca92af\") " pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:16.949424 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:16.949400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log" limit=1024
Sep 10 21:32:17.036938 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:17.036894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/272bd904-e177-49b7-bdf2-f3d311ca92af-must-gather-output\") pod \"must-gather-9xgnv\" (UID: \"272bd904-e177-49b7-bdf2-f3d311ca92af\") " pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:17.037144 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:17.036973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwsp\" (UniqueName: \"kubernetes.io/projected/272bd904-e177-49b7-bdf2-f3d311ca92af-kube-api-access-5lwsp\") pod \"must-gather-9xgnv\" (UID: \"272bd904-e177-49b7-bdf2-f3d311ca92af\") " pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:17.037358 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:17.037336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/272bd904-e177-49b7-bdf2-f3d311ca92af-must-gather-output\") pod \"must-gather-9xgnv\" (UID: \"272bd904-e177-49b7-bdf2-f3d311ca92af\") " pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:17.052060 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:17.052023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwsp\" (UniqueName: \"kubernetes.io/projected/272bd904-e177-49b7-bdf2-f3d311ca92af-kube-api-access-5lwsp\") pod \"must-gather-9xgnv\" (UID: \"272bd904-e177-49b7-bdf2-f3d311ca92af\") " pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:17.176916 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:17.176826    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mst9f/must-gather-9xgnv"
Sep 10 21:32:17.447758 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:17.447731    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mst9f/must-gather-9xgnv"]
Sep 10 21:32:17.449903 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:32:17.449873    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod272bd904_e177_49b7_bdf2_f3d311ca92af.slice/crio-c5f6e5cb1684150a39e3e25966732ed5be7b6fd44d6e8bf62be7b26e4f2bd81c WatchSource:0}: Error finding container c5f6e5cb1684150a39e3e25966732ed5be7b6fd44d6e8bf62be7b26e4f2bd81c: Status 404 returned error can't find the container with id c5f6e5cb1684150a39e3e25966732ed5be7b6fd44d6e8bf62be7b26e4f2bd81c
Sep 10 21:32:17.591417 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:17.591383    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mst9f/must-gather-9xgnv" event={"ID":"272bd904-e177-49b7-bdf2-f3d311ca92af","Type":"ContainerStarted","Data":"c5f6e5cb1684150a39e3e25966732ed5be7b6fd44d6e8bf62be7b26e4f2bd81c"}
Sep 10 21:32:18.613768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:18.613179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mst9f/must-gather-9xgnv" event={"ID":"272bd904-e177-49b7-bdf2-f3d311ca92af","Type":"ContainerStarted","Data":"454ccc5f060fb6da281eaaccdb0114bb782344ef509f82d2f26893dea103c641"}
Sep 10 21:32:18.613768 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:18.613235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mst9f/must-gather-9xgnv" event={"ID":"272bd904-e177-49b7-bdf2-f3d311ca92af","Type":"ContainerStarted","Data":"468e8ab760e3ef6f04e8d6c77b66c834ea4c1bbefd3937266574d644499beffd"}
Sep 10 21:32:18.634128 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:18.633439    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mst9f/must-gather-9xgnv" podStartSLOduration=1.81114719 podStartE2EDuration="2.633417439s" totalImagesPullingTime="822.270249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:18.631813889 +0000 UTC m=+2067.543093667" watchObservedRunningTime="2026-09-10 21:32:18.633417439 +0000 UTC m=+2067.544697222"
Sep 10 21:32:19.900366 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:19.900324    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4htvn_f2ab6023-1a88-44a8-96ec-40f45d1f5966/global-pull-secret-syncer/0.log"
Sep 10 21:32:19.996923 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:19.996877    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gxs5d_abe5234c-2049-492d-bfb4-6532e86a38f3/konnectivity-agent/0.log"
Sep 10 21:32:20.094415 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:20.094379    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-100.ec2.internal_2ed333906767c71c570f41bf877f9c1e/haproxy/0.log"
Sep 10 21:32:24.452199 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:24.452084    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66988d5cd8-84vsc_b5bf47d1-266e-468a-ab53-c8a52555d07d/authorino/0.log"
Sep 10 21:32:24.490881 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:24.490841    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-h26rn_9a5ee140-5233-4c96-b8ee-c9b6905eb214/manager/0.log"
Sep 10 21:32:24.515673 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:24.515640    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-x5g5h_e659077c-8270-4f2a-9652-a255985070c6/manager/0.log"
Sep 10 21:32:24.593580 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:24.593496    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-4zghb_ae881c1e-7a8c-4120-a546-fb99a8fe40d9/manager/0.log"
Sep 10 21:32:24.623512 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:24.623474    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-jmsdn_66489f94-0c51-4e5d-82e2-2851f98629c2/limitador/0.log"
Sep 10 21:32:24.710302 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:24.710212    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-sqvr6_113dcc13-0869-40fc-bb8a-ace6041594ab/manager/0.log"
Sep 10 21:32:26.758340 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:26.758256    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2tg2_3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055/node-exporter/0.log"
Sep 10 21:32:26.788248 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:26.788211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2tg2_3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055/kube-rbac-proxy/0.log"
Sep 10 21:32:26.811559 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:26.811518    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q2tg2_3bc5e9bb-64b6-4eed-9ac9-b4f8973ae055/init-textfile/0.log"
Sep 10 21:32:27.453456 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:27.453369    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbdbd6f5d-9lkv2_604bd90e-3ef5-47ed-8e2f-76626f7453c1/telemeter-client/0.log"
Sep 10 21:32:27.479926 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:27.479896    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbdbd6f5d-9lkv2_604bd90e-3ef5-47ed-8e2f-76626f7453c1/reload/0.log"
Sep 10 21:32:27.511341 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:27.511306    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fbdbd6f5d-9lkv2_604bd90e-3ef5-47ed-8e2f-76626f7453c1/kube-rbac-proxy/0.log"
Sep 10 21:32:30.195718 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.195679    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"]
Sep 10 21:32:30.200447 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.200414    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.213445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.213124    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"]
Sep 10 21:32:30.363523 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.363483    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d96576c45-zrxmk_86edee60-2611-495b-8ae4-7f0833d8e7b4/console/0.log"
Sep 10 21:32:30.373255 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.373217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-podres\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.373445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.373266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-proc\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.373445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.373307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdctt\" (UniqueName: \"kubernetes.io/projected/10eeac50-62fa-4741-8c27-02248326d0e1-kube-api-access-gdctt\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.373445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.373371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-lib-modules\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.373445 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.373406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-sys\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.474661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-podres\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.474661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-proc\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.474661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdctt\" (UniqueName: \"kubernetes.io/projected/10eeac50-62fa-4741-8c27-02248326d0e1-kube-api-access-gdctt\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.474661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-lib-modules\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.474661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-sys\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.474661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-sys\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.474661 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474569    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-podres\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.475172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474668    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-proc\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.475172 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.474870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10eeac50-62fa-4741-8c27-02248326d0e1-lib-modules\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.487504 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.487446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdctt\" (UniqueName: \"kubernetes.io/projected/10eeac50-62fa-4741-8c27-02248326d0e1-kube-api-access-gdctt\") pod \"perf-node-gather-daemonset-662xz\" (UID: \"10eeac50-62fa-4741-8c27-02248326d0e1\") " pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.515627 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.515585    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:30.829582 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:30.829550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"]
Sep 10 21:32:30.831427 ip-10-0-134-100 kubenswrapper[2558]: W0910 21:32:30.831385    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod10eeac50_62fa_4741_8c27_02248326d0e1.slice/crio-f5731c98e5c204788e546d5a1d720580dac90a77e54a028876d21e5aeaf588cf WatchSource:0}: Error finding container f5731c98e5c204788e546d5a1d720580dac90a77e54a028876d21e5aeaf588cf: Status 404 returned error can't find the container with id f5731c98e5c204788e546d5a1d720580dac90a77e54a028876d21e5aeaf588cf
Sep 10 21:32:31.180997 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:31.180901    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-wwhs9_71c28223-175b-4940-b071-b2d3ad49d494/volume-data-source-validator/0.log"
Sep 10 21:32:31.712947 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:31.712686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz" event={"ID":"10eeac50-62fa-4741-8c27-02248326d0e1","Type":"ContainerStarted","Data":"71cb811eb089b3185513ef19d72c778b3d043c84b04fce164c39756f62c73ba9"}
Sep 10 21:32:31.713401 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:31.712992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz" event={"ID":"10eeac50-62fa-4741-8c27-02248326d0e1","Type":"ContainerStarted","Data":"f5731c98e5c204788e546d5a1d720580dac90a77e54a028876d21e5aeaf588cf"}
Sep 10 21:32:31.713401 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:31.713031    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:31.729736 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:31.729680    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz" podStartSLOduration=1.729664484 podStartE2EDuration="1.729664484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:31.727331645 +0000 UTC m=+2080.638611451" watchObservedRunningTime="2026-09-10 21:32:31.729664484 +0000 UTC m=+2080.640944266"
Sep 10 21:32:32.310727 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:32.310689    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5p67d_b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c/dns/0.log"
Sep 10 21:32:32.336599 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:32.336571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5p67d_b77ff2ed-87a6-4ba1-8e78-a4aee60a5b3c/kube-rbac-proxy/0.log"
Sep 10 21:32:32.477753 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:32.477727    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mm8nb_d5f93e88-b4d5-4485-861b-af8d84281145/dns-node-resolver/0.log"
Sep 10 21:32:33.130078 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:33.130031    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2dq2_37333b6d-ae06-4308-950a-43fb79bee3aa/node-ca/0.log"
Sep 10 21:32:34.448901 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:34.448867    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f4cb8c76f-j8wdn_bd69589a-578a-4968-a79b-49bbc8e49f95/kube-auth-proxy/0.log"
Sep 10 21:32:34.481281 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:34.481250    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s6fhp_ea18f009-8376-4cff-9382-d06e4e6c47ca/istio-proxy/0.log"
Sep 10 21:32:34.493516 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:34.493483    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s6fhp_ea18f009-8376-4cff-9382-d06e4e6c47ca/istio-proxy/1.log"
Sep 10 21:32:35.551140 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:35.551108    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sch6g_b35daeae-e0d5-4dd3-b34d-85c520c137de/serve-healthcheck-canary/0.log"
Sep 10 21:32:36.072939 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:36.072910    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zjlg_6e21a780-6040-4adc-bffc-ac0c2a120682/kube-rbac-proxy/0.log"
Sep 10 21:32:36.097936 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:36.097906    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zjlg_6e21a780-6040-4adc-bffc-ac0c2a120682/exporter/0.log"
Sep 10 21:32:36.121138 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:36.121110    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zjlg_6e21a780-6040-4adc-bffc-ac0c2a120682/extractor/0.log"
Sep 10 21:32:37.728872 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:37.728840    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mst9f/perf-node-gather-daemonset-662xz"
Sep 10 21:32:38.490242 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:38.490208    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dt662_cff1fda2-da66-4b33-994c-c01ef7f83b03/manager/0.log"
Sep 10 21:32:38.739315 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:38.739252    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6vc7f_7daa75af-8038-4494-a210-503d51a3ba0f/manager/0.log"
Sep 10 21:32:38.811008 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:38.810966    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2scfr_d3d47442-e9f9-4b18-8d6b-9fc2413b13e1/server/0.log"
Sep 10 21:32:39.075614 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:39.075531    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4c889df7-mzx4c_df418f19-8f48-4767-9d2c-266526a89c96/manager/0.log"
Sep 10 21:32:39.102286 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:39.102249    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4c889df7-mzx4c_df418f19-8f48-4767-9d2c-266526a89c96/copy-manifests/0.log"
Sep 10 21:32:40.815742 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:40.815710    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f4cb8c76f-j8wdn_bd69589a-578a-4968-a79b-49bbc8e49f95/kube-auth-proxy/0.log"
Sep 10 21:32:40.836536 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:40.836502    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s6fhp_ea18f009-8376-4cff-9382-d06e4e6c47ca/istio-proxy/0.log"
Sep 10 21:32:40.847361 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:40.847326    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s6fhp_ea18f009-8376-4cff-9382-d06e4e6c47ca/istio-proxy/1.log"
Sep 10 21:32:42.706269 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:42.706178    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f4cb8c76f-j8wdn_bd69589a-578a-4968-a79b-49bbc8e49f95/kube-auth-proxy/0.log"
Sep 10 21:32:42.726975 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:42.726948    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s6fhp_ea18f009-8376-4cff-9382-d06e4e6c47ca/istio-proxy/0.log"
Sep 10 21:32:42.737760 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:42.737736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-s6fhp_ea18f009-8376-4cff-9382-d06e4e6c47ca/istio-proxy/1.log"
Sep 10 21:32:45.852561 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:45.852532    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-jp692_ec7352cf-af57-4eff-a5b5-525d4388897a/migrator/0.log"
Sep 10 21:32:45.874510 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:45.874468    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-jp692_ec7352cf-af57-4eff-a5b5-525d4388897a/graceful-termination/0.log"
Sep 10 21:32:46.289711 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:46.289638    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-47xx8_1395e3ad-48ba-4e33-a176-8966702e5402/kube-storage-version-migrator-operator/1.log"
Sep 10 21:32:46.290890 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:46.290864    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-47xx8_1395e3ad-48ba-4e33-a176-8966702e5402/kube-storage-version-migrator-operator/0.log"
Sep 10 21:32:47.366866 ip-10-0-134-100 kubenswrapper[2558]: I0910 21:32:47.366838    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-49fks_ca7d60d4-7b8b-4684-9417-db0ad44fbc80/kube-multus/0.log"